none
What is the simplest way to copy data from a hard drive (CSV files) to an Azure Data lake ?

    Question

  • Hello Azure Champions! 

    I have a hard drive that contains around 60GB of data. And I want to copy that in an Azure Data Lake. 

    What is the simplest way to do that ? 

    Thank you for your help!

    Monday, November 6, 2017 10:46 AM

All replies

  • Hi,

    The easiest way would be to connect it to a PC and then using Azure Powershell commandlets (https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-get-started-powershell) or Azure CLI commands (https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-get-started-cli-2.0) to upload the data to Azure Data Lake Store. With a reasonable connectivity from your machines (say 10 Mbps) if you are able to fill up the NIC bandwidth, you can upload 100GB in a day.

    If you do not have reliable connectivity, you could use Azure Import/Export (https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-offline-bulk-data-upload). 

    Thanks,
    Sachin Sheth,
    Program Manager
    Azure Data Lake.

    Tuesday, November 28, 2017 12:23 AM