none
Copy file from Azure Data Lake to Blob Storage using Power Shell

    Question

  • Hi - 

    Is there a way to copy files from ADL Store to Blob storage? I would like to use PowerShell scripting as I have to copy specific files from ADL Store based on certain criteria. I will then use this PS script in my Automation account.

    What are my options, if any.

    Thanks

    Mohit

    Sunday, November 26, 2017 1:05 AM

All replies

  • Hi Mohit,

    The simplest way would be to do it in the 2 steps below:

    1. Download the file/s from ADLS to the local disk using Export-AzureRmDataLakeStoreItem.

    2. Upload them to Blob Storage using Blob Storage specific commandlets.

    You could submit USQL scripts that would copy the data for you (e.g. https://github.com/MicrosoftDocs/azure-docs/blob/master/articles/data-lake-analytics/data-lake-analytics-get-started-powershell.md) . But it will require you to track the job status, retry etc.

    Let us know if either of the above options don't work for you.

    Thanks,
    Sachin Sheth
    Azure Data Lake team.

    Monday, November 27, 2017 8:53 PM
  • Thanks Sachin -

    I want to use my PS script inside an autmation runbook. So not sure how Export-AzureRmDataLakeStoreItem will work in such a scenario as I won't have access to local disk.

    Will look at USQL script. It would be great if there is a poweshell command or a tool to copy/move files from ADL Store to Blob Storage.

    Regards

    Mohit

    Tuesday, November 28, 2017 3:05 PM