locked
Huge TB upload with AzCopy RRS feed

  • Question

  • Hello Experts,

    I just wanted to ask if AzCopy can be utilized to upload about 4 TB of data to Azure Blob Storage...any gotchas are limitations?

    Thursday, March 28, 2019 12:41 AM

Answers

  • Yes, you can use Azcopy to transfer the data to Azure 

    Choose an Azure solution for data transfer 

    Additional information: You can upload to Block Blob 50000 blocks limit is for each object in container. You can have multiple objects each having 50000*100mb size

    The maximum size for a page blob is 8 TB.

    The maximum size of an append blob is therefore slightly more than 195 GB (4 MB X 50,000 blocks).

     Kindly let us know if the above helps or you need further assistance on this issue.

    ------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members.

    Thursday, March 28, 2019 5:35 AM
  • Depending on your Internet connection, you might want to consider Azure Import/Export instead

    https://docs.microsoft.com/en-us/azure/storage/common/storage-import-export-service

    hth
    Marcin

    • Marked as answer by ghostme Thursday, March 28, 2019 2:30 PM
    Thursday, March 28, 2019 10:55 AM

All replies

  • Yes, you can use Azcopy to transfer the data to Azure 

    Choose an Azure solution for data transfer 

    Additional information: You can upload to Block Blob 50000 blocks limit is for each object in container. You can have multiple objects each having 50000*100mb size

    The maximum size for a page blob is 8 TB.

    The maximum size of an append blob is therefore slightly more than 195 GB (4 MB X 50,000 blocks).

     Kindly let us know if the above helps or you need further assistance on this issue.

    ------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members.

    Thursday, March 28, 2019 5:35 AM
  • Depending on your Internet connection, you might want to consider Azure Import/Export instead

    https://docs.microsoft.com/en-us/azure/storage/common/storage-import-export-service

    hth
    Marcin

    • Marked as answer by ghostme Thursday, March 28, 2019 2:30 PM
    Thursday, March 28, 2019 10:55 AM
  • Thanks for the response...

    The import/export service looks great too...One question though is this...

    I have some VMWare VMs with huge data disk size such as 5TB and 6TB...with the new support for larger disk sizes in Azure VM can I use the import/export to ship this data disk (after converting them to .VHD) and then reattached them to a VM in azure?

    Thursday, March 28, 2019 12:39 PM
  • Yes - you should be able to (minor adjustments will likely be required, including installation of the VM agent and moving the swap file to the temporary disk)

    hth
    Marcin

    Thursday, March 28, 2019 12:51 PM
  • Hi Marcin,

    Thanks for the response...in this case it will be only for the "Data Disks" and not the OS disks...so let's assume the VM is migrated to Azure without the huge data using ASR and then we ship the huge data disk using the import/export and then reattached them to the migrated VM?

    Thursday, March 28, 2019 1:27 PM
  • Correct - this makes it much more straightforward

    hth
    Marcin

    Thursday, March 28, 2019 1:29 PM
  • Thanks!!
    Thursday, March 28, 2019 2:30 PM