locked
Syncing large amounts of data to Azure RRS feed

  • Question

  • Hello all,

    I'm looking at methods of getting ~20TB up to Azure. Obviously one method would to use Import/Export service but ideally i'd like to do this over the wire so that I can get a full sync of the data as its "live". OR can the import/export service give me a point-in-time copy, and then copy the changes?

    Any thoughts anyone? Has anyone tried to do this amount of data and share experiences?

    Thanks,

    Ravi

    Wednesday, October 22, 2014 9:35 AM

Answers

  • Hi Ravi,

    As Manu said, you may need the tool called AzCopy, it will help you to achieve batch operations on Azure Storage: http://azure.microsoft.com/en-us/documentation/articles/storage-use-azcopy/

    You can download or upload all your files thru it, but I don't think it can identify the change and sync them only.

    Regards,

    Sean


    Tuesday, November 4, 2014 10:06 AM

All replies

  • Hi Ravi,

    You can use the  Import/Export service to transfer large amounts of file data to Azure Blob storage in situations where uploading over the network is prohibitively expensive or not feasible.

    You may refer the following link for more detailed info : http://azure.microsoft.com/en-us/documentation/articles/storage-import-export-service/

    Also, you may try to use "AzCopy", a command line utility which allows transferring data in to and out of a Windows Azure Storage account.

    Please refer : http://blogs.msdn.com/b/mast/archive/2014/06/28/how-to-copy-files-to-from-azure-storage.aspx

    Regards,

    Manu Rekhar

    Wednesday, October 22, 2014 10:59 AM
  • Hi Manu,

    Yes - I have already mentioned in my post that I am aware of the Import/Export service. But I want to know how I go about syncronising the changes from the Import-HD to what changes are made on the FS..

    thanks

    Ravi

    Wednesday, October 22, 2014 12:25 PM
  • Hi Ravi,

    As Manu said, you may need the tool called AzCopy, it will help you to achieve batch operations on Azure Storage: http://azure.microsoft.com/en-us/documentation/articles/storage-use-azcopy/

    You can download or upload all your files thru it, but I don't think it can identify the change and sync them only.

    Regards,

    Sean


    Tuesday, November 4, 2014 10:06 AM