locked
Azure Files or Disk? RRS feed

  • Question

  • Hello,

    I starting a project to move approximately 1 PB of data from offline storage (USB drives) to online storage. This data consists mostly of imagery files and contract files. Approximately 26% will need to be accessed via web service applications as well as other client uses so a somewhat higher performance throughput and IOPS will be necessary (may fall into standard or premium storage). The data will mostly be read-only. I have been investigating cloud storage and have found both Azure Files and Azure Disk. Azure Files appears to be the cheaper of the 2. Which would be better for this scenario? Azure Files or Azure Disk?

    For the remaining 74% it will be for archival purposes only. Periodically some data from archival will need to be copied to the readily available high performance storage (above) and acceptable retrieval times will be no more than 5 working days. What Azure storage would be best recommended for archival?

    Thursday, February 27, 2020 4:44 PM

Answers

  • Azure Disks are meant to be used as Azure VMs disks - in other words, you have to deploy an Azure VM (and pay for its compute resources - in addition to the disks-related charges). 

    Azure Files do not require Azure VMs - it's essentially a managed storage that provides access via SMB and REST.

    Azure Blobs is yet another manage storage offering - that provides access via HTTP/HTTPS and three access tiers (hot, cool, and archive). In this case the pricing consists of two components:

    - storage in GB

    - access charges.

    With hot access tier, storage pricing is highest but access charges are lowest - with archive tier, it's the opposite. In addition, there is  a significant delay when accessing archive tier-based blobs (hours). 

    You might want to review https://docs.microsoft.com/en-us/azure/storage/common/storage-decide-blobs-files-disks

    hth
    Marcin

    Thursday, February 27, 2020 11:49 PM

All replies

  • For archived data, you would likely want to leverage Azure blob storage (which supports the archive tier).

    In regard to first part of the question - how do you intend to access that data?

    hth
    Marcin

    Thursday, February 27, 2020 4:55 PM
  • In the first higher performance tier, a good part of the data gets accessed by a GIS web services application. Other data does get accessed and used for other miscellaneous purposes such as other applications and data accessed directly for historical analysis, legal evidence, etc.
    Thursday, February 27, 2020 5:00 PM
  • I am still not clear on the differences between Azure Managed Disks and Azure Files. I found these sites but I do not find they cover my scenario.

    https://docs.microsoft.com/en-us/azure/storage/common/storage-decide-blobs-files-disks

    https://docs.microsoft.com/en-us/rest/api/storageservices/features-not-supported-by-the-azure-file-service

    ========================================

    I looked at this site for Azure Managed Disks:

    https://azure.microsoft.com/en-us/pricing/details/managed-disks/

    I looked at this site for Azure Files:

    https://docs.microsoft.com/en-us/azure/storage/files/storage-files-scale-targets

    The Azure Managed Disk site shows performance of 2000 IOPS per disk and 500MB/S throughput for the standard HDD and 6000 IOPS per disk and 750 MB/S throughput for Standard SSD.

    The Azure Files site shows performance of 10,000 IOPS per share and 300 MiB/S for a standard file share with a size of 100 TB. It shows 100,000 IOPS per share and 6,204 MiB/S for a premium file share with a size of  100 TB.

    I may be reading this wrong but there looks like a big performance difference between Azure managed disks and Azure files.

    When looking at pricing I checked out these sites:

    https://azure.microsoft.com/en-us/pricing/details/storage/files/

    https://azure.microsoft.com/en-us/pricing/details/managed-disks/

    The Azure files lists the price per GB as approximately $0.3 per month for premium and $0.085 per month for standard. The Azure Managed Disks lists a price of $1845.50 per month for a 32 TiB HDD. Azure Managed Disks appear much more expensive then Azure Files.

    If someone can clear this up for me it would be greatly appreciated. Also, pricing on cool and cold archival storage would be helpful. Thanks.



    • Edited by LorenZ_DA Thursday, February 27, 2020 11:28 PM
    Thursday, February 27, 2020 11:26 PM
  • Azure Disks are meant to be used as Azure VMs disks - in other words, you have to deploy an Azure VM (and pay for its compute resources - in addition to the disks-related charges). 

    Azure Files do not require Azure VMs - it's essentially a managed storage that provides access via SMB and REST.

    Azure Blobs is yet another manage storage offering - that provides access via HTTP/HTTPS and three access tiers (hot, cool, and archive). In this case the pricing consists of two components:

    - storage in GB

    - access charges.

    With hot access tier, storage pricing is highest but access charges are lowest - with archive tier, it's the opposite. In addition, there is  a significant delay when accessing archive tier-based blobs (hours). 

    You might want to review https://docs.microsoft.com/en-us/azure/storage/common/storage-decide-blobs-files-disks

    hth
    Marcin

    Thursday, February 27, 2020 11:49 PM
  • Is there any update on the issue?

    If the suggested answer helped for your issue, do click on "Mark as Answer" and “Vote as Helpful” on the post that helps you, this can be beneficial to other community members.

    Monday, March 2, 2020 6:47 AM
  • Is there any update on the issue?

    If the suggested answer helped for your issue, do click on "Mark as Answer" and “Vote as Helpful” on the post that helps you, this can be beneficial to other community members.

    Thursday, March 5, 2020 10:45 AM