locked
Best Storage Option among Azure SQL storage and Azure Table storage for Data of Size 80TB of PDF files. RRS feed

  • Question

  • I want to know whether which one is the best option to store 80Tb of data.

    This 80TB of data has PDF files in it. I want to upload PDF files into storage and retrieve when the customers request for it. Total there are 40 Millions of PDF files to store.

    Right now I am using traditional Varbinary(max) to store my PDF files but it costs more and maintenance of such huge database is becoming difficult.

    So, I want move my storage to Azure Services so that I want to reduce cost, Increase the availability and reduce the maintenance work of such huge data.

    Can anyone let me know which service from Azure SQL storage and Azure Table storage is best for above requirement?

    Thanks! 

    Sunday, April 6, 2014 12:43 AM

Answers

All replies

  • Hi Sai,

    I would recommend you to use Azure Storage Services - Table storage and blob storage together.

    Blob Storage - Will hold actually a pdf file. Means upload your pdf files in blob storage.

    Table storage - Will hold the record for a PDF file [like details of file ex. name, size etc] and will have a column which will point to the url of pdf file present in blob storage.

    Here are the details about storage operations -

    Blob usage - http://azure.microsoft.com/en-us/documentation/articles/storage-dotnet-how-to-use-blobs-20/

    Table usage - http://azure.microsoft.com/en-us/documentation/articles/storage-dotnet-how-to-use-table-storage-20/

    A Sample multi tier app using storage - http://code.msdn.microsoft.com/windowsazure/Windows-Azure-Multi-Tier-eadceb36

    Hope this helps.


    Mark As Answer if it helps you | My Blog

    Sunday, April 6, 2014 4:13 AM
  • Yes. you can store the PDF files in blob storage and maintain the reference in sql storage table or sql azure table depending on your requirement. 

    for a comparison:http://codecloudy.wordpress.com/2014/03/11/understanding-windows-azure-tables-comparing-with-relational-sql-tables-on-premisesql-azure/

    -----------------------------------------------------------------------------------------------------

    If you found this post useful, Please "Mark as Answer" or "Vote as Helpful".

    Sunday, April 6, 2014 3:51 PM
  • Thanks for the response!!

    Is storing the documents in the blob storage is secured? Does they provide any confidentiality for the PDF documents?

    Is there any other way to store the PDF documents in Azure blob storage in a secured manner?

    What would be cost difference between mainitaining local servers of 80TB and pushing the 80TB of data into Azure blob storage?


    Sunday, April 6, 2014 6:11 PM
  • You can certainly encrypt them on the blob storage upon writing and decrypt them upon reading, sure.  You have the option to encrypt them all with the same key, different keys, different algorithms, whatever your needs are.

    The cost difference?  That depends on your local setup to host the data. 

    I'd use the azure calculator to estimate what it would cost. 


    Darin R.

    Sunday, April 6, 2014 7:01 PM