locked
How to identify source of blob data RRS feed

  • Question

  • How do I track down the source of blob data being stored in Azure?  I can see that the storage usage is 792.83 GB but I can't tell where that has come from.  What's the best way to see which services are depositing data into a specific storage account?

    Wednesday, April 13, 2016 7:30 PM

All replies

  • Hi Edmund,

    Thanks for posting here.

    To identify which services are depositing data into a specific storage account you can try with 2 steps.

    1. You have to manually check with each services where your storage account is linked which is depositing huge amount of data.
    http://www.cerebrata.com/products/azure-management-studio/introduction

    2. Contact Billing team (free assistance) for the storage account utilization.
    https://azure.microsoft.com/en-us/support/options/

    Regards,
    Vikrant


    • Edited by vikranth s Thursday, April 14, 2016 2:44 PM
    Thursday, April 14, 2016 2:40 PM
  • Hi Edmund,

    If you turn on the Storage Analytics, it will log every single request made to Azure Blob Storage, and you can see where the requests are coming from that are writing data.

    How to monitor a storage account:

    https://azure.microsoft.com/en-us/documentation/articles/storage-monitor-storage-account/

    Storage Analytics reference information:

    https://msdn.microsoft.com/en-us/library/azure/hh343270.aspx

    Robin


    Sr. Content Developer at Microsoft

    Monday, April 18, 2016 10:11 PM
  • Thanks for this but the tool you quoted only appears to display "Classic" storage accounts and not the new ones.  The storage account affected is listed under "Storage accounts" but not "Storage accounts (classic)"

    Thanks,
    Edmund

    Tuesday, April 19, 2016 9:06 AM
  • Thanks but these instructions seem to refer to the old portal but the storage account affected is listed in the new portal under "Storage accounts" and not "Storage accounts (classic)" or on the old portal.

    Thanks,
    Edmund


    Tuesday, April 19, 2016 9:07 AM
  • You're right that the article shows graphics from the Classic Portal. I'll make sure those articles get updated.

    As for Cerebrata, I was able to add my ARM storage account with no problem. What happened when you tried to do that?  (I created the account using the Portal).

    In the Azure Portal, if you go into your storage account and look at settings, you can click Diagnostics and it will show all of the diagnostic data you can retrieve. At the bottom of that blade, you can see the Blob logs, Table logs, and Queue logs. Just check whichever one(s) you're interested in, set the retention time, and save the settings. This will turn on Diagnostics and Logging.

    You can easily view this information using the Cerebrata Azure Management Studio. I think they also have an Azure Storage Explorer, but that's a free product that doesn't have the full capabilities of AMS.

    Unfortunately, you pretty much have to use one of the storage explorers to view that data, because those tables are hidden to PowerShell and to the Server Explorer in Visual Studio. Here's an article listing many of the Azure Storage Explorers we know about:

    https://azure.microsoft.com/en-us/documentation/articles/storage-explorers/

    HTH,

    Robin


    Sr. Content Developer at Microsoft

    • Proposed as answer by vikranth s Wednesday, April 27, 2016 4:34 PM
    Wednesday, April 20, 2016 2:32 AM