locked
Azure Storage - Diagnostics Logs and Metrics not stored periodically RRS feed

  • Question

  • Hi,

    We have an issue in retrieving diagnostics data from Azure Storage accounts for Azure SQL database.

    We have configured diagnostics settings for an Azure SQL database to store the logs and metrics to a Storage account. As per configuration, the .json file containing the metrics is generated under a Blob service in the storage account. Each .json file contains data for 1 hour, one record for each minute (starting from 00:00 to 00:59).

    As per the Microsoft blog(https://docs.microsoft.com/en-us/azure/monitoring-and-diagnostics/monitoring-archive-activity-log), we expect this .json file to be generated at an interval of 1 hour. But the issue is, the files are created randomly.

    Example 1 : .json files for hour=0,1,2,3,4,5 are generated on hour=8

    Example 2 : .json files for day=1,hour=22,23 are generated on day=2,hour=1

    Expectation : .json file for h=5 should be generated once the 5th hour of the day is completed.

    Note : The expected behavior also occurs sometimes.

    Sample scenario : UTC time now is 9.00am. So we expect the last .json file to be generated for h=8,m=0 to 59. But the last generated file stands at h=4 containing data from 4.00 to 4.59

    Kindly check the issue and let us know how this inconsistency with diagnostics metrics storage an be avoided and generate files at regular intervals, as we rely on accurate periodic diagnostics.

    Thursday, December 7, 2017 9:39 AM

Answers

All replies

  • Is there Activity Log data during these absent periods?

    Activity Log data tends to not be as continuous as diagnostic log data.  If there isn't any Activity Log data for that hour, there won't be a blob. 

    ------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members

    Thursday, December 7, 2017 6:23 PM
  • Thanks for the info !

    My doubt is regarding Diagnostics log data, not Activity logs. I guessed that the logging procedure would be common for Diagnostics logs and Activity logs, and hence referred the above mentioned link.

    The issue we face is, the diagnostics logs are not generated for every hour. Any information is this regard will be helpful.

    Thanks in advance. 

    Friday, December 8, 2017 6:27 AM
  • As Sumanth pointed out, did data get generated during the periods when you didn’t see a log file being created?

    -----------------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members.

    Sunday, December 10, 2017 3:11 AM
  • Yes, diagnostics data are shown in Azure Portal during the periods when no diagnostics logs are created !
    Monday, December 11, 2017 7:12 AM
  • Can you refer to the suggestion mentioned in this article

    Enabling Storage Logging and Accessing Log Data

    --------------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members.




    Tuesday, December 12, 2017 2:18 PM