none
How can I use LogParser to query Storage Analytics Logs?

    Question

  • I've enabled logging of blob-store requests...

    http://blogs.msdn.com/b/windowsazurestorage/archive/2011/08/03/windows-azure-storage-logging-using-logs-to-track-storage-requests.aspx

    Which produces log files in this format...

    https://msdn.microsoft.com/en-us/library/azure/hh343259.aspx

    I want to query the content of these logs. I presume using LogParser.exe is the easiest way - but I that I need a plugin which parses each log entry, on behalf of LogParser.

    i.e. As described by...

    http://blogs.iis.net/robert_mcmurray/advanced-log-parser-part-7-creating-a-generic-input-format-plug-in

    But surely someone has already solved this problem?


    Guy le Mar | Dell

    Thursday, January 21, 2016 2:09 AM

Answers

  • Thanks Girish,

    The solution I ended up using, was to "convert" the log files into CSV.

    I did this by downloading the log files locally, then running a C# script (via linqpad) to convert each log file into a CSV file. After that, I used LogParser to query the CSV files.

    The 'trick' here is that the CSV files can contain the metadata that is missing from the log files. i.e. The CSV files contain a header that LogParser can use to know what each field in the file is called.

    Regards,

    Guy


    Guy le Mar | Dell

    • Marked as answer by gmar467 Wednesday, January 27, 2016 5:11 AM
    Wednesday, January 27, 2016 5:11 AM

All replies

  • Hi,

    Thanks for posting here.

    I suggest you to check the below article on logparser.

    http://geekswithblogs.net/woodenshoe/archive/2011/03/15/144375.aspx

    Hope it helps.

    Girish Prajwal

    Thursday, January 21, 2016 4:20 PM
    Moderator
  • Thanks Girish,

    The solution I ended up using, was to "convert" the log files into CSV.

    I did this by downloading the log files locally, then running a C# script (via linqpad) to convert each log file into a CSV file. After that, I used LogParser to query the CSV files.

    The 'trick' here is that the CSV files can contain the metadata that is missing from the log files. i.e. The CSV files contain a header that LogParser can use to know what each field in the file is called.

    Regards,

    Guy


    Guy le Mar | Dell

    • Marked as answer by gmar467 Wednesday, January 27, 2016 5:11 AM
    Wednesday, January 27, 2016 5:11 AM