locked
Log parser throws out of memory exception RRS feed

  • Question

  • User-952733979 posted

    ASP.NET application using COM interface of the Log parser throws OutOfMemoryException on call to ExecuteBatch(). This application which is supposed to be run every so often and so processes the log files incrementally is left unrun, as a result of which is having to deal with large data. The input to the the Log parser query is IIS logs files.

    LogQueryClassClass query = new LogQueryClassClass();
    query.ExecuteBatch()

    To get around the issue, I changed the query to extract only limited no. of records out of log files (simply by specifying SELECT TOP n). But, the COM object that helps remember(using object's property called iCheckPoint) how far we are upto in the log files, REFUSES to record the line number in the checkpoint file the fact that we are only part way through.

    Can someone be able to see how to cope with either the original problem or with what I attempted to do?

    Other bits of code to put in the context....
    COMIISW3CInputContextClassClass w3cIn = new COMIISW3CInputContextClassClass();
    w3cIn.iCheckpoint = checkPointFile;
    w3cIn.consolidateLogs =
    true;

    Thanks
    Venkat

    Tuesday, October 19, 2010 11:05 AM

All replies

  • User690216013 posted
    Log Parser is 32 bit only, so it cannot handle large data. If you really need to do data mining, please use database techniques instead.
    Wednesday, October 20, 2010 9:06 AM