analyzing log files w/ SSIS and SQL Server - any tutorials?

Question

analyzing log files w/ SSIS and SQL Server - any tutorials? Thanks.....

consider the data source as IIS log files.... can we read them using SSIS? and store it in SQL Server? And then do some "analysis"?

Is this a possible scenario?

what sort of problems do you see coming?

Answer 1

You have to make sure your SSIS data source is expecting the appropriate type of log (ODBC) and that IIS is configured to use that log format. It should be pretty straight forward with IIS writing its logs to ODBC you can then just point an SSIS file connection at the log and pull it out as regular ETL job.

http://msdn.microsoft.com/en-us/library/ms525410(v=vs.90).aspx

---

If you're happy and you know it vote and mark.

Answer 2

Look into the post http://www.sqlservercentral.com/Forums/Topic1021301-364-1.aspx#bm1021329 for more details. You can either use SSIS or Log parser(http://www.microsoft.com/en-us/download/details.aspx?id=24659) as mentioned in the thread.

---

Venkataraman R Be Blessed by Divine

Answer 3

Thanks for the answers. on the other forum - we are having a discussion of using hadoop vs SSIS for log analysis. Please join the discussion! here's the thread: http://social.msdn.microsoft.com/Forums/en-US/hdinsight/thread/b3c46e59-be36-4b87-8c12-bc5ec0416b79/#05192592-b49e-4390-af45-7f5312b5de2d

Answer 4

http://technet.microsoft.com/en-us/sqlserver/hh319894.aspx

Answer 5

Hadoop and SSIS:

http://technet.microsoft.com/en-us/library/jj720569.aspx