Saturday, November 17, 2012 1:45 AM
I have an ssis package which loads 1.2 million records of data from oracle into SQL SERVER 2008R2(with 32GB RAM) dataware house table once every week. (truncating and loading)
This process is taking 5 hours to complete the load of 1.2 million records.
If any body did the same thing,i wanted to know their average time to complete the load.
I am new to ssis. Please advice me. Is 5 hours an optimum time ??
Note: the destination table is de-normalized and no indexes are there on it because it is in the dataware house.
- Edited by Testing1.1 Saturday, November 17, 2012 1:47 AM ram details
Monday, November 19, 2012 11:26 AMModerator
Microsoft announced a white paper about loading data using Microsoft SQL Server Integration Services (SSIS): 1 TB of data in less than 30 minutes. That data load, using SQL Server Integration Services, was 30% faster than the previous best time using a commercial ETL tool. This paper outlines what it took: the software, hardware, and configuration used. It describe what they did to achieve that result, and offer suggestions for how to relate these techniques to typical scenarios. Even for customers who don’t have needs quite like this benchmark, such efforts can teach a lot about getting optimal performance. Regarding this issue, I suggest that you go through the useful white paper:
We Loaded 1TB in 30 Minutes with SSIS, and So Can You
TechNet Community Support
- Marked As Answer by Mike YinMicrosoft Contingent Staff, Moderator Sunday, November 25, 2012 4:49 PM