Average Time to Load 1.2 million records from Oracle INTO SQL SERVER 2008R2

Question

Hi All,

I have an ssis package which loads 1.2 million records of data from oracle into SQL SERVER 2008R2(with 32GB RAM) dataware house table once every week. (truncating and loading)

This process is taking 5 hours to complete the load of 1.2 million records.

If any body did the same thing,i wanted to know their average time to complete the load.

I am new to ssis. Please advice me. Is 5 hours an optimum time ??

Note: the destination table is de-normalized and no indexes are there on it because it is in the dataware house.

Answer 1

Hi,

Microsoft announced a white paper about loading data using Microsoft SQL Server Integration Services (SSIS): 1 TB of data in less than 30 minutes. That data load, using SQL Server Integration Services, was 30% faster than the previous best time using a commercial ETL tool. This paper outlines what it took: the software, hardware, and configuration used. It describe what they did to achieve that result, and offer suggestions for how to relate these techniques to typical scenarios. Even for customers who don’t have needs quite like this benchmark, such efforts can teach a lot about getting optimal performance. Regarding this issue, I suggest that you go through the useful white paper:
We Loaded 1TB in 30 Minutes with SSIS, and So Can You

Regards,

---

Mike Yin

TechNet Community Support