I have heard Hadoop would replace datawarehouse/SSIS - your thoughts?

Question

I've seen people referring to Hadoop as the "Distributed Data processing" layer and " Distributed data storage" layer. My question - does it (or rather will it?) replace some/all of datawarehouse/SSIS projects? Your thoughts please? please think about scenario's that are two-three years down the line..

Answer 1

Hadoop is for processing huge (petabytes) unstructured data sources, like web logs, click stream, etc.

It is not so good for processing structured data from OLTP systems.

With the introduction of PolyBase (http://www.zdnet.com/microsofts-polybase-mashes-up-sql-server-and-hadoop-7000007424/) Hadoop becomes just another part of the SQL Server an we will use it as just another part of the warehouse. Depending on the structure of the data source we will use hadoop and old fashioned approach to gather source data.

Answer 2

Thanks for the insightful reply; this is helpful..... keeping the thread open to see what others think about it as wel.....

Thanks.....