Wednesday, January 04, 2012 10:56 AM
In SSIS, there is DQS Cleansing transform. Is there any transform in SSIS for matching records or for finding duplicate records?
Thanks in advance!!
Wednesday, January 04, 2012 2:10 PMModerator
There is no DQS Matching feature in SSIS components at this time.
SSIS already has a Fuzzy Grouping component in the Dataflow Task toolbox which does some algorithms to find near deduplicate and similarities. Fuzzy Grouping looks for similarities and duplicates in the incoming stream of data (as comparing that data set to itself). Fuzzy Lookup does the comparison between the incoming stream of data and a second reference table that you point to (ie. the lookup).
Its a popular request for DQS, so I think the product group is aware that people want the DQS one.
Please vote up this idea on the connect site:
Didn't get enough help here? Submit a case with the Microsoft Customer Support team for deeper investigation - http://support.microsoft.com/select/default.aspx?target=assistance