locked
Removing special characters in ssis RRS feed

  • Question

  • Hi All,

    I have one table with 1.2 million records. I want remove some special characters like .,/  spaces  etc particularly 2 columns name and address and I have duplicates on that columns also. I used fuzzy group transformation after 1 hour also the package running. Please help good approach.

    Thanks

    Friday, April 27, 2012 12:46 AM

Answers

  • Hi there,

    You can use SSIS Sort Transformation component to remove duplicates.

    As for removing special characters, I suggest using T-SQL functions alike REPLACE or combination of CHARINDEX and SUBSTRING. This helps you get better performance as it puts the processing burden on DB Engine before engaging SSIS.

    Cheers.


    http://thebipalace.wordpress.com


    • Edited by SaeedB Friday, April 27, 2012 1:26 AM
    • Marked as answer by Eileen Zhao Monday, May 7, 2012 12:51 AM
    Friday, April 27, 2012 1:24 AM