locked
how to get the duplicate file in ssis RRS feed

  • Question

  • is it possible that i can retrieve the list of all records that are duplicate and put them in a excel files
    Thursday, November 16, 2006 6:30 AM

Answers

  • Hi There,

    Use this query to get the duplicate records from a table, if you are using flat file as a source, load it to the database table and use this query:

    select coulmn a from <tablename> where column a in (select column a from <tablename> group by column a having count(*) > 1). This query will give you the list of records which is duplicate. Later you can add an excel destination to load these duplicate records.

     

    Regards,

    Raju

    Thursday, November 16, 2006 6:36 AM

All replies

  • Hi There,

    Use this query to get the duplicate records from a table, if you are using flat file as a source, load it to the database table and use this query:

    select coulmn a from <tablename> where column a in (select column a from <tablename> group by column a having count(*) > 1). This query will give you the list of records which is duplicate. Later you can add an excel destination to load these duplicate records.

     

    Regards,

    Raju

    Thursday, November 16, 2006 6:36 AM
  • Hi

    thanks for the reply, It work nice, somehow it disappoint me a bit (not on your answer), cause i thought i won't use the query anymore to disect the data and I thought ssis has tool for this. Anyway thanks!!!

     Jagapathi Raju wrote:

    Hi There,

    Use this query to get the duplicate records from a table, if you are using flat file as a source, load it to the database table and use this query:

    select coulmn a from <tablename> where column a in (select column a from <tablename> group by column a having count(*) > 1). This query will give you the list of records which is duplicate. Later you can add an excel destination to load these duplicate records.

     

    Regards,

    Raju

    Thursday, November 16, 2006 7:04 AM