"Skip duplicate outputs" not working RRS feed

  • Question

  • I have a Data Flow with a select statement

    The option "Skip duplicate outpunt" is checken.

    But all duplicates are in the output (currently all columns have the same content to test)

    the output


    Thursday, September 12, 2019 5:06 PM

All replies

  • Apologizes for the delay on the reply . 

    The SELECT option is an part of the schema modifier and so it will be working on the columns and not on the rows . So if you have duplicate columns name and then setting the option will remove from the output . I think this is called out in tool tip . I am attaching the screen shot below . If you are trying to remove the duplicate , you can use the Row modifier and that should help . 

    Please do let me know if you have any other question .

    If you see I have added the same column twice , but in the output we have only 1 column 

    Thanks Himanshu

    Wednesday, September 18, 2019 7:25 PM