locked
How to insert data into destination table if not exists using SSIS RRS feed

  • Question

  • Hi Team,

    Want to load data source to destination if not exists in destination table.

    For example:

    1. Have 1000 records in source table

    2. I did a flat load to destination table

    3. After some time few records updated in source table

    4. I want to load updated records to destination table without updating existing records.


    Thanks Bala Narasimha

    Monday, November 25, 2019 7:41 AM

All replies

  • If possible, you can have a filter condition in SELECT query in OLEDB source which gives only latest records based on date condition. 

    Else, you can use lookup transformation to check what records are new at source. 

    Please refer below. Instead of OLEDB connection, use Cache connection to lookup to flat file. 

    https://www.tutorialgateway.org/ssis-incremental-load-better-approach/


    If the response helped, do "Mark as answer" or upvote it
    - Vaibhav

    Monday, November 25, 2019 7:52 AM
  • Hi BaluChalla,

    Thanks for posting here.

    May I know that if you want to add the updated columns to destination?

    If so, here are some ideas:

    1.Use CDC Task to find out the updated columns and add them to the original table.

    2.Use Mergin Join to match existing data(you need to sort data first),then use Conditional Split to find out the updated columns and add them to the original table.

    3.Use Lookup to match existing data,then export Lookup No Match Output to the original table.

    Best Regards,

    Lily

    • Proposed as answer by Lily Lii Friday, November 29, 2019 10:34 AM
    Tuesday, November 26, 2019 3:03 AM