Unable to implement a pipeline in data factory. RRS feed

  • Question

  • Hi everyone,

    I am trying to implement a pipeline using data bricks but am facing some issues with it, it will be nice if any expert can help me with it.

    So, the scenario which i am trying to implement is as follows: my source of data is present in the azure blob storage which is a .csv file which will be update on a daily basis by the user and the sink of the data is a database present in the azure sql data warehouse. The problem is that scd type 2 has to be implemented while the data is being transformed and finally gets transformed in the sink which is a database. So, if someone can help me with scd type 2 implementation part, it will be really helpful as Data Factory does not have pre defined SCD implementation package as SSIS has.

    Thanks in advance.

    Best Regards,

    Abhijeet Kumar

    Monday, October 7, 2019 10:54 AM


All replies