Importing Daily snapshots of data to Data Lake Storage Gen 2 RRS feed

  • Question

  • I have a source table in a SQL Database that contains daily snapshots of whats going on.

    What I want to do is get daily files of each snapshot out into a Data Lake Gen 2 Data store so we can use it for advanced Analytics

    Here is a possible plan of action

    The plan is is to use a watermark table on our side to record where we are (Because at the beginning we need to create all the snapshots that are already in and then eventually there will only be one day to go through unless we have issues.

    At the moment I'm not sure sure where to start. I know I need a Lookup. Copy activity, A For each loop etc etc But If anyone can point me in the right direction of any online documentation to help with this or any guidance, that would be great


    Wednesday, December 11, 2019 9:25 AM

All replies