locked
AFD Most effective way to move “timestamp less” data from SqL to Blob RRS feed

  • Question

  • Hi!

    I do have a 3rd party application which writes data into an SQL DB.  I do have to move the data a soon as they are written into the db (a soon as possible) into an azure blob storage.  Of course I only want to copy the latest data not all of them. As I do miss a timestamp in my rows I could not benefit from using  WindowStart/End when doing my query.

    I was looking for an option where I could store the ID of the dataset I moved last which I can store in some "session" which is accesable in every activity but so far I did't find anything like this.

    Currently I'm thinking of using SQL -Triggers to copy the data into a differnt db where I could delete the data after I moved them or/and  using a stored procedure. Did I miss other options?

    Regards

    Wolfgang

    Thursday, March 3, 2016 8:25 AM

All replies

  • Those seems to be the right option given the current scheme of things. Over time you will able to do this first class in ADF using variables to pass around context among activities.
    Thursday, April 14, 2016 6:50 PM