Service design for handling large datasets RRS feed

  • Question

  • As an overnight process we need to invoke 2 services against every record in our database (over 1 million records). Specifically, the process flow should be as follows:

    - For each record in the database invoke service A.

    - For each record use the return value from service A as a parameter to invoke service B.

    If we were to process each record one at a time in a synchronous fashion, the time needed for processing all records would be too great. I was wondering if there is a better way to implement this? I have considered batching and making asynchronous calls using a duplex but am unclear about which option would be superior.

    Wednesday, March 25, 2015 7:02 AM


All replies