ADF Linked Service RRS feed

  • Question

  • Hi,

    I have 2 options to pull data into my Azure instance from an external Azure instance . One is via SQL Server and the other is an API (with filters) . considering I have huge data volume,which one do you think will be better in terms of performance, security and maintenance. 


    • Edited by Paresh01 Thursday, March 5, 2020 7:18 PM
    Thursday, March 5, 2020 3:50 PM

All replies

  • Hello Paresh01 , 

    If you are using API , and you mentioned that you have massive data , there is high probability that while you are pulling that your requests will be throttled , ( all API uses this to stop DDos) . The API will only fetch a X numbers of records per call which means that you will have to make lot of calls and it will delay the operations .

    I suggest you to use use the SQL route , as it lets you fetch a lot of record at one time , you can use the fault tolerance to log incompatible rows . 

    Thanks Himanshu

    Friday, March 6, 2020 12:34 AM
  • Thanks Himanshu, Do you think SQL route has any disadvantages ?
    Friday, March 6, 2020 4:12 PM
  • Hello Paresh01 , 

    To me I think that SQL will be a comparatively better then the API . One a high level i do not see any disadvantages

    Thanks Himanshu

    Thursday, March 12, 2020 5:08 PM