locked
Download large amount of data RRS feed

  • Question

  • User1058577588 posted

    Hi,

    We are going to develop web page to download large amount of data from 3rd party  api. what are the main limitations/areas we need to think about.

    we are going to display data in the web page as well as allow client to download data as file. at the moment api support download 1000 records at a time.

    any reason why we can't increase that number.

    Thanks for the help 

    Tuesday, January 16, 2018 3:41 AM

Answers

  • User753101303 posted

    Hi,

    Have you tried to see if this API have support for "paging" ? Usually you try to show a user what matters and it's not uncommon for an API to serve a "page" with possibly links to the previous and next "page" of data.

    If not just talk directly with those providing this API. They may also have a "term of use" to avoid API abuse etc....

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Tuesday, January 16, 2018 9:54 AM

All replies

  • User753101303 posted

    Hi,

    Have you tried to see if this API have support for "paging" ? Usually you try to show a user what matters and it's not uncommon for an API to serve a "page" with possibly links to the previous and next "page" of data.

    If not just talk directly with those providing this API. They may also have a "term of use" to avoid API abuse etc....

    • Marked as answer by Anonymous Thursday, October 7, 2021 12:00 AM
    Tuesday, January 16, 2018 9:54 AM
  • User1058577588 posted
    Thanks for your reply Patrick!!. Yes we are planning to do paging. We need to download more than 50,000 records. We are going to display 1000 record per page. When we are downloading file can we download it as single file?
    Tuesday, January 16, 2018 9:17 PM
  • User-492460945 posted

    Hello aish,

    When we are downloading file can we download it as single file?

    Yes sure you can download file with all the pages records in single click.

    Thanks,

    Rajesh

    Wednesday, January 17, 2018 11:14 AM