Hey!
*The following is just me trying to understand more about Azure Data Factory on how to get data from an API and how to handle pagination*
I'm using a testing environment that I created. It's basically a wordpress site with WooCommerce installed and you can check out those details to make a connection
here (url) if you'd like to give it a try.
What I'm trying to accomplish is to query the endpoint /wc/v3/orders
and to implement a pagination rule to go through all of the values in there.
The specific url that I'm using is https://powerquery.shop/wp-json/wc/v3/orders
and the "next" url comes inside an object in the header ($.Link) as described
here (url) but the main issue that I have is that this object is also mixed with other values in it in a "value pair" form, separated by a semicolon and encapsuled. It looks something like this:
<https://powerquery.shop/wp-json/wc/v3/orders?per_page=100&status%5B0%5D=any&dp=2&page=2>; rel="next"
Should I be using an iteration (until) instead of trying to implement a pagination rule?
I've been trying to follow
this documentation (url), but I haven't had any success trying to implement a pagination rule for this scenario.
Thank you in advance!
