locked
python scripts execution in data factory pipeline for pulling json from an api and store in a blob store RRS feed

  • Question

  • Dear Team, I am new to Azure data factory . The use case i am working on is to fetch json from a source api using azure data factory and store the value in a blob store . I checked the MSFT github repository and there was a sample code for fetching twits and store in to cosmos db. However reading the forum thread it looked like the script had certain issues .

    Where can i get some sample python scripts for Azure Data factory for this ?

    Tuesday, December 3, 2019 9:43 AM

All replies

  • Have you already checked below one? 

    https://github.com/rawatsudhir1/ADFPythonCustomActivity


    If the response helped, do "Mark as answer" and upvote it
    - Vaibhav

    Tuesday, December 3, 2019 1:51 PM
  • Dear Vaibhav, I already checked that one with twitter api and cosmos db. Was looking for something where the end destination is blob storage . 

    Thanks for the response . 

    Wednesday, December 4, 2019 8:06 AM
  • Hi there,

    You can have a custom activity or an azure function activity with python code to fetch data from the REST API and then store the data using Azure blob storage SDKs :

    https://docs.microsoft.com/en-us/azure/storage/blobs/storage-quickstart-blobs-python

    Hope this helps.

    Tuesday, December 10, 2019 8:41 AM
  • Hi there,

    Just wanted to check - was the above suggestion helpful to you? If yes, please consider upvoting and/or marking it as answer. This would help other community members reading this thread.
    Friday, December 13, 2019 9:30 AM
  • Hi there,

    We haven't heard from you in quite some time - was the above suggestion helpful to you? If yes, please consider upvoting and/or marking it as answer. This would help other community members reading this thread.
    Friday, December 20, 2019 9:18 AM