none
Python api for the Azure Data Lake Store Gen2 RRS feed

  • Question

  • Do you plan to release an optimised python api implementation for the Azure Data Lake Store Gen2 in addition to the abfs[1] driver?

    This could be of great benefit for the dask distributed framework [2].

    [1] https://docs.microsoft.com/en-us/azure/storage/data-lake-storage/abfs-driver

    [2] https://github.com/dask/dask-adlfs

    Kind Regards,

    Peter

    • Moved by Sandeep BR Wednesday, July 4, 2018 7:43 PM Better suited here. Moved from Azure storage to Azure Data Lake Analytics & Store
    Wednesday, July 4, 2018 6:59 PM

All replies

  • Thank you for your request. I will forward your request to azure docs team.
    Thursday, July 5, 2018 5:41 PM
    Moderator
  • Hello there -

    There will be interop between the Blob REST APIs and ADLS Gen2 REST APIs, at the GA of ADLS Gen2. Hence you can use the existing Blob library here: https://github.com/Azure/azure-storage-python E.g. upload data via Blob APIs, read data via Blob APIs

    We'll also add the support for the new APIs such as create path, rename path into the library, however we do not have a timeline for it at this moment.

    Sercan Guler,

    Azure Storage PM


    Thursday, July 5, 2018 6:11 PM
  • A follow up question: What APIs were you looking for specifically ? Does Dask require rename a directory API for instance ?
    Thursday, July 5, 2018 6:13 PM
  • Hi Sercan,

    now that the ADLS Gen2 is GA, any timing on the BLOB REST APIs interoperability?

    We want to be able to get data from ADLS Gen2 using powerbi and python. But we cannot.

    Let us know please

    Wednesday, March 20, 2019 8:52 AM
  • My colleague created a GitHub repo to this exact situation.  I've been meaning to try it out for a while, but haven't had time.  Let me know if it helps you.
    https://github.com/adamsmith0016/Azure-storage

    Monday, March 25, 2019 7:19 PM
    Moderator
  • Hi, the link on github is using blob sdk. Those are not good to interact with adls gen 2. So this is not the exact situation, unfortunately
    Wednesday, March 27, 2019 12:00 AM
  • There is a related thread I highly reccomend you look at.
    https://social.msdn.microsoft.com/Forums/en-US/45be0931-379d-4252-9d20-164261cc64c5/error-while-calling-adls-gen-2-rest-api-to-create-file?forum=AzureDataLake
    Monday, April 1, 2019 6:45 PM
    Moderator