none
ADL access is slow than local HDFS.

    Question

  • hi Team, we have a server and an ADL account both in East US 2 region. But still we are facing slowness in access ADL files from our Server. Our Server size is D8s V3. So my question here is since both, the server and ADL are there in same region, is there a way to connect to ADL directly instead of over internet?

    FYI, we are using Python packages to connect to ADL. 

    Thanks in advance. 

    Regards,

    Paramesh. 

    Monday, November 19, 2018 2:39 PM

All replies

  • Hi Paramesh,

    What program is experiencing the slow throughput from ADL and what speeds are you seeing?  Is it the Python Azure modules?  Some code samples might be helpful.


    Monday, November 19, 2018 8:35 PM
    Moderator
  • Hi Jason, Thank you for quick response. Yes we are using python azure data lake module (azure-datalake-store==0.0.34).

    I have not recorded speeds. I have web application which uses ADL/HDFS as its storage. when i configure it to use HDFS, it's speed is good. But when i configure it to use ADL, then it is becoming slow. 

    I also want to record speeds instead of web app performance, can you suggest a way on how to do it?

    Regards,

    Paramesh.

      
    Wednesday, November 21, 2018 1:45 PM