none
Error while accessing azure data lake

    Question

  • I am trying to access azure data lake using R from azure linux vm server. Below is the code i am using to access the file.

    library(RevoScaleR)
    rxSetComputeContext("local")
    hostName = "my lake details"
    port =0
    # this requests that the password be entered interactively
    # note: if using the RGui then it must be entered inline
    oAuth <- rxOAuthParameters(authUri = "https://login.microsoftonline.com/",
    tenantId = "myid",
    clientId = "active directory client id",
    resource = "https://management.core.windows.net/",
    username = "myuserid",
    #password = "mypassword"
    )
    hdFS <- RxHdfsFileSystem(hostName=hostName,  useWebHdfs=TRUE, oAuthParameters=oAuth)
    file1 <- RxTextData("/folder/INFYNSE.csv",fileSystem = hdFS)
    file1
    rxOpen(file1)
    #rxReadNext(file1)
    #rxClose(file1)

    I am getting the below error. 

    /usr/lib64/microsoft-r/8.0/lib64/R/library/RevoScaleR/rxLibs/x64/BxlServer: symbol lookup error: /usr/lib64/libwebhdfs.so: undefined symbol: JNI_GetCreatedJavaVMs
    end of file 3506
    end of file 3506

     

    I have tried below commands 

    ln -s /path/to/libhdfs.so /usr/lib64/libwebhdfs.so

    export LD\_LIBRARY\_PATH=$LD_LIBRARY_PATH:/path/to/libwebhdfs.so

    But the issue didn't resolve. 

    Thanks in advance. 


    Wednesday, December 14, 2016 12:02 PM

All replies

  • Thanks for reaching out.  Today we don't support this specific R Library.  You can alternatively use ADLS REST API to interact with the service from R.  You'll also need to use OAuth for authentication.https://docs.microsoft.com/en-us/rest/api/datalakestore/ and https://docs.microsoft.com/en-us/rest/api/datalakestore/filesystem

    Thank you,

    Guy

    Thursday, January 5, 2017 9:12 PM