none
Azure Data Lake Storage ACLs

    Question

  • I have a azure function tried to write to azure data lake. right now I run it locally to debug, I use a service account's credential to write to the data lake. myself does not have permission for that data lake account, I cannot see anything in azure storage explorer nor portal. 
    when I run it, I got the error message: 

    [8/20/2018 3:03:23 PM] SaveDataLake
    [8/20/2018 3:03:23 PM] Microsoft.Azure.DataLake.Store: Error in creating file /rawzone/utilxxxxxx/spacexxxxxn/rxxxxxx/jxx/streaming/2018/08/20/xxxxxn_15_03_19.json.
    Operation: CREATE failed with HttpStatus:Forbidden  RemoteException: AccessControlException  [2a2f06c5-ff8b-4b31-b66c-9ab26fb8f0e8] Access Denied : /rawzone/utilxxxxxx/spacexxxxxn/rxxxxxx/jxx/streaming/2018/08/20/xxxxxn_15_03_19.json[2018-08-20T08:03:23.5191829-07:00] JavaClassName: org.apache.hadoop.security.AccessControlException.
    Last encountered exception thrown after 1 tries. [Forbidden ( AccessControlException   [2a2f06c5-ff8b-4b31-b66c-9ab26fb8f0e8] Access Denied : /rawzone/utilxxxxxx/spacexxxxxn/rxxxxxx/jxx/streaming/2018/08/20/xxxxxn_15_03_19.json[2018-08-20T08:03:23.5191829-07:00] JavaClassName: org.apache.hadoop.security.AccessControlException ]
    [ServerRequestId:2a2f06c5-ff8b-4b31-b66c-9ab26fb8f0e8].
    [8/20/2018 3:03:23 PM] rxxxxxxIngestion
    [8/20/2018 3:03:23 PM] Microsoft.Azure.DataLake.Store: Error in creating file /rawzone/utilxxxxxx/spacexxxxxn/rxxxxxx/jxx/streaming/2018/08/20/xxxxxn_15_03_19.json.
    Operation: CREATE failed with HttpStatus:Forbidden  RemoteException: AccessControlException  [2a2f06c5-ff8b-4b31-b66c-9ab26fb8f0e8] Access Denied : /rawzone/utilxxxxxx/spacexxxxxn/rxxxxxx/jxx/streaming/2018/08/20/xxxxxn_15_03_19.json[2018-08-20T08:03:23.5191829-07:00] JavaClassName: org.apache.hadoop.security.AccessControlException.
    Last encountered exception thrown after 1 tries. [Forbidden ( AccessControlException   [2a2f06c5-ff8b-4b31-b66c-9ab26fb8f0e8] Access Denied : /rawzone/utilxxxxxx/spacexxxxxn/rxxxxxx/jxx/streaming/2018/08/20/xxxxxn_15_03_19.json[2018-08-20T08:03:23.5191829-07:00] JavaClassName: org.apache.hadoop.security.AccessControlException ]
    [ServerRequestId:2a2f06c5-ff8b-4b31-b66c-9ab26fb8f0e8].  

    what's reason, how should I do to fix it?

    Thanks

    Wes


    Wes



    • Edited by wesbird Monday, August 20, 2018 3:53 PM
    Monday, August 20, 2018 3:50 PM

Answers

  • It seems like you are getting permission issue to write data into azure data lake. You don't have the right access to write to the target azure data lake. Please check the below things on your visual studio and azure data lake.

    1. Check if the service account has a write access to data lake

    2. Make sure service account is trying to write to the azure data lake

    Monday, August 20, 2018 6:08 PM
    Moderator