How to authenticate on Azure DataLake RRS feed

  • Question

  • Hi,

    I am going to write a python code that I will run on Azure Batch. That python code will then access Azure Data Lake to write to it directly. I can easily authenticate to Azure Data Lake if I am willing to write down authentication secret in plain text in the code that will reside in Azure Batch. 

    I will argue writing secret values in the code is not allowed. What is the best way to automatically authenticate?

    I can use Key Vault but then I have to authenticate to Key Vault. How do I do that automatically?

    Any ideas?

    Tuesday, January 29, 2019 5:49 AM

All replies

  • One way Azure Batch has built in to manage authentication is allowing you to attach a Certificate to a pool, which then gets added to each node in the pool.

    To do this you would need to create the certificate with the Certificate API(https://docs.microsoft.com/en-us/rest/api/batchservice/certificate). Then you can add a reference to that certificate on your Azure Batch Pool(https://docs.microsoft.com/en-us/rest/api/batchservice/pool/add#request-body). 

    Tuesday, January 29, 2019 4:57 PM