none
Access of Azure Blob storage from Azure Data lake Analitycs using U-SQL + Extractor written in C#

    Question

  • I create simple C# assembly for extracting data from Azure Blob Storage (IExtractor) and use it in U-SQL. When I run U-SQL locally (using Azure Blob Storage in Azure - not the local emulation) - it work OK. When I Submit it to the ADLA - it did not work - returning error "The remote name could not be resolved: 'f*****.blob.core.windows.net"

    var storageAccount = CloudStorageAccount.Parse(_connectionstring);

    varblobClient = storageAccount.CreateCloudBlobClient();               

    intcont = blobClient.ListContainers().Count();

    the storage  account is connected to Data lake analytic as additional data source

    can someone help, please?

    Tuesday, March 20, 2018 4:47 PM

Answers

  • When running in ADLA, C# code in a U-SQL script is forbidden from making an outbound network connection. This is deliberately restricted by the container (a VM) the c# code is running in.

    The reason why it works locally is that the "container" locally - your machine - is not enforcing any such restrictions.

    Tuesday, March 20, 2018 5:43 PM
    Moderator

All replies

  • When running in ADLA, C# code in a U-SQL script is forbidden from making an outbound network connection. This is deliberately restricted by the container (a VM) the c# code is running in.

    The reason why it works locally is that the "container" locally - your machine - is not enforcing any such restrictions.

    Tuesday, March 20, 2018 5:43 PM
    Moderator
  • Thank you for fast response. I found, than it is possible to extract values from files in Data storage (assigned as data source for Data lake analytic) using build in EXTRACTOR and wasb address.
    Wednesday, March 21, 2018 9:06 AM