none
Not able to pull data from Azure Table storage RRS feed

  • Question

  • Hi all - I'm encountering an issue with Importing Data from a v2 Azure Table. I get 500 bad request. I already verified that the connection is correct. Not sure why I'm getting this error.

    I tried looking at the documentation and couldn't find anything on this error. It's a bit vague....

    Here's the output error log:

    Record Starts at UTC 09/04/2019 15:18:19:
    
    Run the job:"/dll "Microsoft.Analytics.Modules.Reader.Dll, Version=6.0.0.0, Culture=neutral, PublicKeyToken=69c3241e6f0468ca;Microsoft.Analytics.Modules.Reader.Dll.Reader;Load" /Output0 "..\..\Results dataset\Results dataset.dataset" /source "AzureTable" /tableAuthType "Account" /tableAccountName "accu4xdb" /tableAccountKey "********" /tableNames "CurrencyTickHistory" /scanMode "TopN" /rowsToScan "10"  /ContextFile "..\..\_context\ContextFile.txt""
    [Start] Program::Main
    [Start]     DataLabModuleDescriptionParser::ParseModuleDescriptionString
    [Stop]     DataLabModuleDescriptionParser::ParseModuleDescriptionString. Duration = 00:00:00.0026686
    [Start]     DllModuleMethod::DllModuleMethod
    [Stop]     DllModuleMethod::DllModuleMethod. Duration = 00:00:00.0000374
    [Start]     DllModuleMethod::Execute
    [Start]         DataLabModuleBinder::BindModuleMethod
    [Verbose]             moduleMethodDescription Microsoft.Analytics.Modules.Reader.Dll, Version=6.0.0.0, Culture=neutral, PublicKeyToken=69c3241e6f0468ca;Microsoft.Analytics.Modules.Reader.Dll.Reader;Load
    [Verbose]             assemblyFullName Microsoft.Analytics.Modules.Reader.Dll, Version=6.0.0.0, Culture=neutral, PublicKeyToken=69c3241e6f0468ca
    [Start]             DataLabModuleBinder::LoadModuleAssembly
    [Verbose]                 Loaded moduleAssembly Microsoft.Analytics.Modules.Reader.Dll, Version=6.0.0.0, Culture=neutral, PublicKeyToken=69c3241e6f0468ca
    [Stop]             DataLabModuleBinder::LoadModuleAssembly. Duration = 00:00:00.0079969
    [Verbose]             moduleTypeName Microsoft.Analytics.Modules.Reader.Dll.Reader
    [Verbose]             moduleMethodName Load
    [Information]             Module FriendlyName : Import Data
    [Information]             Module Release Status : Release
    [Stop]         DataLabModuleBinder::BindModuleMethod. Duration = 00:00:00.0095613
    [Start]         ParameterArgumentBinder::InitializeParameterValues
    [Verbose]             parameterInfos count = 55
    [Verbose]             parameterInfos[0] name = source , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderDataSourceOrSink
    [Verbose]             Converted string 'AzureTable' to enum of type Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderDataSourceOrSink
    [Verbose]             parameterInfos[1] name = inputURL , type = System.String
    [Verbose]             Set optional parameter inputURL value to NULL
    [Verbose]             parameterInfos[2] name = dataFormat , type = Microsoft.Analytics.Modules.Reader.Dll.HttpReader+DataFormat
    [Verbose]             Set optional parameter dataFormat value to NULL
    [Verbose]             parameterInfos[3] name = csvTsvHasHeader , type = System.Nullable`1[System.Boolean]
    [Verbose]             Set optional parameter csvTsvHasHeader value to NULL
    [Verbose]             parameterInfos[4] name = databaseServerName , type = System.String
    [Verbose]             Set optional parameter databaseServerName value to NULL
    [Verbose]             parameterInfos[5] name = databaseName , type = System.String
    [Verbose]             Set optional parameter databaseName value to NULL
    [Verbose]             parameterInfos[6] name = sqlAccountName , type = System.String
    [Verbose]             Set optional parameter sqlAccountName value to NULL
    [Verbose]             parameterInfos[7] name = accountPassword , type = Microsoft.Analytics.Modules.SecureString
    [Verbose]             Set optional parameter accountPassword value to NULL
    [Verbose]             parameterInfos[8] name = trustServerCertificate , type = System.Boolean
    [Verbose]             Set optional parameter trustServerCertificate value to NULL
    [Verbose]             parameterInfos[9] name = sqlStreamReader , type = System.IO.StreamReader
    [Verbose]             Set optional parameter sqlStreamReader value to NULL
    [Verbose]             parameterInfos[10] name = authType , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderAuthenticationType
    [Verbose]             Set optional parameter authType value to NULL
    [Verbose]             parameterInfos[11] name = sas , type = System.String
    [Verbose]             Set optional parameter sas value to NULL
    [Verbose]             parameterInfos[12] name = accountName , type = System.String
    [Verbose]             Set optional parameter accountName value to NULL
    [Verbose]             parameterInfos[13] name = accountKey , type = Microsoft.Analytics.Modules.SecureString
    [Verbose]             Set optional parameter accountKey value to NULL
    [Verbose]             parameterInfos[14] name = path , type = System.String
    [Verbose]             Set optional parameter path value to NULL
    [Verbose]             parameterInfos[15] name = sasBlobFormat , type = Microsoft.Analytics.Modules.LoaderUtils+FileTypes
    [Verbose]             Set optional parameter sasBlobFormat value to NULL
    [Verbose]             parameterInfos[16] name = blobFormat , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderBlobFormat
    [Verbose]             Set optional parameter blobFormat value to NULL
    [Verbose]             parameterInfos[17] name = delimiter , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderDelimiterType
    [Verbose]             Set optional parameter delimiter value to NULL
    [Verbose]             parameterInfos[18] name = encoding , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderEncodingType
    [Verbose]             Set optional parameter encoding value to NULL
    [Verbose]             parameterInfos[19] name = excelFormat , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderExcelFormat
    [Verbose]             Set optional parameter excelFormat value to NULL
    [Verbose]             parameterInfos[20] name = excelName , type = System.String
    [Verbose]             Set optional parameter excelName value to NULL
    [Verbose]             parameterInfos[21] name = blobCsvHasHeader , type = System.Boolean
    [Verbose]             Set optional parameter blobCsvHasHeader value to NULL
    [Verbose]             parameterInfos[22] name = sasBlobCsvHasHeader , type = System.Boolean
    [Verbose]             Set optional parameter sasBlobCsvHasHeader value to NULL
    [Verbose]             parameterInfos[23] name = tableAuthType , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderAuthenticationType
    [Verbose]             Converted string 'Account' to enum of type Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderAuthenticationType
    [Verbose]             parameterInfos[24] name = tableSas , type = System.String
    [Verbose]             Set optional parameter tableSas value to NULL
    [Verbose]             parameterInfos[25] name = tableAccountName , type = System.String
    [Verbose]             Passing through string 'accu4xdb'
    [Verbose]             parameterInfos[26] name = tableAccountKey , type = Microsoft.Analytics.Modules.SecureString
    [Verbose]             Converted string 'SecureString' to value of type Microsoft.Analytics.Modules.SecureString
    [Verbose]             parameterInfos[27] name = tableNames , type = System.String
    [Verbose]             Passing through string 'CurrencyTickHistory'
    [Verbose]             parameterInfos[28] name = scanMode , type = Microsoft.Analytics.Modules.Reader.Dll.AzureTableReader+PropertyScan
    [Verbose]             Converted string 'TopN' to enum of type Microsoft.Analytics.Modules.Reader.Dll.AzureTableReader+PropertyScan
    [Verbose]             parameterInfos[29] name = rowsToScan , type = System.Int32
    [Verbose]             Converted string '10' to value of type System.Int32
    [Verbose]             parameterInfos[30] name = sasScanMode , type = Microsoft.Analytics.Modules.Reader.Dll.AzureTableReader+PropertyScan
    [Verbose]             Set optional parameter sasScanMode value to NULL
    [Verbose]             parameterInfos[31] name = sasRowsToScan , type = System.Int32
    [Verbose]             Set optional parameter sasRowsToScan value to NULL
    [Verbose]             parameterInfos[32] name = hiveStreamReader , type = System.IO.StreamReader
    [Verbose]             Set optional parameter hiveStreamReader value to NULL
    [Verbose]             parameterInfos[33] name = hCatUri , type = System.String
    [Verbose]             Set optional parameter hCatUri value to NULL
    [Verbose]             parameterInfos[34] name = hadoopUsername , type = System.String
    [Verbose]             Set optional parameter hadoopUsername value to NULL
    [Verbose]             parameterInfos[35] name = hadoopPassword , type = Microsoft.Analytics.Modules.SecureString
    [Verbose]             Set optional parameter hadoopPassword value to NULL
    [Verbose]             parameterInfos[36] name = dataLocation , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+DataLocation
    [Verbose]             Set optional parameter dataLocation value to NULL
    [Verbose]             parameterInfos[37] name = hdfsUri , type = System.String
    [Verbose]             Set optional parameter hdfsUri value to NULL
    [Verbose]             parameterInfos[38] name = azureAccountName , type = System.String
    [Verbose]             Set optional parameter azureAccountName value to NULL
    [Verbose]             parameterInfos[39] name = azureStorageKey , type = Microsoft.Analytics.Modules.SecureString
    [Verbose]             Set optional parameter azureStorageKey value to NULL
    [Verbose]             parameterInfos[40] name = containerName , type = System.String
    [Verbose]             Set optional parameter containerName value to NULL
    [Verbose]             parameterInfos[41] name = urlContent , type = Microsoft.Analytics.Modules.Reader.Dll.Reader+ReaderUrlContents
    [Verbose]             Set optional parameter urlContent value to NULL
    [Verbose]             parameterInfos[42] name = powerQueryURL , type = System.String
    [Verbose]             Set optional parameter powerQueryURL value to NULL
    [Verbose]             parameterInfos[43] name = dataGatewayName , type = Microsoft.Analytics.Modules.Common.Dll.OnPremises.DataGatewayName
    [Verbose]             Set optional parameter dataGatewayName value to NULL
    [Verbose]             parameterInfos[44] name = onPremSqlDatabaseServerName , type = System.String
    [Verbose]             Set optional parameter onPremSqlDatabaseServerName value to NULL
    [Verbose]             parameterInfos[45] name = onPremSqlDatabaseName , type = System.String
    [Verbose]             Set optional parameter onPremSqlDatabaseName value to NULL
    [Verbose]             parameterInfos[46] name = encryptedCredential , type = Microsoft.Analytics.Modules.SecureString
    [Verbose]             Set optional parameter encryptedCredential value to NULL
    [Verbose]             parameterInfos[47] name = onPremSqlStreamReader , type = System.IO.StreamReader
    [Verbose]             Set optional parameter onPremSqlStreamReader value to NULL
    [Verbose]             parameterInfos[48] name = documentDbServer , type = System.String
    [Verbose]             Set optional parameter documentDbServer value to NULL
    [Verbose]             parameterInfos[49] name = documentDbDatabaseName , type = System.String
    [Verbose]             Set optional parameter documentDbDatabaseName value to NULL
    [Verbose]             parameterInfos[50] name = documentDbPassword , type = Microsoft.Analytics.Modules.SecureString
    [Verbose]             Set optional parameter documentDbPassword value to NULL
    [Verbose]             parameterInfos[51] name = documentDbCollection , type = System.String
    [Verbose]             Set optional parameter documentDbCollection value to NULL
    [Verbose]             parameterInfos[52] name = documentDbQuery , type = System.IO.StreamReader
    [Verbose]             Set optional parameter documentDbQuery value to NULL
    [Verbose]             parameterInfos[53] name = documentDbQueryParams , type = System.IO.StreamReader
    [Verbose]             Set optional parameter documentDbQueryParams value to NULL
    [Verbose]             parameterInfos[54] name = inferSchema , type = System.Boolean
    [Verbose]             Set optional parameter inferSchema value to NULL
    [Stop]         ParameterArgumentBinder::InitializeParameterValues. Duration = 00:00:00.0271669
    [Verbose]         Begin invoking method Load ... 
    [Stop]     DllModuleMethod::Execute. Duration = 00:00:00.6339949
    [Critical]     Error: Sorry, it seems that you have encountered an internal system error. Please contact amlforum@microsoft.com with the full URL in the browser and the time you experienced the failure. We can locate this error with your help and investigate further. Thank you.
    [Critical]     {"InputParameters":{"Generic":{"source":"AzureTable","tableAuthType":"Account","tableAccountName":"accu4xdb","tableNames":"CurrencyTickHistory","scanMode":"TopN","rowsToScan":10},"Unknown":["Key: tableAccountKey, ValueType : Microsoft.Analytics.Modules.SecureString"]},"OutputParameters":[],"ModuleType":"Microsoft.Analytics.Modules.Reader.Dll","ModuleVersion":" Version=6.0.0.0","AdditionalModuleInfo":"Microsoft.Analytics.Modules.Reader.Dll, Version=6.0.0.0, Culture=neutral, PublicKeyToken=69c3241e6f0468ca;Microsoft.Analytics.Modules.Reader.Dll.Reader;Load","Errors":"Microsoft.Analytics.Exceptions.ErrorMapping+ModuleException: Sorry, it seems that you have encountered an internal system error. Please contact amlforum@microsoft.com with the full URL in the browser and the time you experienced the failure. We can locate this error with your help and investigate further. Thank you. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> Microsoft.WindowsAzure.Storage.StorageException: The remote server returned an error: (400) Bad Request. ---> System.Net.WebException: The remote server returned an error: (400) Bad Request.\r\n   at System.Net.HttpWebRequest.GetResponse()\r\n   at Microsoft.WindowsAzure.Storage.Core.Executor.Executor.ExecuteSync[T](RESTCommand`1 cmd, IRetryPolicy policy, OperationContext operationContext)\r\n   --- End of inner exception stack trace ---\r\n   at Microsoft.WindowsAzure.Storage.Core.Executor.Executor.ExecuteSync[T](RESTCommand`1 cmd, IRetryPolicy policy, OperationContext operationContext)\r\n   at Microsoft.WindowsAzure.Storage.Table.CloudTable.Exists(Boolean primaryOnly, TableRequestOptions requestOptions, OperationContext operationContext)\r\n   at Microsoft.Numerics.Local.IO.AzureTableReader.GetProperties(Boolean topN, Int32 scanRows)\r\n   at Microsoft.Numerics.Local.IO.AzureTableReader.ReadIntoLocalDataTable()\r\n   at Microsoft.Analytics.Modules.Reader.Dll.Reader.LoadImpl(ReaderDataSourceOrSink source, String inputURL, DataFormat dataFormat, Nullable`1 csvTsvHasHeader, String databaseServerName, String databaseName, String sqlAccountName, SecureString accountPassword, Boolean trustServerCertificate, StreamReader sqlStreamReader, ReaderAuthenticationType authType, String sas, String accountName, SecureString accountKey, String path, FileTypes sasBlobFormat, ReaderBlobFormat blobFormat, ReaderDelimiterType delimiter, ReaderEncodingType encoding, ReaderExcelFormat excelFormat, String excelName, Boolean blobCsvHasHeader, Boolean sasBlobCsvHasHeader, ReaderAuthenticationType tableAuthType, String tableSas, String tableAccountName, SecureString tableAccountKey, String tableNames, PropertyScan scanMode, Int32 rowsToScan, PropertyScan sasScanMode, Int32 sasRowsToScan, StreamReader hiveStreamReader, String hCatUri, String hadoopUsername, SecureString hadoopPassword, DataLocation dataLocation, String hdfsUri, String azureAccountName, SecureString azureStorageKey, String containerName, ReaderUrlContents urlContent, String powerQueryURL, DataGatewayName dataGatewayName, String onPremSqlDatabaseServerName, String onPremSqlDatabaseName, SecureString encryptedCredential, StreamReader onPremSqlStreamReader, String documentDbServer, String documentDbDatabaseName, SecureString documentDbPassword, String documentDbCollection, StreamReader documentDbQuery, StreamReader documentDbQueryParams, Boolean inferSchema) in m:\\AzureMLVS15-004\\_work\\117\\s\\Product\\Source\\Modules\\Reader.Dll\\Reader.cs:line 193\r\n   at Microsoft.Analytics.Modules.Reader.Dll.Reader.Load(ReaderDataSourceOrSink source, String inputURL, DataFormat dataFormat, Nullable`1 csvTsvHasHeader, String databaseServerName, String databaseName, String sqlAccountName, SecureString accountPassword, Boolean trustServerCertificate, StreamReader sqlStreamReader, ReaderAuthenticationType authType, String sas, String accountName, SecureString accountKey, String path, FileTypes sasBlobFormat, ReaderBlobFormat blobFormat, ReaderDelimiterType delimiter, ReaderEncodingType encoding, ReaderExcelFormat excelFormat, String excelName, Boolean blobCsvHasHeader, Boolean sasBlobCsvHasHeader, ReaderAuthenticationType tableAuthType, String tableSas, String tableAccountName, SecureString tableAccountKey, String tableNames, PropertyScan scanMode, Int32 rowsToScan, PropertyScan sasScanMode, Int32 sasRowsToScan, StreamReader hiveStreamReader, String hCatUri, String hadoopUsername, SecureString hadoopPassword, DataLocation dataLocation, String hdfsUri, String azureAccountName, SecureString azureStorageKey, String containerName, ReaderUrlContents urlContent, String powerQueryURL, DataGatewayName dataGatewayName, String onPremSqlDatabaseServerName, String onPremSqlDatabaseName, SecureString encryptedCredential, StreamReader onPremSqlStreamReader, String documentDbServer, String documentDbDatabaseName, SecureString documentDbPassword, String documentDbCollection, StreamReader documentDbQuery, StreamReader documentDbQueryParams, Boolean inferSchema) in m:\\AzureMLVS15-004\\_work\\117\\s\\Product\\Source\\Modules\\Reader.Dll\\EntryPoint.cs:line 437\r\n   --- End of inner exception stack trace ---\r\n   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)\r\n   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)\r\n   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)\r\n   at Microsoft.MetaAnalytics.DllModuleHost.DllModuleMethod.Execute(Dictionary`2 moduleDescription)\r\n   at Microsoft.MetaAnalytics.DllModuleHost.Program.Main(String[] args)\r\n   --- End of inner exception stack trace ---","Warnings":[],"Duration":"00:00:00.6282872"}
    Module finished after a runtime of 00:00:00.9843602 with exit code -2
    Module failed due to negative exit code of -2
    
    Record Ends at UTC 09/04/2019 15:18:28.
    

    Wednesday, September 4, 2019 3:21 PM

Answers