locked
Transfer JSON payload saved in a BLOB storage to TABLE storage RRS feed

  • Question

  • Hi,

    I have Application Insight metrics saved as a BLOB (continuous export) in a blob storage account.

    I need to transfer the blob payload (Json) to a table property.

    With the following query I'm able to transefer only Blob's metadata:

    QUERY:

    SELECT

    *,

    '123' AS PartitionKey

    INTO

    AIContinuousExportTableStorage

    FROM

    AIContinuousExportBlobStorage

    RESULT:

    {
        BlobLastModifiedUtcTime: 2016-06-23 10:09:43+00:00 
        BlobName: xxxxx_37690f9cd34a4b34b0f362e65bbe88d3/Requests/2016-06-23/10/5324a7b1-3f55-4d6f-8c6d-47dc6f77da49_20160623_100942.blob 
        EventProcessedUtcTime: 2016-07-12 10:11:31.991247+00:00 
        PartitionId: 0 
        PartitionId@odata.type: Edm.Int64 
        PartitionKey: 123 
        RowKey: 2016-07-12T10:11:31.9912477Z 
        Timestamp: 2016-07-12 10:11:32.464423+00:00 
        etag: W/"datetime'2016-07-12T10%3A11%3A32.464423Z'"  
    }

    how can I have the full json payload in the output?

    Many thanks

    Francesco

    Tuesday, July 12, 2016 1:38 PM

All replies

  • Do you know the type of blob you are trying to read? Stream Analytics only supports block blobs today.
    Monday, July 18, 2016 4:33 PM
  • Do you have a column that is a record and are trying to serialize it as json in an azure table property? ASA doesn't support that today, it will only write columns that are primitive types.

    Thursday, July 28, 2016 12:52 AM
  • Maybe what you need is Azure Data Factory instead of Stream Analytics:

    https://azure.microsoft.com/en-us/documentation/articles/data-factory-azure-table-connector/#sample-copy-data-from-azure-blob-to-azure-table


    • Edited by MarinaMT Thursday, July 28, 2016 8:40 AM
    Thursday, July 28, 2016 8:38 AM
  • do you have an anonymized / sanitized sample JSON that you can share with us?
    Thursday, July 28, 2016 9:04 PM
  • Have you resolved this issue yet?
    Monday, August 1, 2016 5:54 PM