locked
Azure CLI 2.0 - Blob Download Fails with Received response with content RRS feed

  • Question

  • Starting around 09/18/2017, my team and I noticed that our download from a blob storage account failed with the message "Received response with content".

    Small files such as a JSON document appear to work fine. But a tar.gz > 100 MB fails. The file downloads to about 35.7 MB then stops.

    Here are the steps to recreate:

    1) Upload tar.gz using AZ CLI 2.0
    az storage blob upload --container-name test --file ~/Downloads/mypackage-0.6.2-0029.tar.gz --name mypackage-0.6.2-0029.tar.gz --account-name myblob --account-key 123abc
    2) Download tar.gz using AZ CLI 2.0
    az storage blob download --container-name test --file ~/tmp/mypackage-0.6.2-0029.tar.gz --name mypackage-0.6.2-0029.tar.gz --account-name myblob --account-key 123abc

    Note: this only seems to affect blobs uploaded today. We can download blobs from the previous week just fine.

    These other combinations work:

    CLI 2.0 & X-PLAT-CLI

    1. Upload with AZ CLI 2.0
    2. Download with Azure x-plat-cli

    Browser & CLI 2.0

    1. Upload with Browser
    2. Download with AZ CLI 2.0

    CLI 2.0 & Browser

    1. Upload with AZ CLI 2.0
    2. Download with Browser

    Here is some debug output:

    bcoker@XXXXXXXXXXXXXXXXXXXXXX]$ az storage blob download --container-name test --file ~/tmp/serviceBApplication.tar.gz --name serviceBApplication.tar.gz --account-name XXXXXXX --account-key XXXXXXXXXXXXXXXXXXXXXXXXXXX --debug
    File logging enabled - Writing logs to '/home/bcoker/.azure/logs'.
    Command arguments ['storage', 'blob', 'download', '--container-name', 'test', '--file', '/home/bcoker/tmp/serviceBApplication.tar.gz', '--name', 'serviceBApplication.tar.gz', '--account-name', 'XXXXXXXX', '--account-key', 'XXXXXXXXXXXXXXXXXXXXXX']
    Current cloud config:
    {'endpoints': {'active_directory': 'https://login.microsoftonline.com',
                   'active_directory_data_lake_resource_id': 'https://datalake.azure.net/',
                   'active_directory_graph_resource_id': 'https://graph.windows.net/',
                   'active_directory_resource_id': 'https://management.core.windows.net/',
                   'batch_resource_id': 'https://batch.core.windows.net/',
                   'gallery': 'https://gallery.azure.com/',
                   'management': 'https://management.core.windows.net/',
                   'resource_manager': 'https://management.azure.com/',
                   'sql_management': 'https://management.core.windows.net:8443/',
                   'vm_image_alias_doc': 'https://raw.githubusercontent.com/Azure/azure-rest-api-specs/master/arm-compute/quickstart-templates/aliases.json'},
     'is_active': True,
     'name': 'AzureCloud',
     'profile': 'latest',
     'suffixes': {'azure_datalake_analytics_catalog_and_job_endpoint': 'azuredatalakeanalytics.net',
                  'azure_datalake_store_file_system_endpoint': 'azuredatalakestore.net',
                  'keyvault_dns': '.vault.azure.net',
                  'sql_server_hostname': '.database.windows.net',
                  'storage_endpoint': 'core.windows.net'}}
    Registered application event handler 'CommandTableParams.Loaded' at <function add_id_parameters at 0x7f3ec3d640d0>
    Registered application event handler 'CommandTable.Loaded' at <function add_id_parameters at 0x7f3ec3d640d0>
    Successfully loaded command table from module 'storage'.
    Application event 'CommandTable.Loaded' with event data {'command_table': {'storage blob download': <azure.cli.core.commands.CliCommand object at 0x7f3ec3d7ef28>}}
    Application event 'CommandParser.Loaded' with event data {'parser': AzCliCommandParser(prog='az', usage=None, description=None, formatter_class=<class 'argparse.HelpFormatter'>, conflict_handler='error', add_help=True)}
    Application event 'CommandTableParams.Loaded' with event data {'command_table': {'storage blob download': <azure.cli.core.commands.CliCommand object at 0x7f3ec3d7ef28>}}
    Application event 'CommandParser.Parsing' with event data {'argv': ['storage', 'blob', 'download', '--container-name', 'test', '--file', '/home/bcoker/tmp/serviceBApplication.tar.gz', '--name', 'serviceBApplication.tar.gz', '--account-name', 'XXXXXXXXXXXXXXXXX', '--account-key', 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX']}
    Application event 'CommandParser.Parsed' with event data {'command': 'storage blob download', 'args': Namespace(_command_package='storage', _jmespath_query=None, _log_verbosity_debug=False, _log_verbosity_verbose=False, _output_format='jsonc', _parser=AzCliCommandParser(prog='az storage blob download', usage=None, description='Downloads a blob to a file path, with automatic chunking and progress notifications. Returns an instance of :class:`Blob` with  properties and metadata.', formatter_class=<class 'argparse.HelpFormatter'>, conflict_handler= [...]
    Getting data service client service_type=BlockBlobService
    urllib3.connectionpool : Starting new HTTPS connection (1): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 33554432
    urllib3.connectionpool : Starting new HTTPS connection (2): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304
    urllib3.connectionpool : Starting new HTTPS connection (3): XXXX.blob.core.windows.net
    urllib3.connectionpool : Starting new HTTPS connection (4): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304
    urllib3.connectionpool : Starting new HTTPS connection (5): XXXX.blob.core.windows.net
    urllib3.connectionpool : Starting new HTTPS connection (6): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304
    urllib3.connectionpool : Starting new HTTPS connection (7): XXXX.blob.core.windows.net
    urllib3.connectionpool : Starting new HTTPS connection (8): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304
    urllib3.connectionpool : Starting new HTTPS connection (9): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 4194304

    Received response with content
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 1277773
    urllib3.connectionpool : Starting new HTTPS connection (10): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 1277773
    urllib3.connectionpool : Starting new HTTPS connection (11): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 1277773
    urllib3.connectionpool : Starting new HTTPS connection (12): XXXX.blob.core.windows.net
    urllib3.connectionpool : https://XXXX.blob.core.windows.net:443 "GET /test/serviceBApplication.tar.gz HTTP/1.1" 206 1277773


    • Edited by brian.l.coker Tuesday, September 19, 2017 7:47 PM adding debug log
    Monday, September 18, 2017 10:47 PM

All replies

  • Can you share the snap shot of the error message?

    ---------------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members.

    Tuesday, September 19, 2017 6:26 AM
  • I'd love to, but my account isn't verified yet.

    But it literally just says in red:

    "Received response with content"

    Tuesday, September 19, 2017 4:23 PM
  • We believe it is a problem with 2.0.16 and 2.0.17

    Submitted Issue:

    https://github.com/Azure/azure-cli/issues/4490

    Tuesday, September 19, 2017 9:42 PM
  • This link will help you in verifying your account, so that in future you will be able to post logs, images, hyperlink etc.

    ---------------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members.

    Saturday, September 23, 2017 2:52 PM
  •  “A fix has been worked on” you may continue the discussion on GitHub forum thread.

    ---------------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" on the post that helps you, this can be beneficial to other community members.

    Saturday, September 23, 2017 3:05 PM