none
Not able to upload blob from one storage account to local account which are above 5 MB - HTTP/1.1 500 Server encountered an internal error RRS feed

  • Question

  • Hi Team

    I am trying to upload a blob from one account to another account using AZCopy as mentioned below but i am receiving HTTP 500 error

    AZ Copy Command

    "C:\Program Files (x86)\Microsoft SDKs\Azure\AzCopy\AzCopy.exe" /source:https://XXXXXXXXXX/video-details /dest:http://127.0.0.1:10000/devstoreaccount1/video-details /sourcekey:"---" /destkey:"---" /pattern:"video-details.s1.20181025081829147.cache" /snapshot /y /s /synccopy /destType:blob

    HTTP Request

    PUT http://127.0.0.1:10000/devstoreaccount1/video-details/video-details.s1.20181025081829147.cache?comp=blocklist&timeout=300 HTTP/1.1
    x-ms-blob-cache-control: public, max-age=10800
    x-ms-blob-content-type: application/tv3cache; charset=utf-8
    User-Agent: AzCopy/8.1.0-netcore DataMovement/0.8.1.0 Azure-Storage/9.3.0 (.NET Core)

    Http Response

    HTTP/1.1 500 Server encountered an internal error. Please try again after some time.
    Content-Length: 253
    Content-Type: application/xml
    Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0
    x-ms-request-id: 5e9de019-b4aa-4c14-a8aa-0a9b91afc72e
    x-ms-version: 2018-03-28
    x-ms-error-code: InternalError
    Date: Thu, 25 Oct 2018 11:49:44 GMT

    In the Azure Logs i am receiving below error

      at Microsoft.Cis.Services.Nephos.Common.Protocols.Rest.BasicHttpProcessorWithAuthAndAccountContainer`1.EndPerformOperation(IAsyncResult ar)
       at Microsoft.Cis.Services.Nephos.Common.Protocols.Rest.BasicHttpProcessorWithAuthAndAccountContainer`1.<ProcessImpl>d__103.MoveNext()
    10/25/2018 5:04:16 PM [Error] [ActivityId=e113f48e-4bd4-4ec0-9cdc-2b7f078ade26] [FEUnhandledException] Process crashed due to fatal exception: AsyncHelper.NullReferenceRethrowableException: Object reference not set to an instance of an object. ---> System.NullReferenceException: Object reference not set to an instance of an object.
       at Microsoft.Cis.Services.Nephos.Storage.Service.Protocols.Rest.HttpRestProcessor.<CommitBlobImplV2>d__101.MoveNext()
       at AsyncHelper.AsyncIteratorContextBase.ExecuteIterator(Boolean inBegin)



    • Edited by BhuvanRam Thursday, October 25, 2018 12:02 PM
    Thursday, October 25, 2018 11:56 AM

All replies

  • I am also getting same error while copying Blobs from cloud to local Azure Explorer using AzCopy.exe.

    .net

    Friday, October 26, 2018 11:29 AM
  • hello BhuvanRam

    I am sorry about the delay, I have a few questions that would like to ask you in order to better assist you with your problem

    1. for destination, what is http://127.0.0.1:10000/ meant to be? is it another storage account?

    2. for /sourcekey:"---" /destkey:"---"  I assume you are replacing "---" for the actual storage keys, would that be correct?

    3. Source storage account is marked https but destination is http, is there any particular reason why?

    if there is any other information that could be useful please let me know<o:p></o:p>

    best 


    Monday, October 29, 2018 3:29 PM
    Moderator
  • Hi DiegoRamirez,

    1. For destination, what is http://127.0.0.1:10000/ meant to be? is it another storage account?

    • Its a local Azure Storage emulator  address. I am trying to push the data to my local storage(Http)  from Azure Storage (HTTPS)

    2. For /sourcekey:"---" /destkey:"---"  I assume you are replacing "---" for the actual storage keys, would that be correct?

    • Yes Correct

    3. Source storage account is marked https but destination is http, is there any particular reason why?

    • My Source Storage is actual Azure Storage (https) and i want to download some of the blobs to my local machine and want to access them from my application. So i installed storage emulator (http) in my machine.

    I am facing this issue whenever there is a PUT Request to local storage of Blob Type: URL http://127.0.0.1:10000/devstoreaccount1/video-details/video-details.s1.20181025081829147.cache?comp=blocklist&timeout=300



    • Edited by BhuvanRam Tuesday, October 30, 2018 5:24 AM
    Tuesday, October 30, 2018 5:23 AM
  • Hi Bhuvan,

    Did you check the ports 80 & 443 are open on the machine which is used to upload the blob


    Cheers,

    Tuesday, October 30, 2018 5:26 AM
  • Yes i verified them, they are open. As per the Fiddler i am able to see some of the blob are being pushed to my local storage and the blobs which are pushed with comp=blocklist querystring are getting failed

    Below is the successful PUT Request to my local storage blob

    PUT http://127.0.0.1:10000/devstoreaccount1/search-items/search-items.s1.20181030034644249.cache?timeout=300 HTTP/1.1
    x-ms-blob-type: BlockBlob
    x-ms-client-request-id: f612ef11-011c-42e7-9618-ac9675a5fdd1
    User-Agent: AzCopy/8.1.0-netcore DataMovement/0.8.1.0 Azure-Storage/9.3.0 (.NET Core)
    x-ms-blob-cache-control: public, max-age=10800
    x-ms-blob-content-type: application/XXXXcache;charset=utf-8
    x-ms-version: 2018-03-28
    x-ms-date: Tue, 30 Oct 2018 05:49:10 GMT
    Content-Length: 2536
    Host: 127.0.0.1:10000

    Response from my local storage

    HTTP/1.1 201 Created
    Last-Modified: Tue, 30 Oct 2018 05:49:10 GMT
    ETag: "0x8D63E2B6A15BFF0"
    Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0
    x-ms-request-id: a65e9240-c2a2-4776-8a0e-c6c705ea07aa
    x-ms-version: 2018-03-28
    x-ms-request-server-encrypted: true
    Date: Tue, 30 Oct 2018 05:49:10 GMT
    Content-Length: 0

    Below is the Failed PUT Request to my local storage blob. only comp = blocklist are failing

    PUT http://127.0.0.1:10000/devstoreaccount1/title-details/title-details.s1.20181030014258057.cache?comp=blocklist&timeout=300 HTTP/1.1

    x-ms-blob-cache-control: public, max-age=10800
    x-ms-blob-content-type: application/XXXXXcache;charset=utf-8
    x-ms-client-request-id: 1b2cc850-5da3-45c2-aad7-66282cb0dd09
    User-Agent: AzCopy/8.1.0-netcore DataMovement/0.8.1.0 Azure-Storage/9.3.0 (.NET Core)
    x-ms-version: 2018-03-28
    x-ms-date: Tue, 30 Oct 2018 05:49:37 GMT
    Authorization: SharedKey devstoreaccount1:XXXXXXXXX
    Content-Length: 616
    Host: 127.0.0.1:10000

    Response 

    HTTP/1.1 500 Server encountered an internal error. Please try again after some time.
    Content-Length: 253
    Content-Type: application/xml
    Server: Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0
    x-ms-request-id: f1af07d9-b901-4a3c-a415-a7a904a344f1
    x-ms-version: 2018-03-28
    x-ms-error-code: InternalError
    Date: Tue, 30 Oct 2018 05:49:37 GMT


    • Edited by BhuvanRam Tuesday, October 30, 2018 5:56 AM
    Tuesday, October 30, 2018 5:55 AM
  • hello BhuvanRam

    thanks for the update, quick question, the file you are trying to copy is it still being accessed as you try to operation by some other process?

    best 

    Tuesday, October 30, 2018 6:31 AM
    Moderator
  • No, it not accessing by any other process, I verified that as well. Moreover i am able to download the file from source but not able to upload (PUT request) to my local storage emulator

    To troubleshoot the issue easily i can send the meeting request to you from my corporate email account. Does it works for you ?

    Tuesday, October 30, 2018 6:49 AM
  • thanks for your response BhuvanRam

    We should get you in touch with support to have it investigated and resolved. definitely the situation you are facing does not seem to be right

    Do you have the ability to open a technical support ticket? If not, you can email me at AzCommunity@microsoft.com and provide me with your SubscriptionID and link to this thread. I can enable one for you. 

    best 

    Tuesday, October 30, 2018 3:32 PM
    Moderator
  • I sent email to AzCommunity@microsoft.com  along with my subscription id.

    Wednesday, October 31, 2018 7:05 AM
  • Hello,

    Was there any resolution on this issue?  I am seeing the same behavior.

    -Thomas

    Thursday, November 8, 2018 7:13 PM
  • @bhuvanRam, What specific version of Azcopy are you using? Is it possible to use V10 and let me know if you still see the problem ?
    Monday, November 12, 2018 5:05 PM
    Moderator
  • What specific version of Azcopy are you using? Is it possible to use V10 and let me know if you still see the problem ?
    Monday, November 12, 2018 5:06 PM
    Moderator