locked
Blob Timeout in EastUS2 Region RRS feed

  • Question

  • We have had multiple Blob errors in several storage accounts since Monday 10th.
    Specifically, we are getting an Timeout exception when trying to upload two blobs to storage in parallel C#. However, consistently only one specific blob location fails fails to upload. We have had 5 errors since Monday and its impacting our customers. Is there a reported outage in EastUS2 regarding blobs? We have also been getting multiple 500 errors on a GET blob requests. Could this be a starved resources issue? Perhaps our webapi is running out sockets?

    C#, WebApp, Azure, AzureStorage Classic, EastUS2 LRS,Standard, .NET 4.6.2, WindowsAzure.Storage 8.7.0

    Microsoft.WindowsAzure.Storage.StorageException:
       at Microsoft.WindowsAzure.Storage.Core.Util.StorageAsyncResult`1.End (Microsoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35Microsoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35: c:\Program Files (x86)\Jenkins\workspace\release_dotnet_master\Lib\ClassLibraryCommon\Core\Util\StorageAsyncResult.csMicrosoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35: 77)
       at Microsoft.WindowsAzure.Storage.Blob.CloudBlockBlob.EndUploadFromStream (Microsoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35Microsoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35: c:\Program Files (x86)\Jenkins\workspace\release_dotnet_master\Lib\ClassLibraryCommon\Blob\CloudBlockBlob.csMicrosoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35: 844)
       at Microsoft.WindowsAzure.Storage.Core.Util.AsyncExtensions+<>c__DisplayClass7.<CreateCallbackVoid>b__5 (Microsoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35Microsoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35: c:\Program Files (x86)\Jenkins\workspace\release_dotnet_master\Lib\ClassLibraryCommon\Core\Util\AsyncExtensions.csMicrosoft.WindowsAzure.Storage, Version=8.7.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35: 121)
       at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089)
       at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (mscorlib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089)

    var blob1 = blobCont.GetBlockBlobReference(formBlobId); tasks.Add(blob1.UploadTextAsync(JSON.SerializeDynamic(formData, new Options(includeInherited: true))));

    var blob2 = blobCont.GetBlockBlobReference(stateBlobId); tasks.Add(blob2.UploadTextAsync(JSON.SerializeDynamic(entityState, new Options(includeInherited: true))));


    Tuesday, September 11, 2018 8:26 AM

Answers

  • Hi There,

    Thank you for your feedback. We released a hotfix that seemed to solve the issue. Making the blob operations synchronous stopped the errors. It leads me to believe then some sort of rate limit was reached, but this is has never happened before. Strange behaviour.

    Kind Regards,
    Tuesday, September 18, 2018 8:14 AM

All replies