locked
Socket or timeout exception writing files to Azure Datalake Gen2 (REST API) RRS feed

  • Question

  • We're trying to achieve to write some JSON files to our Azure Data Lake Store Gen2 account, using the official REST API.

    The total amount is not fixed, but it rounds by 400 files (50-60kb per file).

    Our process throws requests in parallel mode to write files and sometimes we receive connection timeout exception when trying to access to the storage account (socket exception or timeout).

    Someone has this type of problem? Is there any limitation to write in Azure Data Lake Storage Gen2?

    Thanks in advance.

    Regards!

    Wednesday, September 4, 2019 10:53 AM

All replies

  • Hi

    Can you try passing the timeout parameters in the REST API URL.

    Example:- 

    PATCH http://{accountName}.{dnsSuffix}/{filesystem}?resource=filesystem&timeout={timeout}
    

    Reference Link

    Let me know if the issue still persists.


    Thanks Naveen Thummlapenta MCSE

    Thursday, September 5, 2019 7:43 AM
  • @Naveen Kumar Thummalapenta - MCSE Adding additional information:

    You may also refer to the suggestion mentioned in the MSDN link. 

    You can check for Azure Data lake Rest API reference/limitations

    Hope this helps!

    Kindly let us know if the above helps or you need further assistance on this issue.
    ------------------------------------------------------------------------------------------

    Do click on "Mark as Answer" and Upvote on the post that helps you, this can be beneficial to other community members.

    Friday, September 6, 2019 1:53 PM
  •  Just checking in to see if the above answer helped. If this answers your query, do click “Mark as Answer” and Up-Vote for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
    Tuesday, September 10, 2019 5:07 AM
  • Hi Naveen,

    We tried with this parameter, but no luck... thanks!

    Regards.

    Wednesday, September 11, 2019 7:52 AM