none
Find cause of error in u-sql script.

    Question

  • So I created a script to read pictures stored in blob storage and process them using Cognitive Services like this:

    ECLARE @input string = "wasb://xxx/{FileName}.JPG";
    
    REFERENCE ASSEMBLY ImageCommon;
    REFERENCE ASSEMBLY FaceSdk;
    REFERENCE ASSEMBLY ImageEmotion;
    REFERENCE ASSEMBLY ImageTagging;
    REFERENCE ASSEMBLY ImageOcr;
    
    @tags =
        EXTRACT FileName string, 
                NumObjects int,
                Tags SQL.MAP<string, float?>
        FROM @input
        USING new Cognition.Vision.ImageTagsExtractor();
    
    @tags_serialized =
        SELECT FileName,
               NumObjects,
               String.Join(";", Tags.Select(x => String.Format("{0}:{1}", x.Key, x.Value))) AS TagsString
        FROM @tags;
    
    OUTPUT @tags_serialized
        TO "/tags.csv"
        USING Outputters.Csv();

    but if fails with this error:

    {

    "jobId": "https://adlsexpecho.azuredatalakeanalytics.net/jobLink/9eb0b2c2-b8f9-458b-9be7-6313dfbbea02",
    "errors": {
    "diagnosticCode": 223346732,
    "severity": "Error",
    "component": "Yarn",
    "source": "System",
    "errorId": "VertexRetriedTooMany",
    "message": "Vertex retried too many times",
    "description": "Vertex SV1_Extract[0][1] retried 24 times.",
    "resolution": "",
    "helpLink": "",
    "details": "",
    "userData": ""
    }
    }

    but it does not give me any clue on what is wrong. Resubmitting the job does not help.

    How can I find out what the issue is?


    Monday, December 24, 2018 11:38 AM

All replies

  • When I try it with a smaller set it seems to work. Might the limited number of requests per minute to the cognitive services have to do something with this problem? And if so, how could I solve it. 
    Thursday, January 3, 2019 8:26 AM
  • Hi,

    There's a similar issue reported here :

    https://stackoverflow.com/questions/34511711/vertex-retried-too-many-times-error-occurred-on-running-azure-data-lake-analytic

    See if this helps you, else we can continue to probe in further.


    MSDN

    Thursday, January 3, 2019 10:37 AM
    Moderator