none
How to find how many vertex will be when submiting any job.

    Question

  • Hello Team,

    I have been working on USQL and i have some questions hope i can get here.

    1.When we submit any job then it converts into vertex but i want to know how can i know without submitting the job that how many vertex will be created for that job.

    2.When we run any job we get efficiency on the portal and we get if we increase the Au it will increase the efficiency but still same so how efficiency is related to and how can we increase that ?

    3.When we run any python extension or r Extension we have to use below code .

    @m  =
        REDUCE @t ON time
        PRODUCE date string, 
                mentions string
               USING new Extension.Python.Reducer("PythonExtensionDemo1.usql.py", pyVersion : "3.5.1");

    What is the use of "ON Time" there Time is column but why we are using ON?

    Hope to get answer here

    thank you.

    Monday, August 13, 2018 6:23 AM

All replies

  • The best way to find out how many AUs you should assign to a job, is to use the Visual Studio add-in.  There are several blog posts on AU efficiency.  This is one that you can start with.

    https://blogs.msdn.microsoft.com/azuredatalake/2018/05/15/use-au-analyzer-for-faster-lower-cost-data-lake-analytics/ 

    Guy

    Monday, August 13, 2018 4:43 PM