none
Problems with local debugging hosts: LocalVertex and LocalRunHelper (on VS exit)

    Question

  • Hi,

    As I anticipated in my other post, I'm having problems when debugging U-SQL scripts locally on a Windows 7 SP1.

    I managed to make the scripts work but I get and exception many times during local debug run. If I don't hit close program and instead continue to run, the script in the end runs successfully. But I cannot put my finger on this problema and also I can't get a call stack (call stack output window is all blank). Therefore, I don't know which dll is causing this.

    Then on Visual Studio Exit I get also an exception on LocalRunHelper.exe. Also, I don't have a call stack.

    Firma con problemas:
      Nombre del evento de problema: BEX64
      Nombre de la aplicación: LocalRunHelper.exe
      Versión de la aplicación: 10.2.2.0
      Marca de tiempo de la aplicación: 57336fca
      Nombre del módulo con errores: ntdll.dll
      Versión del módulo con errores: 6.1.7601.18247
      Marca de tiempo del módulo con errores: 521eaf24
      Desplazamiento de excepción: 0000000000079a5f
      Código de excepción: c000000d
      Datos de excepción: 0000000000000000
      Versión del sistema operativo: 6.1.7601.2.1.0.256.48
      Id. de configuración regional: 9226
      Información adicional 1: bf3c
      Información adicional 2: bf3c144880393b5bbf15e099d84d7578
      Información adicional 3: ba42
      Información adicional 4: ba42cccdebc7110d70003d6270d7daa4

    Lea nuestra declaración de privacidad en línea:
      http://go.microsoft.com/fwlink/?linkid=104288&clcid=0x0c0a

    Si la declaración de privacidad en línea no está disponible, lea la declaración de privacidad sin conexión:
      C:\windows\system32\es-ES\erofflps.txt

    USQL Script Works fine when submitting to ADLA account. However, I need to be able to run and debug scripts locally. This problem does not happen on my Windows 10 Notebook, but for security reasons I need to work on Customer's PC.

    At some point I also got a weird error like this one in Activity log

    System.ArgumentException: rootPath cannot be null or empty   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.SymbolManager.CompilerServices.CompilerServiceSettings..ctor(String rootPath, String scriptPath, String privateFolder)   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.SymbolManager.CompilerServices.CompilerServiceSettings.GetDefaultSettings(String rootPath, String scriptPath, String privateFolder)   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.SymbolManager.CompilerServices.CompilerServicesAppDomainFactory.CreateAndStoreCompilerServicesAppDomain(String scriptPath, String rootPath, Boolean createDomain)   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.SymbolManager.CompilerServices.CompilerServicesAppDomainFactory.GetCompilerServicesAppDomainInstance(String scriptPath)   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.SymbolManager.RemoteLanguageServiceUtils.GetExpansions(String scriptPath, Int32 offset, EnumExpansionType type)   at Microsoft.Cosmos.ScopeStudio.VsExtension.EditorExtension.ExpandColumnTagger.<GetTags>d__0.MoveNext()   at Microsoft.VisualStudio.Text.Tagging.Implementation.TagAggregator`1.<GetTagsForBuffer>d__38.MoveNext()

    Please help!

    Thursday, June 2, 2016 9:54 PM

All replies

  • Update: Now it won't even allow me to select  Local Analytics Account. I have no idea why.
    Thursday, June 2, 2016 10:03 PM
  • This is the Windows Error Reporting I get when debugging locally

    Firma con problemas:


      Nombre del evento de problema: BEX64

      Nombre de la aplicación: LocalVertexHost.exe

      Versión de la aplicación: 0.0.0.0

      Marca de tiempo de la aplicación: 57336f23

      Nombre del módulo con errores: ntdll.dll

      Versión del módulo con errores: 6.1.7601.18247

      Marca de tiempo del módulo con errores: 521eaf24

      Desplazamiento de excepción: 0000000000079a5f

      Código de excepción: c000000d

      Datos de excepción: 0000000000000000

      Versión del sistema operativo: 6.1.7601.2.1.0.256.48

      Id. de configuración regional: 9226

      Información adicional 1: 1074

      Información adicional 2: 1074c9fd7e25e4595d76828c57e874a7

      Información adicional 3: 3172

      Información adicional 4: 3172afed7c861cab6f579c67c2835f10



    I also get this when hitting "Debug"


    Severity


    Code


    Description


    Project


    File


    Line


    Suppression State


    Error


    Microsoft.Cosmos.ScopeStudio.BusinessObjects.Debugger.ScopeDebugException: An output statement must have at least one local run step! output=D:\Users\jjgomezh\AppData\Local\USQLDataRoot   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.Debugger.PerStatementDebugExeGeneratorBase.FindLocalRunsteps(CompileResult debugScriptCompileResult)   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.Debugger.PerStatementDebugExeGeneratorBase.GenerateDebugNode(CompileResult result)   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.Debugger.ExeGeneratorBase.GenerateExe(String assemblyName, String targetDirectory, CompileResult result)   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.Debugger.USqlPerStatementDebugExeGenerator.GenerateExe()   at Microsoft.Cosmos.ScopeStudio.BusinessObjects.Debugger.LocalRunManager.GetLocalDebugAssembly(List`1 breakPointInfoList, Boolean tolerateNoDebugInfo)   at Microsoft.VisualStudio.Project.BuildableProjectConfig.GenerateExeIfExpired(IScopeProjectStateSnapshot state)   at Microsoft.VisualStudio.Project.BuildableProjectConfig.<>c__DisplayClass9.<>c__DisplayClassd.<Build>b__2()   at System.Threading.Tasks.Task.InnerInvoke()   at System.Threading.Tasks.Task.Execute()


    d:\mis documentos\visual studio 2015\Projects\AmbulanceDemo\AmbulanceDemo\5.1-Ambulance-StreamSets.usql


    1

    • Edited by amihanov Thursday, June 2, 2016 10:20 PM
    Thursday, June 2, 2016 10:14 PM
  • Just recording the error I get when running local debugging with Data Lake Tools. I'm sure nothing helpful... but at least to document

    Firma con problemas:
      Nombre del evento de problema: BEX64
      Nombre de la aplicación: LocalVertexHost.exe
      Versión de la aplicación: 0.0.0.0
      Marca de tiempo de la aplicación: 57336f23
      Nombre del módulo con errores: ntdll.dll
      Versión del módulo con errores: 6.1.7601.18247
      Marca de tiempo del módulo con errores: 521eaf24
      Desplazamiento de excepción: 0000000000079a5f
      Código de excepción: c000000d
      Datos de excepción: 0000000000000000
      Versión del sistema operativo: 6.1.7601.2.1.0.256.48
      Id. de configuración regional: 9226
      Información adicional 1: 1074
      Información adicional 2: 1074c9fd7e25e4595d76828c57e874a7
      Información adicional 3: 3172
      Información adicional 4: 3172afed7c861cab6f579c67c2835f10

    Lea nuestra declaración de privacidad en línea:
      http://go.microsoft.com/fwlink/?linkid=104288&clcid=0x0c0a

    Si la declaración de privacidad en línea no está disponible, lea la declaración de privacidad sin conexión:
      C:\windows\system32\es-ES\erofflps.txt

    IF I forcé to close the program, I get this on the command line:

    Running step 1 of 19

    Unhandled Exception: System.Exception: Failed to execute step, return code is : -1073741811
     StdOut: LocaVertexHost Runtime engine initialized
    Fri Jun 03 15:02:52 2016: enter native vertex execution
    Fri Jun 03 15:02:52 2016: ScopeEngine reset done in 0msec
    Fri Jun 03 15:02:52 2016: IO registration done in 1msec
    StreamCacheClientProxyManager: ConnectToStreamCacheServer WaitNamedPipe failed with error: 2.
    Fri Jun 03 15:02:52 2016: CLR check done in 0msec
    Fri Jun 03 15:02:52 2016: InitManaged done in 0msec
    Fri Jun 03 15:02:52 2016: InitNative done in 0msec
    Input Stream Count = 1, Input Buffer Size = 4194304, Input Buffer Count = 2
    Output Stream Count = 2, Output Buffer Size = 4194304, Output Buffer Count = 2
    Fri Jun 03 15:02:52 2016: VertexMain done in 123msec
    Fri Jun 03 15:02:52 2016: ShutdownNative done in 0msec
    Fri Jun 03 15:02:52 2016: ShutdownManaged done in 0msec
    SV1_Extract_Split: vertexGuid=FFFFFFFF-FFFF-FFFF-FFFF-FFFFFFFFFFFF, vertexStart=Fri Jun 03 15:02:52 2016, avgExecutionMemoryPeakSize=85196
    80, avgGlobalMemoryPeakSize=0, avgHashMemoryPeakSize=0, avgIOMemoryPeakSize=25165824, avgManagedMemoryPeakSize=0, avgOverallMemoryPeakSize
    =33685504, avgOverallReservedPeakSize=54525952, avgPrivateMemoryPeakSize=139378688, avgSortMemoryPeakSize=0, avgWorkingSetPeakSize=3787161
    6, maxExecutionMemoryPeakSize=8519680, maxGlobalMemoryPeakSize=0, maxHashMemoryPeakSize=0, maxIOMemoryPeakSize=25165824, maxManagedMemoryP
    eakSize=0, maxOverallMemoryPeakSize=33685504, maxOverallReservedPeakSize=54525952, maxPrivateMemoryPeakSize=139378688, maxSortMemoryPeakSi
    ze=0, maxWorkingSetPeakSize=37871616,
            SplitOutput: OperatorWaitOnIOTime=0, exclusiveTime=16, inclusiveTime=125, maxRowCount=28799, opId=3, rowCount=28799,
                    SplitOutputter: avgIoTime=0, bytes=1470913, closeTime=0, maxIoTime=0, maxIoTimeSize=0, maxRowCount=28799, minIoTime=0, min
    IoTimeSize=1470913, opId=4, openTime=0, operations=1, rowCount=28799, totalIoTime=0, totalThrottlingTime=0, totalWaitTime=0,
                            IOBuffers: avgBufferMemory=8388608, maxBufferCount=2, maxBufferMemory=8388608, maxBufferSize=4194304,
                            Allocator_SplitOutputter: avgBinarySize=0, avgCommittedSize=0, avgReservedSize=4194304, avgStringSize=0, maxBinary
    Size=0, maxCommitCount=0, maxCommittedSize=0, maxReservedSize=4194304, maxResetCount=28800, maxStringSize=0,
                    SplitOutputter: avgIoTime=0, bytes=1470913, closeTime=0, maxIoTime=0, maxIoTimeSize=0, maxRowCount=28799, minIoTime=0, min
    IoTimeSize=1470913, opId=5, openTime=0, operations=1, rowCount=28799, totalIoTime=0, totalThrottlingTime=0, totalWaitTime=0,
                            IOBuffers: avgBufferMemory=8388608, maxBufferCount=2, maxBufferMemory=8388608, maxBufferSize=4194304,
                            Allocator_SplitOutputter: avgBinarySize=0, avgCommittedSize=0, avgReservedSize=4194304, avgStringSize=0, maxBinary
    Size=0, maxCommitCount=0, maxCommittedSize=0, maxReservedSize=4194304, maxResetCount=28800, maxStringSize=0,
                    ParallelUnionAll: avgInputCount=1, exclusiveTime=0, inclusiveTime=109, maxInputCount=1, maxRowCount=28799, opId=86, rowCou
    nt=28799,
                            Extractor: IoStreamInclusiveTime=15, OperatorWaitOnIOTime=0, avgIoTime=7, bytes=3122164, closeTime=0, exclusiveTim
    e=109, inclusiveTime=109, maxIoTime=15, maxIoTimeSize=1561082, maxRowCount=28799, minIoTime=0, minIoTimeSize=1561082, opId=1, openTime=0,
    operations=2, rowCount=28799, totalIoTime=15, totalThrottlingTime=0, totalWaitTime=0,
                                    Allocator_TextEncodingReader: avgBinarySize=0, avgCommittedSize=8388608, avgReservedSize=16777216, avgStri
    ngSize=0, maxBinarySize=0, maxCommitCount=1, maxCommittedSize=8388608, maxReservedSize=16777216, maxResetCount=1, maxStringSize=0,
                                    IOBuffers: avgBufferMemory=8388608, maxBufferCount=2, maxBufferMemory=8388608, maxBufferSize=4194304,
                                    Allocator_Extractor: avgBinarySize=0, avgCommittedSize=131072, avgReservedSize=4194304, avgRowDataSize=120
    , avgStringSize=20, maxBinarySize=0, maxCommitCount=1, maxCommittedSize=131072, maxFixedRowDataSize=64, maxReservedSize=4194304, maxResetC
    ount=57601, maxRowDataSize=120, maxStringSize=20,
    Overall memory usage statistics
            Allocations = 71
            Deallocations = 71
            Outstanding size = 0
            Outstanding reservations = 0
    IO memory usage statistics
            Allocations = 6
            Deallocations = 6
            Outstanding size = 0
            Outstanding reservations = 0
    Execution memory usage statistics
            Allocations = 65
            Deallocations = 65
            Outstanding size = 0
            Outstanding reservations = 0
    Fri Jun 03 15:02:52 2016: Stats dump done in 0msec
    Fri Jun 03 15:02:52 2016: finished executing successfully in 0.124sec
    LocaVertexHost Execution finished in    0.16 sec

    StdErr: i,06/03/2016 15:02:52,Cosmos,g_pCosmosConfig is NULL,SrcFile="csthreadpoolex.cpp" SrcFunc="CsDefaultThreadPoolEx_CreateCb" SrcLine
    ="1609" Pid="7472" Tid="6152" TS="0x01D1BDD2E90D6AA8" String1="Using default value 100 for param DefaultThreadPoolTimerQueueDepthLogThresh
    old"
    d,06/03/2016 15:02:52,Cosmos,ThreadPoolCreateThreadTimer,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::Initialize" SrcLine="136" P
    id="7472" Tid="6152" TS="0x01D1BDD2E90D6AA8" String1="pThreadPool=00000000057D8290 TimerThreadId=3152 uMaxThreadCount=16 uLogCallbackTimeM
    s=10000 uLogPoolQueueTimeMs=100 uLogPoolQueueDepth=100 uLogTimerQueueTimeMs=100 uLogTimerQueueDepth=100"
    d,06/03/2016 15:02:52,Cosmos,ThreadPoolCreateThreadWorker,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::CreateNewThread" SrcLine="
    375" Pid="7472" Tid="6152" TS="0x01D1BDD2E90D6AA8" String1="pThreadPool=00000000057D8290 WorkerThreadId=7708 uCreatedThreadCount=1 uMaxThr
    eadCount=16"
    d,06/03/2016 15:02:52,Cosmos,ThreadPoolCreateThreadWorker,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::CreateNewThread" SrcLine="
    375" Pid="7472" Tid="7708" TS="0x01D1BDD2E90D6AA8" String1="pThreadPool=00000000057D8290 WorkerThreadId=7740 uCreatedThreadCount=2 uMaxThr
    eadCount=16"
    d,06/03/2016 15:02:52,Cosmos,ThreadPoolCreateThreadWorker,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::CreateNewThread" SrcLine="
    375" Pid="7472" Tid="7740" TS="0x01D1BDD2E90D91B8" String1="pThreadPool=00000000057D8290 WorkerThreadId=8848 uCreatedThreadCount=3 uMaxThr
    eadCount=16"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid="7472" Tid="7740" TS="0x01D1BDD2E90D91B8" String1="pThreadPool=00000000057D8290 Class=class AsyncCallbackJob Instance=0000000007C9E940
     Latency=0 StartedAt=131094577721217464 FinishedAt=131094577721217464"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid="7472" Tid="8848" TS="0x01D1BDD2E90D91B8" String1="pThreadPool=00000000057D8290 Class=class AsyncCallbackJob Instance=0000000007C9E940
     Latency=0 StartedAt=131094577721217464 FinishedAt=131094577721217464"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid="7472" Tid="7708" TS="0x01D1BDD2E90DB8C8" String1="pThreadPool=00000000057D8290 Class=class AsyncCallbackJob Instance=0000000007C9E820
     Latency=20000 StartedAt=131094577721207464 FinishedAt=131094577721227464"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid="7472" Tid="7740" TS="0x01D1BDD2E90DB8C8" String1="pThreadPool=00000000057D8290 Class=class AsyncCallbackJob Instance=0000000007C9E820
     Latency=0 StartedAt=131094577721227464 FinishedAt=131094577721227464"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid="7472" Tid="8848" TS="0x01D1BDD2E90DB8C8" String1="pThreadPool=00000000057D8290 Class=class AsyncCallbackJob Instance=0000000007C9E820
     Latency=0 StartedAt=131094577721227464 FinishedAt=131094577721227464"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid="7472" Tid="7708" TS="0x01D1BDD2E91F44F8" String1="pThreadPool=00000000057D8290 Class=class AsyncCallbackJob Instance=0000000007C9F360
     Latency=0 StartedAt=131094577722377464 FinishedAt=131094577722377464"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid="7472" Tid="7740" TS="0x01D1BDD2E91F9318" String1="pThreadPool=00000000057D8290 Class=class AsyncCallbackJob Instance=0000000007C9F360
     Latency=0 StartedAt=131094577722397464 FinishedAt=131094577722397464"
    d,06/03/2016 15:02:52,CommonDebug,ThreadPoolJobFinish,SrcFile="csthreadpoolex.cpp" SrcFunc="CsThreadPoolEx::InvokeCallback" SrcLine="727"
    Pid=

       at Microsoft.Azure.BigAnalytics.LocalRun.LocalRunner.RunVertices(XmlReader reader, String cachePath, String tempPath, String runtimePat
    h, String dataRoot, String debuggerMailPath, Int32 stepCount, CommandContext commandContext, Boolean outputHeader, String useLocale, Actio
    n`1 postMessage)
       at Microsoft.Azure.BigAnalytics.LocalRun.LocalRunner.ExecuteQueryPlan(String algebraFile, String cachePath, String tempPath, String run
    timePath, String dataRoot, String debuggerMailPath, Boolean outputHeader, String useLocale, Action`1 postMessage)
       at Microsoft.Azure.BigAnalytics.LocalRun.LocalRunHelper.DoExec()
       at Microsoft.Azure.BigAnalytics.LocalRun.LocalRunHelper.Execute(String[] args)
       at Microsoft.Azure.BigAnalytics.LocalRun.Program.Main(String[] args)
    Presione una tecla para continuar . . .

    • Edited by amihanov Friday, June 3, 2016 8:05 PM
    Friday, June 3, 2016 7:48 PM
  • I searched on the web and ran into this below.   Currently the U-SQL runtime does have AVX instruction set enabled, so that is possibly the root cause.

    http://serverfault.com/questions/718543/what-does-event-bex64-mean

    "On a side note, the problem that I had turned out to be due to the AVX instruction set being available on CPU level, but not supported on OS level (Windows 2008 R2 RTM). One of the DLLs being loaded used msvcr120!log function, which was calling one of AVX instructions, which led to crash"

    Another page posted a solution, that is to add exceptions to DEP regarding the offending app, and in this case, it is "LocalVertexHost.exe".  Could you please try that ?

    http://windows.ittoolbox.com/groups/technical-functional/windows-7-l/bex-error-in-windows-7-4682211

    Also please make sure AVX is enabled:

    http://superuser.com/questions/244213/how-can-i-check-whether-intels-avx-is-enabled-on-my-computer

    Monday, June 6, 2016 1:38 AM
  • Hi,

    Bad news. This is what I tried:

    1) Disabling DEP altogether: bcdedit.exe /set {current} nx AlwaysOff

    2) Running another bcdedit command to enable avx: bcdedit /set xsavedisable 0

    3) Rebooted the PC...

    4) Same crash...

    But the problem persists. Any other ideas ? Can Antivirus have anything to do with this ? Do I need to also reinstall Data Lake tools ??

    • Proposed as answer by Yangyd-MSDN Monday, June 20, 2016 2:17 AM
    • Unproposed as answer by Yangyd-MSDN Monday, June 20, 2016 2:17 AM
    Tuesday, June 7, 2016 3:04 PM
  • Hi,

    Could you please run "msinfo32"  and let us know the CPU type and OS patch level ?   For example, just post the screen shot of the first page of msinfo32.

    Thanks a lot,

    Yu Dong

    Sunday, June 12, 2016 5:28 AM