dfservice.exe crashing on startup

Question

So, I recently updated to the latest Azure SDK stuff and my dfservice.exe no longer starts, when I try to run it from csmonitor.exe.

The crash shows up in event log (detailed info listed at bottom of post) as an ArgumentException crash. If I debug it in VS I can see that the error message is "invalid chars in path":

StackTrace:
       at System.IO.Path.CheckInvalidPathChars(String path)
       at System.IO.Path.NormalizePathFast(String path, Boolean fullCheck)
       at System.IO.Path.GetFullPath(String path)
       at Microsoft.ServiceHosting.Tools.DevelopmentFabric.Program.Main(String[] args)

Disassembling in Reflector it seems that the error is coming from the line: "m_storageRoot = Path.GetFullPath(args[i] + @"\");"

I can't debug csmonitor.exe to figure out what path it's actually passing here... any ideas?

Version=1
EventType=CLR20r3
EventTime=129623284200599059
ReportType=2
Consent=1
ReportIdentifier=ef0f9793-efa3-11e0-81c6-bcaec56d1c61
Response.type=4
Sig[0].Name=Problem Signature 01
Sig[0].Value=dfservice.exe
Sig[1].Name=Problem Signature 02
Sig[1].Value=1.0.0.0
Sig[2].Name=Problem Signature 03
Sig[2].Value=4e83d3ed
Sig[3].Name=Problem Signature 04
Sig[3].Value=mscorlib
Sig[4].Name=Problem Signature 05
Sig[4].Value=2.0.0.0
Sig[5].Name=Problem Signature 06
Sig[5].Value=4d8cdc57
Sig[6].Name=Problem Signature 07
Sig[6].Value=3666
Sig[7].Name=Problem Signature 08
Sig[7].Value=4
Sig[8].Name=Problem Signature 09
Sig[8].Value=System.ArgumentException
DynamicSig[1].Name=OS Version
DynamicSig[1].Value=6.1.7601.2.1.0.256.48
DynamicSig[2].Name=Locale ID
DynamicSig[2].Value=1033
UI[2]=C:\Program Files\Windows Azure SDK\v1.5\Bin\devfabric\DFService.exe
UI[3]=Windows Azure Compute Emulator Service has stopped working
UI[4]=Windows can check online for a solution to the problem.
UI[5]=Check online for a solution and close the program
UI[6]=Check online for a solution later and close the program
UI[7]=Close the program
LoadedModule[0]=C:\Program Files\Windows Azure SDK\v1.5\Bin\devfabric\DFService.exe
LoadedModule[1]=C:\Windows\SYSTEM32\ntdll.dll
LoadedModule[2]=C:\Windows\SYSTEM32\MSCOREE.DLL
LoadedModule[3]=C:\Windows\system32\KERNEL32.dll
LoadedModule[4]=C:\Windows\system32\KERNELBASE.dll
LoadedModule[5]=C:\Windows\system32\ADVAPI32.dll
LoadedModule[6]=C:\Windows\system32\msvcrt.dll
LoadedModule[7]=C:\Windows\SYSTEM32\sechost.dll
LoadedModule[8]=C:\Windows\system32\RPCRT4.dll
LoadedModule[9]=C:\Windows\Microsoft.NET\Framework64\v4.0.30319\mscoreei.dll
LoadedModule[10]=C:\Windows\system32\SHLWAPI.dll
LoadedModule[11]=C:\Windows\system32\GDI32.dll
LoadedModule[12]=C:\Windows\system32\USER32.dll
LoadedModule[13]=C:\Windows\system32\LPK.dll
LoadedModule[14]=C:\Windows\system32\USP10.dll
LoadedModule[15]=C:\Windows\system32\IMM32.DLL
LoadedModule[16]=C:\Windows\system32\MSCTF.dll
LoadedModule[17]=C:\Windows\Microsoft.NET\Framework64\v2.0.50727\mscorwks.dll
LoadedModule[18]=C:\Windows\WinSxS\amd64_microsoft.vc80.crt_1fc8b3b9a1e18e3b_8.0.50727.6195_none_88e41e092fab0294\MSVCR80.dll
LoadedModule[19]=C:\Windows\system32\shell32.dll
LoadedModule[20]=C:\Windows\system32\ole32.dll
LoadedModule[21]=C:\Windows\system32\profapi.dll
LoadedModule[22]=C:\Windows\assembly\NativeImages_v2.0.50727_64\mscorlib\8f7abb6f7384aad8fc43659820726eab\mscorlib.ni.dll
LoadedModule[23]=C:\Windows\Microsoft.NET\Framework64\v2.0.50727\mscorsec.dll
LoadedModule[24]=C:\Windows\system32\WINTRUST.dll
LoadedModule[25]=C:\Windows\system32\CRYPT32.dll
LoadedModule[26]=C:\Windows\system32\MSASN1.dll
LoadedModule[27]=C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_5.82.7601.17514_none_a4d6a923711520a9\COMCTL32.dll
LoadedModule[28]=C:\Windows\system32\CRYPTSP.dll
LoadedModule[29]=C:\Windows\system32\rsaenh.dll
LoadedModule[30]=C:\Windows\system32\CRYPTBASE.dll
LoadedModule[31]=C:\Windows\system32\imagehlp.dll
LoadedModule[32]=C:\Windows\system32\ncrypt.dll
LoadedModule[33]=C:\Windows\system32\bcrypt.dll
LoadedModule[34]=C:\Windows\system32\bcryptprimitives.dll
LoadedModule[35]=C:\Windows\system32\USERENV.dll
LoadedModule[36]=C:\Windows\system32\GPAPI.dll
LoadedModule[37]=C:\Windows\system32\cryptnet.dll
LoadedModule[38]=C:\Windows\system32\WLDAP32.dll
LoadedModule[39]=C:\Windows\system32\SensApi.dll
LoadedModule[40]=C:\Windows\system32\Cabinet.dll
LoadedModule[41]=C:\Windows\system32\DEVRTL.dll
LoadedModule[42]=C:\Windows\Microsoft.NET\Framework64\v2.0.50727\mscorjit.dll
LoadedModule[43]=C:\Program Files\Windows Azure SDK\v1.5\Bin\devfabric\Microsoft.ServiceHosting.Tools.DevelopmentFabric.Service.dll
LoadedModule[44]=C:\Windows\system32\VERSION.dll
LoadedModule[45]=C:\Windows\system32\apphelp.dll
FriendlyEventName=Stopped working
ConsentKey=CLR20r3
AppName=Windows Azure Compute Emulator Service
AppPath=C:\Program Files\Windows Azure SDK\v1.5\bin\devfabric\DFService.exe
ReportDescription=Stopped working

Answer 1

There are two acknowledged problems with Azure SDK v1.5

accounts with a space in the login name

port already in use

Answer 2

 

Neither of those seem to apply. My _CSRUN_STATE_DIRECTORY is already set to E:\A\.

 

Edit: I tried changing E:\A\ to E:\A and I think it worked once... but now does not work again.

It must have worked once, since there are now two more directories inside E:\A that weren't there before (DevFCLogs/DFAgentLogs).

 

More testing:

Running it with CSRun works. It doesn't work when started from CSMonitor or when trying to run a project from VS2010.

Edit 2: Now it is starting from CSMonitor and VS2010. I'm not sure what changed. I haven't changed any settings.

 

 

Now I am just getting a different error when trying to run projects from VS:

[Listener127.0.0.1:10000] Socket Exception (10013) occured when initializing client listener 

netstat shows that Process# 4 (System) is listening on this port. If I stop the storage emulator it stops.

Answer 3

If I restart my computer, then start VS and try to run my project, it gives this error:

 

Windows Azure Tools: Failed to initialize Windows Azure storage emulator. Unable to start Development Storage. Failed to start Storage Emulator: the SQL Server instance ‘.\’ could not be found.   Please configure the SQL Server instance for Storage Emulator using the ‘DSInit’ utility in the Windows Azure SDK.

 

 

If I try to run it a second time, it successfully starts the storage emulator, but then gives the error:

Windows Azure Tools: [Listener127.0.0.1:10000] Socket Exception (10013) occured when initializing client listener 

Server stack trace: 
   at System.ServiceModel.Channels.ServiceChannel.HandleReply(ProxyOperationRuntime operation, ProxyRpc& rpc)
   at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
   at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]: 
   at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
   at Microsoft.Windows.Azure.DevFabric.IManagement.UpdateTenant(String tenantName, ServiceModelDefinition serviceModel)
   at Microsoft.ServiceHosting.Tools.DevelopmentFabric.FabricClient.AddServiceDeployment(String tenantName, String serviceModelPath, String instanceDescriptionPath, ServiceDeploymentOptions options)

 

Answer 4

I noticed that I had to use csrun to start the emulator.

Having set the environment variable, I would uninstall the SDKand then reinstall the SDK just to ensure you have a clean install. And who knows, a reboot in the middle might not go wrong either.

Answer 5

So I just tried:

1) Uninstall everything with "Azure" in its name, along with Silverlight, etc.

2) Drop DevStorage database.

3) Reboot, reinstall Azure SDKs, reboot again.

4) Create a new database with DSInit, start DevStorage & DevFabric with CSRun.

5) Start VS and tried to run my project.

Same result. :/

I noticed when running DSInit that it talks about reserving ports 10000-10003...

Answer 6

I'll start a new thread since this is something different.

Answer 7

This has come back, with a fresh install.

Same symptoms, dfservice.exe just crashing when trying to run it. Reinstalling all Azure things in the Web Platform Installer doesn't help.

Error doesn't happen when I don't have _CSRUN_STATE_DIRECTORY set, but happens when it is set, no matter where I point it.

Again, it is turning up in event log as an ArgumentException:

Fault bucket , type 0
Event Name: CLR20r3
Response: Not available
Cab Id: 0

Problem signature:
P1: dfservice.exe
P2: 1.6.0.0
P3: 4eb3101a
P4: mscorlib
P5: 2.0.0.0
P6: 4e1539fa
P7: 3666
P8: 4
P9: System.ArgumentException
P10: 

Answer 8

It seems that _CSRUN_STATE_DIRECTORY can't end in a slash. This is non-obvious.