locked
HTTP Data Downloader - Help Required RRS feed

  • Question

  • Hi guys

    I am new to .NET development so I’m probably doing something wrong – however, I am attempting to create the HttpDataDownloaderSample (I apologise, I can't provide the link on these forums until my account is verified).

    I noticed three usual items when attempting to replicate the project:

    1) When I load the CustomDotNetActivity script I note that there is an error on row 91:

    blob.UploadFromFile(decompressedFile, FileMode.OpenOrCreate);

    It appears that UploadFromFile no longer accepts FileMode.OpenOrCreate as an argument (I therefore removed it):

    2) I receive the below error when trying to install one of the NuGet dependencies:

    Install-Package : Unable to find package 'Microsoft.DataFactories.Runtime'

    3) Upon Data Factories execution, it outputs the following error (I understand that this is likely related to my first point above):

    Activity (RunId = "c5a4ba78-c9a6-49b0-b2c0-863e71e1f4c6") failed with error message: "Unknown error in module: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.MissingMethodException: Method not found: 'Void Microsoft.WindowsAzure.Storage.Blob.CloudBlockBlob.UploadFromFile(System.String, Microsoft.WindowsAzure.Storage.AccessCondition, Microsoft.WindowsAzure.Storage.Blob.BlobRequestOptions, Microsoft.WindowsAzure.Storage.OperationContext)'. at DataDownloaderActivityNS.DataDownloaderActivity.GatherDataForOneHour(String sliceStartTime, String urlFormat) at DataDownloaderActivityNS.DataDownloaderActivity.Execute(IEnumerable`1 linkedServices, IEnumerable`1 datasets, Activity activity, IActivityLogger logger) in C:\ADFGetStarted\htmlScrape\Class1.cs:line 43 at Microsoft.Azure.Management.DataFactories.Runtime.ActivityExecutor.Execute(Object job, String configuration, Action`1 logAction) --- End of inner exception stack trace --- at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor) at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture) at Microsoft.DataPipeline.Compute.HDInsightJobExecution.ReflectingActivityWrapper.Execute() in f:\_Bld\12751\6742\Sources\Product\Common\Compute\src\HDIComputeDelegatorJob\ReflectingActivityWrapper.cs:line 44 at Microsoft.DataPipeline.Compute.HDInsightJobExecution.JobWrapper.RunJob() in f:\_Bld\12751\6742\Sources\Product\Common\Compute\src\HDIComputeDelegatorJob\JobWrapper.cs:line 94 at Microsoft.DataPipeline.Compute.HDInsightJobExecution.Launcher.Main(String[] args) in f:\_Bld\12751\6742\Sources\Product\Common\Compute\src\HDIComputeDelegatorJob\Launcher.cs:line 78."

    Any help is appreciated!

    Thanks,Simon

    Tuesday, June 28, 2016 1:54 PM

All replies

  • Hi Simon,

    Looks like you are using a Windows Azure Storage Nuget version that is not 4.3.0?

    Could you verify that from your packages.config?

    Thanks,

    Yitao

    Friday, July 8, 2016 5:13 PM
    Answerer