No announcements
-
0 Votes2 HDI with 1 Hive Metastore
Hi, We deploy 2 HDI clusters: H1 Hadoop and Interactive Query(IQ), and we point both to use same Azure Data Lake and Hive Metastore When ...Unanswered | 2 Replies | 113 Views | Created by Freddy.Setiawan - Wednesday, July 17, 2019 9:43 AM | Last reply by HimanshuSinha-msft - Thursday, July 18, 2019 9:04 PM
-
0 Votes
Can't deploy HDInsight 4.0 (Spark 2.3) in VNet
The problem is I can't deploy HDI cluster in desired VNet, but couple weeks ago I could do it with the same template and VNet configuration. In Ambari I see 3 ...Unanswered | 2 Replies | 115 Views | Created by Vitaliy Degtyarev - Tuesday, July 16, 2019 11:52 AM | Last reply by AshishThapliyal - Wednesday, July 17, 2019 5:11 PM -
0 Votes
how to access on premise impala/hive tables from azure hdinsights
Quickly need info on this. how to access on premise impala/hive tables from azure hdinsights. Is there anyway to access?If ...Proposed | 4 Replies | 155 Views | Created by shettyani - Thursday, July 4, 2019 9:27 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, July 16, 2019 6:06 AM -
0 Votes
Connect ADLS from Interactive query (hive) server as external storage
We already have our data in azure data lake store as parquet files. We want to use interactive query for querying this data but we don't want to ingest the data into hive ...Proposed | 2 Replies | 117 Views | Created by ArnayJoshi - Thursday, July 4, 2019 5:59 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, July 8, 2019 9:32 AM -
0 Votes
C# Programmatically connect Apache Kafka on HDInsight 3.6
C# - Please let me know any .NET SDK or NuGet packages like confluent.kafka to connect Azure HDInsight with Kafka HD Insight with Kafka ( Sample info ...Proposed | 4 Replies | 315 Views | Created by SMSuresh - Thursday, June 20, 2019 11:47 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, July 3, 2019 5:07 AM -
0 Votes
Azure append blob storage does not support spark textFile API
Hello, When I run sc.textFile('/path to an append blob'), I got the following error. Caused by: com.microsoft.azure.storage.StorageException: Incorrect Blob ...Proposed | 11 Replies | 2980 Views | Created by Azure append blob does not support HDInsight spark - Monday, September 14, 2015 10:11 PM | Last reply by akkidx - Sunday, June 30, 2019 3:33 AM -
0 Votes
Java with Data Factory HDInsight Spark Activity
I was wondering if Java jar files in addition to Scala jar files are supported for HDInsight Spark Activities in Data ...Answered | 8 Replies | 280 Views | Created by bwong9 - Monday, June 24, 2019 8:12 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, June 28, 2019 5:18 AM -
0 Votes
api for reading hive metadata from hdinsight
Hi Is there an api to read hive metadata from hdinsight? Thanks RachnaProposed | 2 Replies | 174 Views | Created by RJB2019 - Monday, June 17, 2019 6:47 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, June 25, 2019 11:02 AM -
0 Votes
"Heartbeat lost" problem 3 nodes in HDInsight cluster - how to resolve?
Hi all, We are having problems with 3 nodes in our HDInsight cluster reporting "heartbeat lost" in the Ambari web UI and the troubleshooting steps (in ...Answered | 3 Replies | 183 Views | Created by Sean Holm - Saturday, June 22, 2019 7:32 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, June 24, 2019 8:27 AM -
1 Votes
Kafka Queries
I have the following questions with regards to Kafkka. Appreciate if you can address them ? 1.Do we have the support for failover in HDInsight Kafka ...Answered | 5 Replies | 267 Views | Created by Raven Peaks - Friday, June 7, 2019 4:31 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, June 18, 2019 5:09 AM -
0 Votes
Unable to create HDInsight Linked Service in ADF
I was going through some adf tutorial labs(https://github.com/kromerm/adflab) and ran into an issue where I was unable to create an HD Insight Linked Service. I found a tutorial on the microsoft ...Answered | 3 Replies | 160 Views | Created by KevinCurnow - Thursday, June 13, 2019 2:36 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, June 17, 2019 5:15 AM -
2 Votes
Transform data in the cloud by using Spark activity in Azure Data Factory
HI Team, I am following this documentation . I am trying with the steps that are provided in official documentation. When i am trying to deploy the pipeline, ...Proposed | 15 Replies | 599 Views | Created by Ankur321 - Wednesday, April 3, 2019 11:42 AM | Last reply by ami232 - Friday, June 14, 2019 10:37 AM -
0 Votes
Automating Hive Query using Azure PowerShell
Hi , I am trying to execute the below script to automate hive query run on HDInsight cluster Invoke-AzureRmHDInsightHiveJob -StatusFolder ...Proposed | 1 Replies | 139 Views | Created by Kumud Advani - Tuesday, June 11, 2019 1:50 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, June 12, 2019 7:01 AM -
0 Votes
Importing a Class from a Library (PySpark on HDInsight)
I'm trying to import a specific class (ExponentialSmoothing) from a very popular library called StatsModels. It actually works great in databricks and in my own local Jupyter Notebook, but for some ...Unanswered | 3 Replies | 262 Views | Created by Justin Cherveny - Monday, June 3, 2019 7:36 PM | Last reply by Justin Cherveny - Monday, June 10, 2019 6:35 PM -
0 Votes
Troubleshooting running a pig pipeline job on on-demand cluster. ERROR 2999: Unexpected internal error.
Hi, I am running a pig pipeline activity on the on-demand HDInsight cluster. It did successfully ran on the input from and output to both Azure Blob Storage days ...Proposed | 4 Replies | 224 Views | Created by qaws01395 - Monday, June 3, 2019 1:29 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, June 6, 2019 5:52 AM -
0 Votes
Connecting an external Hadoop
The goal is probably poorly formulated due to lack of knowledge of Apache technology stack. Still, There is a need to replace the Hadoop in HDInsight cluster with ...Proposed | 1 Replies | 178 Views | Created by SergeKr - Wednesday, June 5, 2019 12:20 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, June 6, 2019 5:43 AM -
2 Votes
AuthorizationFailed when running pipeline on on-demand cluster. Microsoft.HDInsight/clusters/write
Hi, I tried to manually trigger the pipeline activity on my new created data factory and on-demand cluster. But I failed with not sufficient write permission. My ...Answered | 3 Replies | 296 Views | Created by qaws01395 - Thursday, May 23, 2019 7:17 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, June 3, 2019 5:02 AM -
1 Votes
How to use confluent.kafka SDK with Azure HDInsight
Any documentation how to use confluent.kafka nuget package and to connect use HDInsight with Kafka ? I found nothing ? A sample code will be really appreciate, I ...Answered | 4 Replies | 335 Views | Created by Hugo Girard - Friday, May 24, 2019 7:30 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, May 30, 2019 4:51 AM -
0 Votes
Spark unable to scale beyond 32 nodes
In current Spark Configuration we can’t go beyond 32 worker nodes as the Head Nodes we are currently using are 2*D12v2 (4cores 28 GiB) and when scaling up the worker nodes beyond 32 nodes on the ...Answered | 2 Replies | 283 Views | Created by varsh83 - Wednesday, May 22, 2019 6:32 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, May 28, 2019 9:12 AM -
0 Votes
HDinsight Cluster port
<form action="https://www.reddit.com/r/AZURE/comments/bqwwis/azure_free_account/?#" class="usertext warn-on-unload" id="form-t3_bqwwis97f" ...Proposed | 1 Replies | 266 Views | Created by newdave111 - Monday, May 20, 2019 3:28 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, May 27, 2019 4:16 AM - Items 1 to 20 of 1706 Next ›
No announcements
