No announcements
-
2 VotesDremio access to HDInsight cluster and Hive
We are exploring the option to access a hive table or underlying data in hdfs on HDInsight cluster on Azure from Dremio client. We are currently able to access the other resources like MSSQLServer, ...Proposed | 3 Replies | 100 Views | Created by azdevad1 - Monday, September 9, 2019 3:04 PM | Last reply by azdevad1 - Friday, September 13, 2019 4:22 PM
-
0 Votes
question about install packages on HDInsight spark cluster(linux)
Hi all, I am trying to build up spark cluster so that our ML team could use ADF to submit spark activity. I run into some configuration issue and hope any of ...Proposed | 3 Replies | 104 Views | Created by davidyang2000 - Friday, September 6, 2019 5:49 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, September 13, 2019 9:53 AM -
0 Votes
Getting Operation timed out when trying to send event to Event Hub using Java client 3.0.0
Hi Team, I am trying to send an event to Event Hub using below code ...Proposed | 4 Replies | 79 Views | Created by Orion_123 - Tuesday, September 10, 2019 6:48 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, September 13, 2019 9:49 AM -
0 Votes
Which Azure Data Factory resource to use with HDInsights Jupyter Notebook (Pyspark 3)
My team and I are trying to configure an azure data factory (ADF) pipeline that runs some code I wrote for an HDInsight job. The code runs just fine when I open the Jupyter Notebook in my HDInsight ...Proposed | 3 Replies | 101 Views | Created by Justin Cherveny - Tuesday, September 3, 2019 5:50 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, September 10, 2019 4:23 AM -
0 Votes
JAVA API for getting information about a given HDInsight
az hdinsight show --resource-group <resource group> --name <cluster name> I am using Oracle java ...Proposed | 3 Replies | 105 Views | Created by Kiran_81 - Thursday, September 5, 2019 4:57 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, September 10, 2019 4:21 AM -
0 Votes
How to run shell script in Azure datafactory V2?
Is there a way or work around to run a shell script in ADF v2?Proposed | 3 Replies | 121 Views | Created by nvbala.vignesh - Tuesday, September 3, 2019 9:05 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, September 6, 2019 9:11 AM -
0 Votes
LLAP Interactive Query Cluster Slow Query Performance
Hi, We have HDInsight with interactive query running on our environment. The users reported that their queries running slow. We have tried to ...Proposed | 6 Replies | 263 Views | Created by Freddy.Setiawan - Wednesday, August 14, 2019 2:21 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, September 5, 2019 6:54 AM -
0 Votes
HDInsight with Datalake Gen2 storage
I have created HDInsight Hadoop cluster with underlying storage account as Blob storage and was able to successfully prove out a few concepts of creating tables, loading data from ...Proposed | 4 Replies | 158 Views | Created by azdevad1 - Tuesday, August 27, 2019 5:00 PM | Last reply by MartinJaffer-MSFT - Friday, August 30, 2019 5:29 PM -
0 Votes
Submitting pyspark job through livy using user defined parameters
Below is the folder structure that we follow on the wasb. main.py jobs.zip jobs ...Proposed | 5 Replies | 829 Views | Created by learningmind - Monday, January 29, 2018 6:52 PM | Last reply by JelenaLazar - Wednesday, August 28, 2019 4:39 PM -
0 Votes
Question about HDInsight IO cache
Hi HDInsight team! We here evaluating running Spark on HDInsight with data cache, and I went across this great article introducing HDInsight IO cache ...Proposed | 4 Replies | 218 Views | Created by Chen71 - Thursday, August 15, 2019 10:26 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, August 28, 2019 10:18 AM -
0 Votes
connecting via ssh client
ssh admin@Kafkaepam-ssh.azurehdinsight.net i'm getting access denied error while connecting to the HDInsight clusterAnswered | 4 Replies | 176 Views | Created by manjerekar rao - Tuesday, August 20, 2019 2:46 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, August 27, 2019 8:26 AM -
0 Votes
Difference in HDInsight clusters - Insight requested
We have multiple options available for the HDInsight clusters. I am aware of the below documentation but still need some insights. For example, creating a Hadoop ...Answered | 1 Replies | 103 Views | Created by azdevad1 - Monday, August 26, 2019 4:46 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, August 27, 2019 5:24 AM -
1 Votes
Access denied when connecting to HDIssight cluster using Putty
Hi, I have created a HBase cluster in HDInsight. When I tried to connect to cluster using putty from my windows machine, it gives access denied ...Answered | 5 Replies | 1399 Views | Created by Aswathy Raveendran - Friday, October 20, 2017 7:14 AM | Last reply by HimanshuSinha-msft - Monday, August 26, 2019 6:54 PM -
0 Votes
HDinsight cluster - Access previously created hive tables
I created a HDInsight cluster and loaded a couple of files into hive tables. Since I deleted the cluster for obvious reasons and created a new one again today. It seems to be a completely new instance ...Answered | 4 Replies | 166 Views | Created by azdevad1 - Friday, August 23, 2019 4:41 PM | Last reply by MartinJaffer-MSFT - Monday, August 26, 2019 4:28 PM -
0 Votes
Bash Script URL from repository?
I'm trying to use the python library "holidays" in my pyspark 3 kernel jupyter notebook in HDInsight. I'm following the instructions in the documentation to install custom ...Proposed | 3 Replies | 213 Views | Created by Justin Cherveny - Friday, August 9, 2019 7:13 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, August 21, 2019 6:21 AM -
0 Votes
Retrieve hive table in a new cluster
Hi I am new in HDInsight and I have create a bunch of tables with hive in a cluster. After creating the tables I have connected these to powerBI. But ...Proposed | 3 Replies | 491 Views | Created by Cécile Angéla - Friday, August 9, 2019 1:38 PM | Last reply by MartinJaffer-MSFT - Monday, August 19, 2019 6:38 PM -
0 Votes
Are node/host names retrieved from ambari unique over lifetime of hdinsight cluster
centos@hn0-cluste:~$ curl -u admin:password "https://clustesting03.azurehdinsight.net/api/v1/clusters/clustesting03/hosts" --silent | jq -r ...Answered | 5 Replies | 313 Views | Created by Kiran_81 - Tuesday, July 30, 2019 7:06 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, August 7, 2019 8:28 AM -
0 Votes
Spark-submit job in hdinsight cluster using apache livy, ERROR: No yarn application found
Hi, Whenever I'm submitting my spark job using apahce livy I'm getting following error No YARN application is found with tag livy-batch-7-ko9bt2my in 120 seconds. ...Proposed | 3 Replies | 290 Views | Created by Fadd_khan - Tuesday, July 30, 2019 11:46 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, August 6, 2019 5:27 AM -
0 Votes
2 HDI with 1 Hive Metastore
Hi, We deploy 2 HDI clusters: H1 Hadoop and Interactive Query(IQ), and we point both to use same Azure Data Lake and Hive Metastore When ...Answered | 5 Replies | 344 Views | Created by Freddy.Setiawan - Wednesday, July 17, 2019 9:43 AM | Last reply by ChiragMishra-MSFT - Tuesday, July 30, 2019 10:50 AM -
0 Votes
Can't deploy HDInsight 4.0 (Spark 2.3) in VNet
The problem is I can't deploy HDI cluster in desired VNet, but couple weeks ago I could do it with the same template and VNet configuration. In Ambari I see 3 ...Proposed | 5 Replies | 341 Views | Created by Vitaliy Degtyarev - Tuesday, July 16, 2019 11:52 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, July 24, 2019 1:38 PM - Items 1 to 20 of 1724 Next ›
No announcements
