No announcements
Found 1802 threads
-
0 Votes
TimedOutWaitingForAmbariHostsErrorCode issue with HDInsight
I am using ARM Template to create a HDInsight SPARK cluster. At the end of HDInsight configuration state I am getting the below error: Deployment failed. Correlation ID: ...Proposed | 1 Replies | 250 Views | Created by BiNiku - Thursday, April 16, 2020 5:32 AM | Last reply by ChiragMishra-MSFT - Thursday, April 16, 2020 6:25 AM -
0 Votes
Add External data source oozie/sqlserver to a HDInsight Deployment using CLI.
I have been through the Azure CLI documentation for HDInsight and don't see any options to add external datasource to the HDInsight which I can do it when I use the ...Answered | 3 Replies | 360 Views | Created by BiNiku - Thursday, April 9, 2020 7:00 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, April 14, 2020 3:45 PM -
1 Votes
HDInsight metastore server
I'd like to create and delete HDInsight clusters using a continuously running SQL server for the Hive metastore. Unfortunately because of the high demand, there are no Azure SQL ...Answered | 1 Replies | 209 Views | Created by Peter Paluska - Wednesday, April 8, 2020 7:38 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, April 8, 2020 10:37 AM -
0 Votes
Install HDInsight with ESP failed with error message "Domain XXX not found in the Active Directory"
W'd like to deploy an HDInsight with Enterprise Security Package (ESP) and integration with azure AD. We followed online documents to create an AD ...Proposed | 6 Replies | 2120 Views | Created by edouardzyc - Thursday, September 27, 2018 10:39 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, April 8, 2020 5:30 AM -
0 Votes
Spark HBase connection failing on Secured HDInsight clusters
We have enabled ESP on our HDInsight clusters and we are running into issues when making a call from Spark to HBase. I have created a keytab file with my logon – ...Proposed | 2 Replies | 347 Views | Created by varsh83 - Tuesday, March 24, 2020 10:28 PM | Last reply by MartinJaffer-MSFT - Thursday, April 2, 2020 11:34 PM -
0 Votes
Save Notebooks and or state or filesystem across Cluster delete/reprovision
There is no stop/start for an HDInsight Cluster so I need to deploy and delete daily. The state, or rather the hdfs file system gets overwritten with every deployment. I really just need to save my ...Proposed | 4 Replies | 317 Views | Created by dcDRH - Friday, March 27, 2020 2:15 PM | Last reply by MartinJaffer-MSFT - Thursday, April 2, 2020 11:31 PM -
0 Votes
Can I use python to get count on table of HDInsight and return result?
I have HDInsight and I am writing python daily job to query data on it, and I need to check the row count on it. I would like to use python/API to get the row count of the table, no matter running ...Unanswered | 1 Replies | 221 Views | Created by wing_chung - Tuesday, March 31, 2020 9:58 AM | Last reply by MartinJaffer-MSFT - Tuesday, March 31, 2020 10:32 PM -
0 Votes
Is there a way in CLI to add a config to the cluster for the external hive metadata store?
Hi, I used the CLI command to create an HDI cluster 4.0 , with success :) az hdinsight create --name $clustername --resource-group $resourceGroupName ...Proposed | 5 Replies | 452 Views | Created by Ortwin - Tuesday, March 17, 2020 12:47 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, March 26, 2020 9:25 AM -
0 Votes
Necessity of Kerberos on ESP enabled HDInsight
I have HDInsight Kafka cluster with ESP enabled. Hence I already have AD group for authentication, Apache Ranger for Kafka topic level authorization, TLS enabled for encryption. I Want to know if this ...Proposed | 3 Replies | 295 Views | Created by mvidya - Sunday, March 15, 2020 10:38 AM | Last reply by KranthiPakala-MSFT - Friday, March 20, 2020 5:11 AM -
0 Votes
Could not load db driver class: com.mysql.jdbc.Driver
I'm trying to use Sqoop to connect to MySQL database but i keep getting this error ' Could not load db driver class: com.mysql.jdbc.Driver'. I found some resources online about a jar file and ...Proposed | 3 Replies | 356 Views | Created by Thomas Karba - Monday, March 2, 2020 6:53 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, March 19, 2020 9:28 AM -
0 Votes
How to change Azure HDInsight Hadoop to Azure Private endpoint.
I already create a Azure HDInsight Hadoop cluster but in public network. Now,I want to change it into Private network using Azure Private Link to private endpoint. How can I change ...Answered | 3 Replies | 302 Views | Created by sarveshpandey23 - Monday, March 9, 2020 8:12 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, March 19, 2020 9:24 AM -
1 Votes
Databricks Connection error with power BI
getting this error when connecting Power BI with Azure Databricks through spark build in connector: Details: "ODBC: ERROR [HY000] [Microsoft][DriverSupport] ...Proposed | 8 Replies | 6846 Views | Created by meenu sheokand - Tuesday, April 9, 2019 4:02 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, March 13, 2020 4:40 AM -
0 Votes
HDInsight Deployment using Power Shell New-AzHDInsightCluster
Hi, I am trying to deploy a HDInsight cluster 4.0 using functions provide by Power Shell 3.5 (New-AzHDInsightCluster) I am getting the following error ...Proposed | 7 Replies | 527 Views | Created by Ortwin - Tuesday, March 10, 2020 1:47 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, March 11, 2020 9:29 AM -
0 Votes
Open Questin related to big data services
Hi Team, I am Onkar, i am intrested to user Azure services but after hands on only. I am trying to use all Big data component on azure but each time facing some issue & unable ...Proposed | 3 Replies | 295 Views | Created by Onkar55 - Sunday, March 1, 2020 6:24 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, March 5, 2020 12:02 PM -
0 Votes
Comparison of HDInsight over Azure Databricls
Hello, From past some days, I am exploring on Azure HDInsight Hadoop cluster and Azure Databricks comparison. In my comparison I found the following ...Proposed | 3 Replies | 495 Views | Created by akhiltummala7 - Wednesday, February 26, 2020 9:22 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, March 5, 2020 12:02 PM -
0 Votes
Head Node role in Kafka HDInsight
When we create a Kafka on HDInsight cluster, by default we get 2 head nodes and 3 zookeeper nodes. If I am right, worker nodes are nothing but brokers if we create kafka cluster. So in this scenario, ...Answered | 1 Replies | 257 Views | Created by mvidya - Thursday, March 5, 2020 10:50 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, March 5, 2020 12:00 PM -
0 Votes
Understanding Managed Disk usage for Kafka on HDInsight
Hi, I want to create hdinsight kafka cluster and I want to start with 1 managed disk for 3 worker nodes. Later according to requirement I want to scale up the managed disks as I ...Answered | 2 Replies | 259 Views | Created by mvidya - Friday, February 28, 2020 10:03 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, March 3, 2020 4:17 AM -
0 Votes
HiveServer2 Interactive Fail to start
Hello, The HiveServer2 Interactive server is failing to start with LLAP status unknown. WARN status.LlapStatusServiceDriver: Watch mode enabled ...Proposed | 3 Replies | 596 Views | Created by dissana-yaka - Sunday, February 23, 2020 4:31 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, February 26, 2020 12:16 PM -
0 Votes
Kerberos Authentication on hdinsight cluster
Hi All, Could you please let me know the procedure to enable Kerberos Authentication on Hdinsight Cluster (ESP Enabled) with AD DS integrated and also ...Answered | 5 Replies | 399 Views | Created by Rahul Goud Akkula - Friday, February 14, 2020 10:25 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, February 25, 2020 10:26 AM -
1 Votes
Unable to Install Superset on Azure HDI
Hello all, I want to get Apache Superset installed on our IQR cluster. Although it's bundled in the HWX GA release for HDI, installing is restricted. Is it possible to get this ...Answered | 2 Replies | 235 Views | Created by dissana-yaka - Monday, February 17, 2020 9:05 AM | Last reply by dissana-yaka - Tuesday, February 18, 2020 5:04 AM
No announcements