No announcements
-
0 VotesHow to use confluent.kafka SDK with Azure HDInsight
Any documentation how to use confluent.kafka nuget package and to connect use HDInsight with Kafka ? I found nothing ? A sample code will be really appreciate, I ...
-
0 Votes
AuthorizationFailed when running pipeline on on-demand cluster. Microsoft.HDInsight/clusters/write
Hi, I tried to manually trigger the pipeline activity on my new created data factory and on-demand cluster. But I failed with not sufficient write permission. My ...Proposed | 1 Replies | 54 Views | Created by qaws01395 - Thursday, May 23, 2019 7:17 PM | Last reply by CHEEKATLAPRADEEP-MSFT - 21 hours 41 minutes ago -
0 Votes
Fail to create in-demand hadoop cluster in Azure Data Factory; additionalProperties is not active
Chose Vnet and Subnet -> From Azure subscription -> and put in the existing vitrual network ID and subnet name. But the problem still present and the same error message ...Answered | 3 Replies | 189 Views | Created by qaws01395 - Wednesday, May 22, 2019 5:58 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, May 24, 2019 5:25 AM -
0 Votes
HDInsight Cluster stuck on applying changes when scaling
Hello, I tried to scale down my HDInsight cluster, but the service got stuck on "Applying changes..." (it is alredy 20 hours in this stage). I am unable to do anything with it. I cannot ...Proposed | 7 Replies | 1040 Views | Created by Marek Lani - Saturday, August 13, 2016 3:58 PM | Last reply by s7imtiaz - Friday, May 24, 2019 4:52 AM -
0 Votes
Spark unable to scale beyond 32 nodes
In current Spark Configuration we can’t go beyond 32 worker nodes as the Head Nodes we are currently using are 2*D12v2 (4cores 28 GiB) and when scaling up the worker nodes beyond 32 nodes on the ...Unanswered | 1 Replies | 77 Views | Created by varsh83 - Wednesday, May 22, 2019 6:32 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, May 23, 2019 11:29 AM -
0 Votes
Why is an empty file with the name of folder inside a Azure Blob storage container is created?
Hi All, I am running a Hive QL through HD Insight on demand cluster which does the following 1) spool the data from a hive view 2) Create a ...Proposed | 3 Replies | 428 Views | Created by Surya Seshagiri - Thursday, October 18, 2018 11:04 AM | Last reply by Mike Ubezzi (Azure) - Tuesday, May 21, 2019 4:35 PM -
0 Votes
HDinsight Cluster port
<form action="https://www.reddit.com/r/AZURE/comments/bqwwis/azure_free_account/?#" class="usertext warn-on-unload" id="form-t3_bqwwis97f" ... -
0 Votes
HDInsight in On-prem
Hi , Is it possible to install HDInsight on prem , may be single node installation in my local machine for training purposes? If so , is there a container image that will make things ...Proposed | 1 Replies | 93 Views | Created by psantha - Friday, May 17, 2019 5:41 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, May 20, 2019 4:29 AM -
0 Votes
Apache Ranger & Azure RBAC integration for HDInsight
I would like to understand in greater detail how Apache Ranger and Azure RBAC integrate, particularly in the context of access to Azure Data Lake Storage (ADLS Gen 2).Proposed | 1 Replies | 73 Views | Created by TrellisTech - Wednesday, May 15, 2019 2:18 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, May 16, 2019 10:16 AM -
0 Votes
Not able to access wasb FileSystem while running word count map reduce job
java -jar WordCount201.jar wasb://hexhadoopcluster-2019-05-15t07-01-07-193z@hexanikahdinsight.blob.core.windows.net/hexa/custdata.csv ...Proposed | 1 Replies | 72 Views | Created by JPurva - Wednesday, May 15, 2019 11:15 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, May 15, 2019 12:51 PM -
0 Votes
Kafka and Kafka Connectors
Hi, Does HDinsights support Kafka Connectors? Support are saying not supported for the Kafka Connectors to HDFS (Azure storage). Have tried and data ...Proposed | 5 Replies | 179 Views | Created by RichardJS74 - Thursday, May 9, 2019 12:25 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, May 14, 2019 5:11 AM -
0 Votes
Error while testing AZURE HIVE ODBC connection-Microsoft][Hardy] (34) Error from server: connect() failed: errno = 10060
Hi All, I have created a HIVE ODBC DSN for 64 bit which is pointed to HDinsight cluster.While testing this connection we are getting below ...Proposed | 6 Replies | 160 Views | Created by Priyshankar - Thursday, May 2, 2019 9:44 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, May 9, 2019 9:38 AM -
0 Votes
Can't submit a livy request for a jar file stored locally on the head nodes
I'm trying to reference the documentation below to make a livy request to an HDI 3.6 cluster and run a jar file that is stored locally on the head ...Proposed | 2 Replies | 125 Views | Created by jdecowski - Thursday, May 2, 2019 2:57 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, May 7, 2019 7:03 AM -
0 Votes
SSL setup for HDI Kafka - cannot produce messages via SSL port
I am trying to set up an HDI Kafka cluster with SSL for encryption and authentication as described in this ...Answered | 3 Replies | 414 Views | Created by Srdjan Milakovic - Monday, March 25, 2019 3:35 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, April 29, 2019 5:05 AM -
0 Votes
Differences between HD Insight and Azure Data bricks
Hi All, Can anyone please post the differences between Azure HD Insight and Azure Databricks. I know that HDInsight has several types of ...Answered | 3 Replies | 236 Views | Created by Surya Seshagiri - Wednesday, April 24, 2019 7:27 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, April 25, 2019 6:16 AM -
0 Votes
Unable to create HDI with Existing ADL - "Unable to verify permissions"
Hi, I'm trying to create HDI with Enterprise Security Package on Existing ADL. I've checked the ADL and saw that the service principal has been granted RWX on the ...Proposed | 3 Replies | 236 Views | Created by Freddy.Setiawan - Monday, April 22, 2019 5:56 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, April 24, 2019 9:08 AM -
0 Votes
HD Insight
I have created an HDInsight cluster following this tutorial: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-blob-storage. I have linked it to an existing Azure Storage account ...Answered | 1 Replies | 289 Views | Created by Raven Peaks - Wednesday, April 17, 2019 4:11 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, April 18, 2019 10:20 AM -
0 Votes
how to connect azure hdinsight kafka in .net
how to connect azure hdinsight kafka in .net? I have try the project:azure-event-hubs-for-kafka but i have no idea how to get the EH_CONNECTION_STRING in ...Proposed | 6 Replies | 349 Views | Created by LiuShaoyun - Wednesday, April 10, 2019 7:54 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, April 17, 2019 5:26 AM -
0 Votes
Move Hive metastore from HDInsight cluster to Azure SQL
Hello Everyone, I created a new HDInsight cluster (with Hive) and selected just the default options. In this case, I forgot to select the option to keep the Hive metastore in ...Proposed | 6 Replies | 2177 Views | Created by Markno22 - Thursday, September 8, 2016 7:12 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, April 17, 2019 5:22 AM -
2 Votes
Transform data in the cloud by using Spark activity in Azure Data Factory
HI Team, I am following this documentation . I am trying with the steps that are provided in official documentation. When i am trying to deploy the pipeline, ...Proposed | 14 Replies | 441 Views | Created by Ankur321 - Wednesday, April 3, 2019 11:42 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, April 15, 2019 4:47 AM - Items 1 to 20 of 1692 Next ›
No announcements
