No announcements
Found 1802 threads
-
0 VotesHow to Create and Run Apache Pig Jobs in Hadoop cluster in HDInsight
Hi, I signed up to Azure free account and created a Apache Hadoop cluster in HDInsight, I am trying to create an apache pig job and run it in the cluster, however, I struggle to ...Proposed | 3 Replies | 2317 Views | Created by PiggyZhou - Friday, May 29, 2020 9:48 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, June 5, 2020 12:29 PM
-
0 Votes
New-AzHDInsightCluster: Operation returned an invalid status code 'BadRequest'
Install-Module -Name Az.HDInsight PS /home/shafaat> New-AzHDInsightCluster ` >> -ResourceGroupName $resourceGroupName ...Unanswered | 4 Replies | 4026 Views | Created by Rahul Akk - Saturday, May 16, 2020 5:45 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, June 5, 2020 12:29 PM -
0 Votes
Sharing files between two clusters.
I have to create two separate azure cluster for two different sites. Then i need to connect them together with a server. I wanted to know how ...Proposed | 3 Replies | 2063 Views | Created by Rajbukhariya - Thursday, May 21, 2020 3:35 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, May 29, 2020 11:17 AM -
0 Votes
[Announcement] Azure HDInsight Forum Migrated to Microsoft Q&A
All MSDN Azure Forums have moved to Microsoft Q&A platform to help our community members to find faster ... -
1 Votes
How to install custom HBase Coprocessor.
Hi, We're currently using our own ambari hadoop nodes with hbase and we currently use a couple of coprocessors, some to handle custom queries via a gRPC API, some to send a message ...Answered | 5 Replies | 1983 Views | Created by Geert Pt - Monday, May 18, 2020 2:48 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, May 26, 2020 4:12 AM -
0 Votes
error while creating hdinsight with adls gen1 as default storage
Could you please share any ex powershell script where i can pass metastore config for hive and oozie along . also am storing certificate in keyvault secrets and plz let ...Proposed | 3 Replies | 1577 Views | Created by Rahul Akk - Sunday, May 17, 2020 9:45 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, May 22, 2020 1:21 PM -
0 Votes
ERROR while creating hdinsight
Hi Team, The same script worked earlier but when i changed storage parameters and then run it aagain it fails with the below error in the new ...Answered | 3 Replies | 1731 Views | Created by Rahul Akk - Tuesday, May 19, 2020 5:54 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, May 20, 2020 12:42 PM -
0 Votes
[Announcement] Microsoft Q&A to replace all English Azure MSDN forums
Azure HDInsight forum will be migrating to a new home on Microsoft Q&A! We’ve listened to your feedback on how ... -
0 Votes
How to use Kafka 2.3 in HDInsight
The documentation recommends the use of Kafka 2.3 in HDInsight 4.0 but there is no such option while creating the cluster. How can this be achieved? "We recommend using Spark ...Proposed | 3 Replies | 1673 Views | Created by RChee12 - Sunday, May 10, 2020 9:34 PM | Last reply by HimanshuSinha-msft - Monday, May 18, 2020 3:48 PM -
0 Votes
powershell script to launch hdinsight in existing vnet
Hi All below is the error i am getting while i use powershell script to launch hdinsight cluster in existing vnet using the below script ...Proposed | 20 Replies | 2745 Views | Created by Rahul Akkula - Friday, December 13, 2019 1:31 PM | Last reply by Rahul Akk - Saturday, May 16, 2020 5:50 PM -
0 Votes
Service Principal for ADLS
Hi Team, I understand that we need to have service principal in place for hdinsight cluster to access ADLS. My requirement is to use service principal ...Proposed | 6 Replies | 1767 Views | Created by Rahul Akk - Wednesday, May 6, 2020 10:34 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, May 14, 2020 11:55 AM -
1 Votes
Using JsonSerDe in a hive script in an on-demand hdinsight cluster
I have written a hive script that works fine in an existing HDInsight cluster. But when I instantiate the script via the Azure Data Factory in an on demand cluster, I get the following ...Answered | 3 Replies | 1885 Views | Created by 2Jon - Saturday, May 2, 2020 8:20 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, May 7, 2020 12:10 PM -
0 Votes
Hdinsight cluster -----EDGE node IAAS vs PAAS
Hi Team, What are the options for adding an edge node to an HDinsight cluster. I understand that once the HDInsight cluster is created we can deploy and attach an edge node to the ...Answered | 5 Replies | 1815 Views | Created by Rahul Akk - Monday, May 4, 2020 12:43 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, May 6, 2020 12:31 PM -
0 Votes
Spark - Jupyter notebook connection error
I do the following: 1. click "Jupyter Notebook 2. Click HVACTutorial.ipynb 3. Notebook opens ok, but I get the ...Proposed | 6 Replies | 4010 Views | Created by ChrThi - Saturday, July 25, 2015 1:05 PM | Last reply by ChiragMishra-MSFT - Tuesday, May 5, 2020 12:31 PM -
2 Votes
MFA DISABLE for HDI ESP clusters
MFA Settings and then there should we give the CIDR subnet range for the trsuted IP's to bypass MFA. I'd be waiting for your response. Thanks in ...Answered | 8 Replies | 1963 Views | Created by Rahul Akk - Thursday, April 30, 2020 11:56 AM | Last reply by Rahul Akk - Tuesday, May 5, 2020 9:06 AM -
0 Votes
powershell script to launch hdinsight using automation runbook
Hi Team, I am trying to run powershell script using automation runbook in free trial version. Attached is the screenshot of the error. Could ...Answered | 3 Replies | 1715 Views | Created by Rahul Akk - Saturday, May 2, 2020 10:56 AM | Last reply by Rahul Akk - Monday, May 4, 2020 12:30 PM -
0 Votes
Service principle role for HDI to access ADLS
Hi Team, I understand that we must create service principal app registration and then assign it with some role to acccess ADLS and then later this service principal is used by the ...Answered | 2 Replies | 1680 Views | Created by Rahul Akk - Thursday, April 30, 2020 12:00 PM | Last reply by Rahul Akk - Thursday, April 30, 2020 6:11 PM -
0 Votes
Read files from Azure storage in map function
Hi, My pyspark application tries to process some json data in Azure blob containers (they are in different containers). To process json files in one container, I use the following ...Proposed | 3 Replies | 1837 Views | Created by yuejiang_li - Saturday, April 18, 2020 12:11 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, April 24, 2020 11:27 AM -
1 Votes
Jupyter and pyspark through ssh not working in HDInsights
Hi, After I create a HDInsight cluster on azure, I used it fine for tutorial on jupyter notebook at the first time. But when I start a new jupyter notebook and ...Answered | 10 Replies | 2743 Views | Created by yuejiang_li - Monday, April 13, 2020 8:11 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, April 20, 2020 7:20 AM -
0 Votes
HDInsight Deployment using CLI with ADLS Gen2 Storage.
Hi, I am trying to create a HDInsight Cluster with version 4.0. When I give a storage account that have enabled hierarchical namespace (Azure Data Lake Storage Gen2), I get the ...Answered | 6 Replies | 1783 Views | Created by BiNiku - Thursday, April 9, 2020 6:57 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, April 16, 2020 11:48 AM - Items 1 to 20 of 1802 Next ›
No announcements
