No announcements
-
0 VotesPython notebook failed but the overall status of notebook activity shows as succeeded.
Hi I have daily ADF pipeline has the databricks activity calls this py notebook. This morning it has failed because of some transformation rules. But the overall notebook status and databricks ...Answered | 17 Replies | 346 Views | Created by naveen.kuppili - Wednesday, November 20, 2019 2:41 PM | Last reply by CHEEKATLAPRADEEP-MSFT - 1 hour 26 minutes ago
-
0 Votes
Handling Event hub messages when spark jobs fails
Hi, Could you please provide solution for the below issue, Event hub Producer using .net For Consuming messages we are using ... -
0 Votes
How to copy or append the one dataframa data to another dataframe?
Json source frame as 100 columns with all string data type including date columns are string and target frame as same 100 columns but only difference is some columns as timestamp, date ...Proposed | 4 Replies | 150 Views | Created by everfor - Saturday, November 23, 2019 9:43 AM | Last reply by CHEEKATLAPRADEEP-MSFT - 20 hours 36 minutes ago -
0 Votes
Get the Account Usage View
Hi, I am trying to get the Account Usage as following: https://docs.databricks.com/administration-guide/account-settings/usage.html The ...Proposed | 2 Replies | 132 Views | Created by AlexMws - Tuesday, November 26, 2019 4:50 PM | Last reply by CHEEKATLAPRADEEP-MSFT - 20 hours 36 minutes ago -
0 Votes
How to save Keras Model in HDF5 format
Hi. I am running script that create deep learning model which needs to be saved to somewhere. This model then has to be imported to another place to test model. I tried two ... -
0 Votes
dynamic column mapping automatically?
through data factory we are passing the dynamically different json file and writing to sql server tables but the source and target columns order are different are different and target table columns ...Proposed | 3 Replies | 159 Views | Created by everfor - Monday, November 18, 2019 4:36 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, November 27, 2019 10:30 AM -
0 Votes
Redesigning SProc to Azure Databricks SQL
Hi, I am trying to redesign the ETL process from Stored Proc to Azure Databricks. I have below question. 1) I am looking to convert the existing SProc to ...Proposed | 3 Replies | 164 Views | Created by Harvey h - Wednesday, November 20, 2019 4:51 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, November 27, 2019 10:30 AM -
0 Votes
Azure Databricks - lesson on docs.microsoft.com
Create a Databricks workspace Tried creating a Azure databricks workspace and cluster for the notebook. But the cluster creation is ...Answered | 2 Replies | 236 Views | Created by ARR1234 - Saturday, November 23, 2019 10:59 PM | Last reply by ARR1234 - Monday, November 25, 2019 1:52 PM -
0 Votes
Passing dataframe sql output in query preaction statement?
jsonframe.createOrReplaceTempView("newDataFramesql") val query = " update call1 set current_row = 0 where ID in (select ID from "+newDataFramesql+" ...Proposed | 3 Replies | 198 Views | Created by everfor - Monday, November 11, 2019 8:50 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, November 22, 2019 10:24 AM -
0 Votes
What are the steps involved in installing Apache Livy on Azure data bricks?
Hi Everyone, I want to install the Apache livy on Azure databricks. What are the steps involved in installing apache livy on azure ...Proposed | 3 Replies | 168 Views | Created by Nandha1712 - Monday, November 18, 2019 6:27 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, November 22, 2019 10:24 AM -
0 Votes
Data Labeling Needs
Does Azure offer internal tools for data labelings needs either for my own private workforce or a third party vendor? How can I create data labeling tasks through Azure?Unanswered | 1 Replies | 164 Views | Created by Data Labeling - Tuesday, November 19, 2019 10:14 PM | Last reply by RohitMungi-MSFT - Wednesday, November 20, 2019 10:24 AM -
0 Votes
Azure Databricks Spark: java.lang.OutOfMemoryError: GC overhead limit exceeded
Hi There, I am executing a Spark job in Azure Databricks cluster. I am triggering the job via a Azure Data Factory ...Proposed | 4 Replies | 257 Views | Created by ketanmehta4u - Monday, November 4, 2019 5:33 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, November 20, 2019 4:46 AM -
0 Votes
Unable to connect to SQL DATABASE using RODBC
library(RODBC) Please find the code below dbhandle <- odbcDriverConnect('driver={ODBC Driver 17 for SQL ...Answered | 3 Replies | 256 Views | Created by sadanandm2 - Wednesday, November 6, 2019 6:21 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, November 20, 2019 4:44 AM -
0 Votes
Calling the sql stored proc's in Scala?
In Dbricks scala programming, how to call the Azure Sql dwh stored procedures ? Also how to store the output in the data frame?Proposed | 3 Replies | 209 Views | Created by everfor - Monday, November 11, 2019 8:48 AM | Last reply by Vaibhav-Chaudhari - Monday, November 11, 2019 3:18 PM -
0 Votes
Cannot upload specific csv files to azure databricks
When attempting to upload a csv file to Azure Databricks I receive an upload error as seen in the attached screenshot. I am able to successfully upload other csv files without issue. The file I am ...Unanswered | 2 Replies | 283 Views | Created by richard.coleman - Monday, November 4, 2019 3:28 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, November 7, 2019 9:17 AM -
0 Votes
Azure data fctory(azure data bricks)
Hi, this is satish I am try to create cluster in data bricks through freetrail , but it unable to work so is ...Proposed | 3 Replies | 220 Views | Created by satish madaka - Tuesday, October 29, 2019 9:19 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, November 7, 2019 9:15 AM -
0 Votes
Way to save a lot of image files to Azure blob storage
Hi. I am new to azure databricks. Basically what I am doing is that I generate a bunch of images from data coming from the devices in databricks notebook and then transfer those images to azure blob ...Proposed | 3 Replies | 319 Views | Created by Brian2004 - Friday, October 25, 2019 8:29 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, November 4, 2019 6:27 AM -
0 Votes
Unable to Mount CSV file From Azure Blob Storage into Azure DataBricks using R
I am trying to read a CSV file from azure Blob storage into azure Databricks using R . but azure databricks failed to read Could you please let me know the ...Proposed | 9 Replies | 413 Views | Created by sadanandm2 - Monday, October 21, 2019 3:41 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, October 30, 2019 8:53 AM -
0 Votes
Unable to Read SAV file using [R] in azure Databricks
Please find the Code and error message while trying to read sav file in azure Databricks using ...Proposed | 3 Replies | 302 Views | Created by sadanandm2 - Wednesday, October 23, 2019 9:32 AM | Last reply by MartinJaffer-MSFT - Tuesday, October 29, 2019 5:38 PM -
0 Votes
Sharing data between two scripts in Azure Databricks
Hi. I am trying to make communicate between two scripts running in the same cluster in Azure Databricks. In Python with local server, I was able to import module ...Unanswered | 8 Replies | 378 Views | Created by Brian2004 - Friday, October 18, 2019 7:13 AM | Last reply by Naveen Thummalapenta - Friday, October 25, 2019 2:26 PM - Items 1 to 20 of 21 Next ›
No announcements
