No announcements
-
0 VotesIssue while writing data from databricks to Azure DW (synapse)
Trying to write data into SQl DW through databricks stream data frame. process is trying to delete the temp folder in the BLOB storage and throwing below. In the documentation I see that ...Proposed | 6 Replies | 172 Views | Created by sandeep8530 - Monday, December 23, 2019 9:19 PM | Last reply by 00000000-0000-0000-0000-000000000000 - Friday, December 27, 2019 7:43 PM
-
0 Votes
Cluster Configeration for 850 GB Data for analytical workload in Databricks
Hi, try to find , but didn't get any document or reference need to process 850 GB for for analytical workload Worker Type: ...Proposed | 2 Replies | 89 Views | Created by manish0000 - Wednesday, December 25, 2019 8:45 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, December 27, 2019 9:59 AM -
0 Votes
spark read dw driver difference
what's the difference between reading table from azure data warehouse using .format("jdbc") ...Proposed | 3 Replies | 161 Views | Created by sakurai_db - Thursday, December 19, 2019 3:48 PM | Last reply by sakurai_db - Friday, December 27, 2019 1:56 AM -
0 Votes
Azure Databricks: SQL Notebook - Querying data from ADLS
Data Lake (Gen1) -> Azure SQL Database -> Power BI Requirement: We typically want to visualize data in the data lake in a relational format for various operational reasons ...Unanswered | 1 Replies | 65 Views | Created by Rajkumar5055 - Thursday, December 26, 2019 2:58 PM | Last reply by Srihad - Thursday, December 26, 2019 4:28 PM -
0 Votes
AttributeError: 'FSHandler' object has no attribute 'mount'
Hi, 1) I imported the dbutil modules but the problem is when I mount the blob ...Proposed | 2 Replies | 146 Views | Created by Harvey h - Thursday, December 19, 2019 7:00 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, December 24, 2019 11:13 AM -
0 Votes
Not able to Read and Write to SQL DWH Passthrough Ad Azure from Databricks High Concurrency
WE ARE NOT ABLE TO READ WRITE TO SQL DWH FROM DATABRICKS. THIS HAPPEN IF WE USE PASSTHROUGH WITH AD AZURE AUTH WITH HIGH CONCURRENCY MODE. IF WE USE HIGH CONCURRENCY WITH SQL Server ...Proposed | 3 Replies | 264 Views | Created by MaurizioIT - Friday, December 13, 2019 9:47 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Tuesday, December 24, 2019 11:12 AM -
0 Votes
Databricks Notebook Action fails - INVALID_PARAMETER_VALUE
Dear All, I have configured a simple pipeline using the example reported in this MS ...Proposed | 5 Replies | 267 Views | Created by Grandi Roberto - Tuesday, December 10, 2019 7:28 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, December 19, 2019 8:13 AM -
1 Votes
Can't import the installed python modules
I had just began to run python notebooks through spark cluster offered in Azure Databricks. As a requirement, we have installed couple of external packages like spacy and kafka, through both shell ...Answered | 5 Replies | 223 Views | Created by micro_bvin - Thursday, December 12, 2019 1:00 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, December 19, 2019 8:12 AM -
0 Votes
Redesigning SProc to Azure Databricks SQL
Hi, I am trying to redesign the ETL process from Stored Proc to Azure Databricks. I have below question. 1) I am looking to convert the existing SProc to ...Answered | 8 Replies | 414 Views | Created by Harvey h - Wednesday, November 20, 2019 4:51 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, December 19, 2019 6:01 AM -
0 Votes
Syntax Error trying to run Introduction To Azure Databricks notebook 2
I'm going thru the Microsoft Learn here: https://docs.microsoft.com/en-us/learn/modules/intro-to-azure-databricks/4-using-notebooks ...and I'm getting a syntax ...Answered | 3 Replies | 275 Views | Created by Bill Blakey FA - Sunday, December 8, 2019 9:36 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, December 16, 2019 8:14 AM -
0 Votes
Handling Event hub messages when spark jobs fails
Hi, Could you please provide solution for the below issue, Event hub Producer using .net For Consuming messages we are using ...Proposed | 7 Replies | 339 Views | Created by naveen751 - Thursday, December 5, 2019 10:49 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Monday, December 16, 2019 4:43 AM -
0 Votes
Documentation to use sql queries in Cluster notebook
Hi Team, I need one help as i have create database in Azure storage and now execute some sql queries on existing database to transform data instead of scala/spark queries. Please ...Answered | 3 Replies | 284 Views | Created by Sudehely - Thursday, December 12, 2019 11:59 PM | Last reply by Vaibhav-Chaudhari - Saturday, December 14, 2019 9:56 AM -
1 Votes
How to save Keras Model in HDF5 format
Hi. I am running script that create deep learning model which needs to be saved to somewhere. This model then has to be imported to another place to test model. I tried two ...Answered | 3 Replies | 307 Views | Created by Brian2004 - Thursday, December 5, 2019 12:51 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, December 11, 2019 9:14 AM -
0 Votes
Get the Account Usage View
Hi, I am trying to get the Account Usage as following: https://docs.databricks.com/administration-guide/account-settings/usage.html The ...Proposed | 3 Replies | 324 Views | Created by AlexMws - Tuesday, November 26, 2019 4:50 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, December 6, 2019 10:07 AM -
0 Votes
Python notebook failed but the overall status of notebook activity shows as succeeded.
Hi I have daily ADF pipeline has the databricks activity calls this py notebook. This morning it has failed because of some transformation rules. But the overall notebook status and databricks ...Answered | 17 Replies | 536 Views | Created by naveen.kuppili - Wednesday, November 20, 2019 2:41 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, December 6, 2019 4:35 AM -
0 Votes
How to copy or append the one dataframa data to another dataframe?
Json source frame as 100 columns with all string data type including date columns are string and target frame as same 100 columns but only difference is some columns as timestamp, date ...Proposed | 4 Replies | 315 Views | Created by everfor - Saturday, November 23, 2019 9:43 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Thursday, December 5, 2019 9:25 AM -
0 Votes
dynamic column mapping automatically?
through data factory we are passing the dynamically different json file and writing to sql server tables but the source and target columns order are different are different and target table columns ...Proposed | 3 Replies | 320 Views | Created by everfor - Monday, November 18, 2019 4:36 PM | Last reply by CHEEKATLAPRADEEP-MSFT - Wednesday, November 27, 2019 10:30 AM -
0 Votes
Azure Databricks - lesson on docs.microsoft.com
Create a Databricks workspace Tried creating a Azure databricks workspace and cluster for the notebook. But the cluster creation is ...Answered | 2 Replies | 472 Views | Created by ARR1234 - Saturday, November 23, 2019 10:59 PM | Last reply by ARR1234 - Monday, November 25, 2019 1:52 PM -
0 Votes
Passing dataframe sql output in query preaction statement?
jsonframe.createOrReplaceTempView("newDataFramesql") val query = " update call1 set current_row = 0 where ID in (select ID from "+newDataFramesql+" ...Proposed | 3 Replies | 348 Views | Created by everfor - Monday, November 11, 2019 8:50 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, November 22, 2019 10:24 AM -
0 Votes
What are the steps involved in installing Apache Livy on Azure data bricks?
Hi Everyone, I want to install the Apache livy on Azure databricks. What are the steps involved in installing apache livy on azure ...Proposed | 3 Replies | 342 Views | Created by Nandha1712 - Monday, November 18, 2019 6:27 AM | Last reply by CHEEKATLAPRADEEP-MSFT - Friday, November 22, 2019 10:24 AM - Items 1 to 20 of 31 Next ›
No announcements
