Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
0 answers
Enable Claude 4 Sonnet Support on Azure Databricks
I had access to azure databricks sonnet 4 model deployment This shortly disappeared after I started using it. Could I get assistance re-enabling this for my tenant?
Azure Databricks
asked 2025-08-10T22:24:05.3966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 40%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESY%3C/text%3E%3C/svg%3E)
sean yeoh
0
Reputation points
commented 2025-08-11T18:44:47.4366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
28,225
Reputation points Microsoft External Staff
Moderator
0 answers
Unable to start job runs and start cluster in Azure Databricks
Every time I start a workflow/job, I get the error message: "Triggering new runs for organization [org_number] is currently disabled temporarily." Every time I start any cluster, I get the error message: "Could not start cluster…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-07-30T22:19:04.2066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 63%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKB%3C/text%3E%3C/svg%3E)
Kian Baula
0
Reputation points
commented 2025-08-11T15:25:21.21+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 16%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKK%3C/text%3E%3C/svg%3E)
Kalyani Kondavaradala
405
Reputation points Microsoft External Staff
Moderator
0 answers
BAD_REQUEST: Azure Managed Identity Credential with Access Connector Id /subscriptions
Not able to create workspace - sbit-ws. Error - BAD_REQUEST: Azure Managed Identity Credential with Access Connector Id…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-11T13:13:16.1733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 9%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETM%3C/text%3E%3C/svg%3E)
Thayal Muhunthan
0
Reputation points
commented 2025-08-11T14:54:30.8066667+00:00
Smaran Thoomu
28,225
Reputation points Microsoft External Staff
Moderator
1 answer
Azure Devops pipeline and dataset parametrization issue
I have added parametrization for ADF pipelines but yet I don't see the parameters reflected in the override parameters list. Tried reconnecting the adf connection to git and also overwriting the live mode from source branch and published the adf…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(259.20000000000005, 75%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
1 answer
Can't access Azure Databricks account console as Account Admin
I am encountering an issue with Azure Databricks account management. --I am the owner of the Azure subscription that hosts my Databricks resources. --I am also a Global Administrator in Microsoft Entra ID for this tenant. Problem: Despite having these…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-09T03:39:46.59+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 9%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEZ%3C/text%3E%3C/svg%3E)
Ethan Zawadzke
0
Reputation points
commented 2025-08-11T12:59:46.2666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 50%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
1 answer
databricks not working with Geoparquet for write data
Py4JJavaError: An error occurred while calling o535.save. : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 17.0 failed 4 times, most recent failure: Lost task 0.3 in stage 17.0 (TID 45) (10.137.237.68 executor 0):…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-07T10:50:36.78+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 52%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Anil Kasar
5
Reputation points
commented 2025-08-11T12:26:02.7266667+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
0 answers
Datababricks managed network - can I access firewalled storage account in classic compute?
I have a default Databricks setup with managed network and public IP. I want it to talk to a storage account, that is firewalled. I can do this for serverless but not for a classic compute. I've added a vnet in between and peered bricks to this…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-08T04:20:03.5566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 43%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDN%3C/text%3E%3C/svg%3E)
Dimitry Nechaev
20
Reputation points
commented 2025-08-11T10:26:58.34+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
1 answer
Unable to access Azure Databricks workspace from external applications like Power Apps
I am unable to access our Azure Databricks workspace from external applications like Microsoft Power Apps and Power Automate. Steps taken: Generated a Personal Access Token (PAT) from the Databricks workspace. Attempted REST API call using the token…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-07T13:44:00.75+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 47%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Aqil, Abdul
0
Reputation points
commented 2025-08-08T13:41:53.0766667+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
0 answers
Request to Enable Lakehouse Apps (Preview)
We would like to request access to the Lakehouse Apps (Preview) feature in our Databricks workspace to enable internal development of low-code/no-code LLM applications. Workspace Details: Workspace URL: https://<your-workspace>.databricks.com/ …
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-06T11:18:56.9533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 2%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDA%3C/text%3E%3C/svg%3E)
Data AI Analytics
0
Reputation points
commented 2025-08-08T11:19:00.18+00:00
Smaran Thoomu
28,225
Reputation points Microsoft External Staff
Moderator
1 answer
Azure Quota Exceeded Exception Error even though I am using minimum.
Azure Quota Exceeded Exception: The VM size you are specifying is not available. [details] QuotaExceeded: Operation could not be completed as it results in exceeding approved Total Regional Cores quota. Additional details - Deployment Model: Resource…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-03T16:20:31.9466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 60%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHK%3C/text%3E%3C/svg%3E)
HIMANSHU KUMAR
0
Reputation points
commented 2025-08-07T17:50:02.0233333+00:00
Smaran Thoomu
28,225
Reputation points Microsoft External Staff
Moderator
3 answers
Can't access the Azure Databricks Accounts Console
Hi there, When I tried to log on to https://accounts.azuredatabricks.net/login, I encountered an error. It says: Selected user account does not exist in tenant 'Microsoft Services' and cannot access the application…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2024-07-30T12:22:12.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 39%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZZ%3C/text%3E%3C/svg%3E)
Ziwei Zeng
15
Reputation points
commented 2025-08-07T17:27:55.9033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 85%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
SomeGuy
0
Reputation points
1 answer
Applying Merged CDC Delta Data from ADLS to Azure SQL Hyperscale at Scale
As part of our enterprise-scale data migration project, we are migrating data from IBM DB2 (on-prem) to Azure SQL Hyperscale. The migration consists of three phases: One-time Historical Load CDC Catch-Up Phase (Batch) CDC Streaming Phase…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-04T10:42:29.11+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 56.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJC%3C/text%3E%3C/svg%3E)
Janice Chi
580
Reputation points
edited a comment 2025-08-07T14:53:47.6+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
3 answers
One of the answers was accepted by the question author.
Upload .txt and .sh files to databricks Workspace folder.
I am trying to upload .txt and .sh files in the databricks workspace folder so that while starting a cluster the init script can be referred from the workspace folder, manually I am able to create the files but from azure devops pipeline its not…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-03-27T06:53:40.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 50%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Shriram Sethi
25
Reputation points
commented 2025-08-07T05:28:53.5566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 49%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESL%3C/text%3E%3C/svg%3E)
Sunny Liu
0
Reputation points
2 answers
One of the answers was accepted by the question author.
azure databricks Claude/Sonnet endpoints missing
Not sure why, but when using Serving endpoint databricks-claude-3-7-sonnet I begun getting error - databricksException - {\"error_code\":\"PERMISSION_DENIED\",\"message\":\"PERMISSION_DENIED: Endpoint…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-07-11T21:19:09.4633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 37%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETT%3C/text%3E%3C/svg%3E)
Thomas Thornton
20
Reputation points MVP
accepted 2025-08-06T15:35:40.94+00:00
Thomas Thornton
20
Reputation points MVP
1 answer
Need Lakeflow Connect enabled on the Azure Databricks instance azuredatabricks2025
Need Lakeflow Connect Public Preview feature to be enabled on the Azure Databricks instance azuredatabricks2025
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-07-31T22:20:55.9666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 98%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAN%3C/text%3E%3C/svg%3E)
Anupama Natarajan
0
Reputation points
commented 2025-08-06T10:53:57.83+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
0 answers
Request for proposal based on the attached DWH scenario
Dear Sir or Madam, As pa Kind regards, Chaima Meddah
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-04T11:56:04.64+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 10%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMC%3C/text%3E%3C/svg%3E)
Meddah, Chaima
0
Reputation points
commented 2025-08-06T14:12:46.4366667+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
1 answer
Databricks Repos or Alternatives?
We’re working on a large-scale data migration project from IBM DB2 to Azure SQL Hyperscale using ADF, Kafka, and Databricks. Our ingestion and transformation logic (including CDC handling, recon, and retry orchestration) is implemented in Databricks…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-05T10:45:37.41+00:00
Janice Chi
580
Reputation points
commented 2025-08-06T10:57:37.3133333+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator
1 answer
MERGE INTO
Is MERGE INTO between ADLS Delta layer and Azure SQL Hyperscale (relational) tables possible and effective?
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-05T13:03:00.1833333+00:00
Janice Chi
580
Reputation points
answered 2025-08-06T20:26:03.17+00:00
Smaran Thoomu
28,225
Reputation points Microsoft External Staff
Moderator
1 answer
DATABRICKS ASSET BUNDALS VS TERRAFORM
We are moving towards a multi-environment deployment model for our Databricks notebooks and jobs (Dev, QA, PreProd, Prod). Currently, infrastructure is provisioned via Terraform, and the DE team manually deploys notebooks or uses CLI scripts. We are…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-06T07:13:50.8033333+00:00
Janice Chi
580
Reputation points
commented 2025-08-06T20:49:31.6433333+00:00
Smaran Thoomu
28,225
Reputation points Microsoft External Staff
Moderator
1 answer
Recommended Staging Layer Location in Streaming (ADLS Branch vs. Hyperscale Staging)
In our current project, we are migrating ~80 TB of data from on-prem DB2 to Azure SQL Hyperscale. We are using Kafka + Databricks Structured Streaming to ingest CDC data into Azure. Our ingestion strategy is split into three phases: One-Time Historical…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,614 questions
asked 2025-08-06T08:03:43.8466667+00:00
Janice Chi
580
Reputation points
commented 2025-08-07T08:49:23.82+00:00
Venkat Reddy Navari
5,330
Reputation points Microsoft External Staff
Moderator