Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
1 answer
Databricks workspace preso em estado inconsistente — necessário force delete e remoção de system deny assignment
Databricks workspace preso em estado inconsistente — necessário force delete e remoção de system deny assignment Olá, equipe de suporte. Estou enfrentando um problema conhecido com um workspace do Azure Databricks que ficou preso em um estado…
Azure Databricks
asked 2026-03-03T03:25:50.9666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 52%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEA%3C/text%3E%3C/svg%3E)
Elias Acosta
0
Reputation points
edited the question 2026-03-06T14:33:08.9066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 2%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Manoj Kumar Boyini
8,875
Reputation points Microsoft External Staff
Moderator
1 answer
data bricks data ingestion techniques
Hi Expert, needs following information Overall Purpose The board shows a Data Cycle / Data Strategy POC used to: Identify the right datasets Secure access to data sources Ingest and prepare data Ensure governance and quality Deliver trusted data for…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-03-05T13:56:25.4866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 76%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDL%3C/text%3E%3C/svg%3E)
delta lake
0
Reputation points
answered 2026-03-05T19:27:20.7+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 24%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Pilladi Padma Sai Manisha
4,990
Reputation points Microsoft External Staff
Moderator
2 answers
Databricks job cluster error: Could not reach driver of cluster cluster-id.
We are experiencing an intermittent error in one of our jobs that always runs at the same time (11:00 PM). On some days, the job fails with the following error: DriverError: Could not reach driver of cluster <cluster-id> I have seen in other…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-25T16:44:55.28+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(112.00000000000001, 78%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGL%3C/text%3E%3C/svg%3E)
González Ternero, David
0
Reputation points
commented 2026-03-05T07:38:57.4366667+00:00
González Ternero, David
0
Reputation points
0 answers
Network Check Control Plane Failure:
[details] X_NHC_CONTROL_PLANE_UNREACHABLE: Instance failed network health check before bootstrapping with fatal error: X_NHC_CONTROL_PLANE_UNREACHABLE 2 failed component(s): control_plane internet Retryable: true Based on the failure results:…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 76%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
1 answer
Unable to delete the Resource Group.
Dear Support Team, I am an MCT holder currently using an MSDN Platforms Subscription. While working with Azure, I created a resource group and a Databricks service. However, I encountered an issue when attempting to delete the resource group. The…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-03-03T13:47:09.1533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 6%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
Venkatesh Raju N
0
Reputation points
edited the question 2026-03-05T04:48:31.9733333+00:00
Manoj Kumar Boyini
8,875
Reputation points Microsoft External Staff
Moderator
2 answers
Clarification on Collection and Sub Collections Hierarchy Limits along with Root in Microsoft Purview
Hi Team, We are currently designing our governance structure in Microsoft Purview and would like to clarify the platform limitations related to collections, sub collections and hierarchy levels to ensure our architecture aligns with best practices and…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-03-04T16:44:05.07+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(160, 84%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
SudhakarReddy Marepalli
0
Reputation points
commented 2026-03-04T19:17:02.6466667+00:00
SudhakarReddy Marepalli
0
Reputation points
2 answers
databricks workspace status: Deleting
When i try to delete the Databricks workspace in Azure. I got an error and the status is in Deleting state since 24Hrs.
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-03-02T23:41:15.9666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 94%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESH%3C/text%3E%3C/svg%3E)
Sree Harsha
0
Reputation points
commented 2026-03-03T22:42:02.9133333+00:00
Sree Harsha
0
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Databricks Ingestion Pipeline how to modify Ingestion Gateway classic compute SKU?
I’m using Azure Databricks and trying to create a basic SQL Server Data Ingestion pipeline following the wizard. The wizard automatically creates an Ingestion Gateway that uses classic compute with Standard_F4s SKUs. There are no configuration options…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-23T18:15:50.7366667+00:00
Chris Amaris
20
Reputation points
accepted 2026-03-03T16:03:11.2933333+00:00
Chris Amaris
20
Reputation points
1 answer
Unable to delete ghost dabatricks workspace
I have a Databricks workspace which I don't see in the Azure Portal anymore. I have tried to force delete it with the Remove-AzDatabricksWorkspace but it does not work. The documentation says I need to contact a Microsoft tech support so the can delete…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-03-02T13:38:36.3066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 32%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAA%3C/text%3E%3C/svg%3E)
Azure Administrator
0
Reputation points
commented 2026-03-02T15:42:00.8666667+00:00
Manoj Kumar Boyini
8,875
Reputation points Microsoft External Staff
Moderator
1 answer
Why Databricks Tables are searchable in Azure Purview but Not Schema
Hi Team, We are scanning Azure Databricks (Unity Catalog) into Microsoft Purview. All schemas are visible and open correctly except one specific schema. For that schema: It appears in the hierarchy under the metastore. The child tables are visible and…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-27T15:41:41.5366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 66%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPY%3C/text%3E%3C/svg%3E)
Priya Yadav
20
Reputation points
commented 2026-03-02T08:56:50.2166667+00:00
Priya Yadav
20
Reputation points
3 answers
End to End Lineage not visible between Azure Databricks and Power BI in MS Purview
Issue Description We are implementing Microsoft Purview for enterprise data governance for a client. The client’s data platform consists of: Azure Data Factory for orchestration Azure Databricks with Unity Catalog for data storage and transformations …
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-12T19:13:57.9666667+00:00
SudhakarReddy Marepalli
0
Reputation points
edited a comment 2026-03-02T07:56:44.3433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
33,840
Reputation points Microsoft External Staff
Moderator
1 answer
Cannot delete Azure Databricks
I am trying to delete a Databricks workspace, but the deletion has been ongoing for about a day. I tried deleting it several times using both the portal and the REST API, but failed. The provisioning state still says "Deleting," even though it…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 72%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHN%3C/text%3E%3C/svg%3E)
2 answers
Call file system utlity mount to mount the Azure storage in Databricks
Hi Team, I am trying to mount the Azure storage to DBFS using mount utility and getting below error. Do you have any idea to solve this issue? Py4JError: ('Method public com.databricks.backend.daemon.dbutils.DBUtilsCore$Result…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-24T13:15:41.43+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 22%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERN%3C/text%3E%3C/svg%3E)
riya nai
0
Reputation points
commented 2026-02-26T22:19:56.5733333+00:00
Manoj Kumar Boyini
8,875
Reputation points Microsoft External Staff
Moderator
1 answer
Clarification on Synchronization of Databricks Unity Catalog Column Tags with Microsoft Purview Column-Level Tags
We are currently scanning Azure Databricks (Unity Catalog enabled) into Microsoft Purview and observing column-level metadata ingestion. We would like clarification on the following: If we add or update column-level tags in Databricks Unity Catalog, how…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-20T17:50:30.7+00:00
SudhakarReddy Marepalli
0
Reputation points
commented 2026-02-26T19:28:44.6666667+00:00
SudhakarReddy Marepalli
0
Reputation points
1 answer
One of the answers was accepted by the question author.
Clarification on “Description” field in OpenLineage JSON metadata
Hi Team, We have enabled OpenLineage for our Azure Databricks environment to capture column-level lineage. In the transformation section of the OpenLineage output, we see the following structure: "transformations": [ We would like to…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-25T09:53:19.73+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(83.2, 60%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMA%3C/text%3E%3C/svg%3E)
Mohammed Aamer
160
Reputation points
accepted 2026-02-26T11:49:24.18+00:00
Mohammed Aamer
160
Reputation points
1 answer
One of the answers was accepted by the question author.
Query on Adding New Column for Custom Attributes in Unity Catalog
Hi Team, I have a quick query regarding Unity Catalog. In the Overview section of tables/views, we can currently see column-level details such as column, type, comments and tags. Is there any supported way to introduce an additional custom column or…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-25T12:42:25.8233333+00:00
Mohammed Aamer
160
Reputation points
accepted 2026-02-26T10:32:57.9633333+00:00
Mohammed Aamer
160
Reputation points
1 answer
Locked out of Azure Databricks Management Console due to IP allowlist misconfiguration (0.0.0.0/16)
Hello Microsoft Support Team, I am the account admin of my Azure Databricks account. By mistake, I added an IP access list entry 0.0.0.0/16 at the account level, which has blocked all IP addresses (including mine and other admins). We are now completely…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2025-10-07T12:22:09.32+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 3%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Sandeep Kumar Sharma
5
Reputation points
commented 2026-02-23T14:18:49.3233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 62%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECS%3C/text%3E%3C/svg%3E)
Chris Stephens
0
Reputation points
1 answer
One of the answers was accepted by the question author.
CDE Tagging Best Practice in Unity Catalog
Hi, We have implemented Unity Catalog using a medallion architecture (Bronze → Silver → Gold). In the Gold layer, certain business columns are being tagged as Critical Data Elements (CDEs). These Gold CDE columns are derived from multiple columns in…
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-18T17:48:33.5366667+00:00
Mohammed Aamer
160
Reputation points
accepted 2026-02-19T08:28:25.8266667+00:00
Mohammed Aamer
160
Reputation points
1 answer
Azure Databricks Account locked out due to IP Access List misconfiguration
I accidentally locked myself out of the Databricks account console by configuring an IP Access List at the account level with an incorrect IP address.
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-17T15:49:15.59+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 4%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEA%3C/text%3E%3C/svg%3E)
Enric A
0
Reputation points
commented 2026-02-17T19:56:36.2566667+00:00
Manoj Kumar Boyini
8,875
Reputation points Microsoft External Staff
Moderator
1 answer
One of the answers was accepted by the question author.
Unity Catalog Permissions for Metadata Management
Can you point the exact role or permission that needs to be granted in DB by IT and what level (create/manage/assign, etc)? These are for databricks unity catalog tables. I want to add comments and tags for columns.
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,846 questions
asked 2026-02-12T20:46:53.3866667+00:00
Mohammed Aamer
160
Reputation points
accepted 2026-02-16T10:21:40.9766667+00:00
Mohammed Aamer
160
Reputation points