5,421 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

How to read a csv file from synapse link service to a storage data lake

I am trying to use pyspark via synapse to read a table/csv file that resides on a storage account. I have got the code below, but 2 things. Its failing due to access and i am not sure if the syntax is correct wither. I have got a synapse spark pool and…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-07T15:52:16.0633333+00:00
MrFlinstone 706 Reputation points
commented 2025-08-11T22:45:42.95+00:00
MrFlinstone 706 Reputation points
1 answer

Error when running debug on a pipeline in synapse

I have got a sink destination for a synapse analytics pipeline, works well with the storage account setup with synapse, however I am trying to change the sink destination to a different storage account, anytime I do that and run the pipeline in debug…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-07T11:00:22.8066667+00:00
MrFlinstone 706 Reputation points
commented 2025-08-11T11:52:01.1133333+00:00
Venkat Reddy Navari 5,255 Reputation points Microsoft External Staff Moderator
1 answer

Permission Denied Error (403) When Connecting to Azure OpenAI and Cosmos DB from Azure Synapse Analytics

Hi Team, When attempting to connect to Azure OpenAI and Azure Cosmos DB from an Azure Synapse Analytics notebook, a Permission Denied error (code 403) is encountered due to firewall rules or virtual network settings. Both Azure OpenAI and Cosmos DB…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-05T09:27:45.66+00:00
Sooriya E 10 Reputation points
commented 2025-08-11T03:39:31.74+00:00
Harish Peddapally 0 Reputation points Microsoft External Staff Moderator
1 answer

I passed a certification registered under Microsoft account. How can I download the certificate when this account was closed?

Hi, there I passed a certification registered under Microsoft account. I signed in with Microsoft account to book the exam and passed it. Now this account was closed and I can no longer to sign in with it, I don't have access to the certificate. How can…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-10T13:45:46.98+00:00
Peng Lyu 0 Reputation points
answered 2025-08-10T14:09:36.7933333+00:00
Andreas Baumgarten 125.2K Reputation points MVP Volunteer Moderator
1 answer One of the answers was accepted by the question author.

Azure Synapse API call 403 error when accessing Synapse Notebook with GET method

{ "error": { "code": "Unauthorized", "message": "The principal '71b82c6f-3c4b-4060-a695-61e366d4f5f8' does not have the required Synapse RBAC permission to perform this action. Required…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2024-03-07T17:01:28.5066667+00:00
Vivek Vijay Patil 40 Reputation points
accepted 2025-08-09T18:57:12.6666667+00:00
Vivek Vijay Patil 40 Reputation points
1 answer

Oracle Connector 2.0 in Synapse - Missing Support for Full Connection String Usage

The Oracle Connector 1.0 has worked reliably and effectively for our integration needs. One of its most valuable features was the ability to use a single connection string—including the InitializationString—through a Key Vault reference. More…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-07-22T14:54:55.6533333+00:00
Jeff S 5 Reputation points
commented 2025-08-08T12:45:35.08+00:00
Jeff S 5 Reputation points
1 answer One of the answers was accepted by the question author.

How to Define a Parquet-LIST as a SQL Field in a External Table

Hello, First in a Synapse Notebook I'm reading PowerBI Refreshes, this is written into a Parquet-file on a DataLake Gen 2 refreshes = requests.get(admin_refreshables_expand, headers=header) print(refreshes) try: refreshes =…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-06T19:58:10.4933333+00:00
Harry Leboeuf 26 Reputation points
accepted 2025-08-08T09:42:50.5366667+00:00
Harry Leboeuf 26 Reputation points
1 answer

Apache Spark poll ends with time out error

Hi, When runninn my pipeline which contains a Notebook activity, I faced this error. This error appears suddenly sometimes, and sometimes doesn't happend This pipeline executes iteratively almost 15 times, for the same Notebook which is parametrized. The…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-07T15:41:45.63+00:00
Jona 885 Reputation points
answered 2025-08-07T18:28:11.4766667+00:00
Smaran Thoomu 28,225 Reputation points Microsoft External Staff Moderator
1 answer

About trigger Synapse Pipeline on folder creation

Hi, I have a Spark App that writes data into ADLS2, producing the following files structure: Since I have many files written, I can't just create a Blob created trigger on a pipeline since there are many of them. I was thinking about a trigger on the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-07-29T17:04:31.8766667+00:00
Jona 885 Reputation points
commented 2025-08-07T13:05:30.6066667+00:00
Venkat Reddy Navari 5,255 Reputation points Microsoft External Staff Moderator
1 answer

How can I determine if my environment is PDW (APS) or Azure Synapse Dedicated SQL Pool?

I'm working on a script that needs to programmatically detect whether the connected environment is: PDW / Analytics Platform System (on-premise) or Azure Synapse Analytics Dedicated SQL Pool (cloud) I’ve already tried checking: …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-05T11:36:55.5666667+00:00
Saish Paradkar 20 Reputation points
commented 2025-08-07T12:41:48.69+00:00
Venkat Reddy Navari 5,255 Reputation points Microsoft External Staff Moderator
2 answers

Data not inserted on delta table

Hi, I'm creating a Synapse Notebook to create a simple delta table so that I can query it later. The problem is that the data seems not to be inserted ... %%sql CREATE TABLE myTable ( id INT, name STRING, lastName STRING ) USING DELTA; And…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-05T02:31:54.0433333+00:00
Jona 885 Reputation points
answered 2025-08-07T07:40:17.2133333+00:00
Kalyani Kondavaradala 405 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Picking dinamically Spark Poll to execute

Hi, I have this situation: A pipeline A notebook activity on it Three differents spark pools The pipeline is called many times with differents arguments, giving the notion of iterations When the pipelines start executing I could realized that if…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-02T04:44:22.56+00:00
Jona 885 Reputation points
accepted 2025-08-07T00:38:29.4866667+00:00
Jona 885 Reputation points
2 answers

Complex query performance optimization in Azure Synapse

I am working on a complex ETL process using Azure Synapse Analytics and I need some expert advice on optimizing the performance of a particularly challenging query. I have a large dataset stored in an Azure Synapse dedicated SQL pool. The dataset…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2024-05-17T08:11:46.83+00:00
MulluriNivas-6816 100 Reputation points
answered 2025-08-05T12:48:50.3466667+00:00
Vladyslav Kabachnyi 0 Reputation points
2 answers

Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.

Strangely since morning Synapse SQL Serverless on one environment is not able to query external data in a storage account. This was running fine till now [This query cannot be executed because we can't get enough capacity for optimal performance in time.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2024-06-28T13:39:30.8133333+00:00
amit karmakar 5 Reputation points
commented 2025-08-06T09:00:17.1333333+00:00
Ade Darby 5 Reputation points
1 answer

Is there an outage in UK South affecting Azure Synapse Analytics?

At around 10am (BST), our Azure Synapse Analytics pipelines started failing with the following error message: Operation on target Copy data failed: Failure happened on 'Source' side.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2024-07-10T10:15:00.4666667+00:00
James Neville 0 Reputation points
commented 2025-08-06T08:58:25.2366667+00:00
Ade Darby 5 Reputation points
1 answer

Unable to detach the Apache spark pool from synapse notebook

Hi, We are trying to delete an Apache Spark pool from one of our resource groups, but we’re encountering issues because it is attached to some Synapse notebooks. However, we are unable to detach it from within the workspace under the Notebooks section.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-07-29T06:23:14.56+00:00
Sooriya E 10 Reputation points
commented 2025-08-04T03:29:52.9466667+00:00
Pratyush Vashistha 975 Reputation points Microsoft External Staff Moderator
1 answer

Pass parameters from Synapse Pipeline to Notebook

Hi, I have this situation: A Synapse pipeline with parameters A Notebook activity inside it I don't see in the Notebook activity to pass paramerts to PySpark, and I don't know how to get them from code in the case the parameters could be be passed…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-07-30T03:03:06.74+00:00
Jona 885 Reputation points
commented 2025-08-05T14:58:52.9566667+00:00
Venkat Reddy Navari 5,255 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Strange error when running Synapse Notebook

Hi, When developing and runnin in debug mode a notebook, I have no error. This is the code: But when orchestrating the notebook inside a Notebook activity and running in a pipeline, This error appears: Can you give me a hand? regards

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-07-30T03:28:03.2166667+00:00
Jona 885 Reputation points
accepted 2025-08-01T14:46:02.18+00:00
Jona 885 Reputation points
1 answer

Synapse Workspace Provisioning Failure After Network Configuration Change

I was conducting end-to-end testing after deploying/spinning-up a Logic App in our dev environment. Our objective was to test the workflow's ability to trigger Synapse pipelines via web requests. Since our environment security policies typically prohibit…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-05T10:23:34.2+00:00
Mondli Ndlela 0 Reputation points
answered 2025-08-06T06:06:55.15+00:00
Pratyush Vashistha 975 Reputation points Microsoft External Staff Moderator
1 answer

Serverless synapse querying COSMOS analytics store

I have a Serverless SQL Pool of Synapse and it is connected to COSMOS DB's Analytical store, Some of the items come through as non json objects , when i copy from the COSMOS DB and paste it in the Notepad++ the data seems to be of JSON format but the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,421 questions
asked 2025-08-05T11:11:46.1866667+00:00
Subhash Marti 0 Reputation points
commented 2025-08-06T16:56:37.1433333+00:00
Venkat Reddy Navari 5,255 Reputation points Microsoft External Staff Moderator