How to read a csv file from synapse link service to a storage data lake
I am trying to use pyspark via synapse to read a table/csv file that resides on a storage account. I have got the code below, but 2 things. Its failing due to access and i am not sure if the syntax is correct wither. I have got a synapse spark pool and…
Azure Synapse Analytics
Error when running debug on a pipeline in synapse
I have got a sink destination for a synapse analytics pipeline, works well with the storage account setup with synapse, however I am trying to change the sink destination to a different storage account, anytime I do that and run the pipeline in debug…
Azure Synapse Analytics
Permission Denied Error (403) When Connecting to Azure OpenAI and Cosmos DB from Azure Synapse Analytics
Hi Team, When attempting to connect to Azure OpenAI and Azure Cosmos DB from an Azure Synapse Analytics notebook, a Permission Denied error (code 403) is encountered due to firewall rules or virtual network settings. Both Azure OpenAI and Cosmos DB…
Azure Synapse Analytics
I passed a certification registered under Microsoft account. How can I download the certificate when this account was closed?
Hi, there I passed a certification registered under Microsoft account. I signed in with Microsoft account to book the exam and passed it. Now this account was closed and I can no longer to sign in with it, I don't have access to the certificate. How can…
Azure Synapse Analytics

Azure Synapse API call 403 error when accessing Synapse Notebook with GET method
{ "error": { "code": "Unauthorized", "message": "The principal '71b82c6f-3c4b-4060-a695-61e366d4f5f8' does not have the required Synapse RBAC permission to perform this action. Required…
Azure Synapse Analytics
Oracle Connector 2.0 in Synapse - Missing Support for Full Connection String Usage
The Oracle Connector 1.0 has worked reliably and effectively for our integration needs. One of its most valuable features was the ability to use a single connection string—including the InitializationString—through a Key Vault reference. More…
Azure Synapse Analytics
How to Define a Parquet-LIST as a SQL Field in a External Table
Hello, First in a Synapse Notebook I'm reading PowerBI Refreshes, this is written into a Parquet-file on a DataLake Gen 2 refreshes = requests.get(admin_refreshables_expand, headers=header) print(refreshes) try: refreshes =…
Azure Synapse Analytics
Apache Spark poll ends with time out error
Hi, When runninn my pipeline which contains a Notebook activity, I faced this error. This error appears suddenly sometimes, and sometimes doesn't happend This pipeline executes iteratively almost 15 times, for the same Notebook which is parametrized. The…
Azure Synapse Analytics

About trigger Synapse Pipeline on folder creation
Hi, I have a Spark App that writes data into ADLS2, producing the following files structure: Since I have many files written, I can't just create a Blob created trigger on a pipeline since there are many of them. I was thinking about a trigger on the…
Azure Synapse Analytics

How can I determine if my environment is PDW (APS) or Azure Synapse Dedicated SQL Pool?
I'm working on a script that needs to programmatically detect whether the connected environment is: PDW / Analytics Platform System (on-premise) or Azure Synapse Analytics Dedicated SQL Pool (cloud) I’ve already tried checking: …
Azure Synapse Analytics
Data not inserted on delta table
Hi, I'm creating a Synapse Notebook to create a simple delta table so that I can query it later. The problem is that the data seems not to be inserted ... %%sql CREATE TABLE myTable ( id INT, name STRING, lastName STRING ) USING DELTA; And…
Azure Synapse Analytics

Picking dinamically Spark Poll to execute
Hi, I have this situation: A pipeline A notebook activity on it Three differents spark pools The pipeline is called many times with differents arguments, giving the notion of iterations When the pipelines start executing I could realized that if…
Azure Synapse Analytics
Complex query performance optimization in Azure Synapse
I am working on a complex ETL process using Azure Synapse Analytics and I need some expert advice on optimizing the performance of a particularly challenging query. I have a large dataset stored in an Azure Synapse dedicated SQL pool. The dataset…
Azure Synapse Analytics
Azure Synapse Error :This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.
Strangely since morning Synapse SQL Serverless on one environment is not able to query external data in a storage account. This was running fine till now [This query cannot be executed because we can't get enough capacity for optimal performance in time.…
Azure Synapse Analytics

Is there an outage in UK South affecting Azure Synapse Analytics?
At around 10am (BST), our Azure Synapse Analytics pipelines started failing with the following error message: Operation on target Copy data failed: Failure happened on 'Source' side.…
Azure Synapse Analytics
Unable to detach the Apache spark pool from synapse notebook
Hi, We are trying to delete an Apache Spark pool from one of our resource groups, but we’re encountering issues because it is attached to some Synapse notebooks. However, we are unable to detach it from within the workspace under the Notebooks section.…
Azure Synapse Analytics
Pass parameters from Synapse Pipeline to Notebook
Hi, I have this situation: A Synapse pipeline with parameters A Notebook activity inside it I don't see in the Notebook activity to pass paramerts to PySpark, and I don't know how to get them from code in the case the parameters could be be passed…
Azure Synapse Analytics

Strange error when running Synapse Notebook
Hi, When developing and runnin in debug mode a notebook, I have no error. This is the code: But when orchestrating the notebook inside a Notebook activity and running in a pipeline, This error appears: Can you give me a hand? regards
Azure Synapse Analytics
Synapse Workspace Provisioning Failure After Network Configuration Change
I was conducting end-to-end testing after deploying/spinning-up a Logic App in our dev environment. Our objective was to test the workflow's ability to trigger Synapse pipelines via web requests. Since our environment security policies typically prohibit…
Azure Synapse Analytics
Serverless synapse querying COSMOS analytics store
I have a Serverless SQL Pool of Synapse and it is connected to COSMOS DB's Analytical store, Some of the items come through as non json objects , when i copy from the COSMOS DB and paste it in the Notepad++ the data seems to be of JSON format but the…