Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,712 questions
1 answer
One of the answers was accepted by the question author.
Missing "smallrc" DB role from Synapse Analytics dedicated SQL pools
Hi All, I am a data engineer. Since yesterday we have observed that the "smallrc" DB role is missing from all synapse dedicated sql pools in all our environments (dev/stage/prod). All our synapse instances are provisioned in the AU East Azure…
asked 2024-07-22T06:50:25.8133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(156.8, 98%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAN%3C/text%3E%3C/svg%3E)
Ashish Naik
20
Reputation points
commented 2024-08-01T09:57:15.0466667+00:00
PRADEEPCHEEKATLA-MSFT
86,131
Reputation points Microsoft Employee
1 answer
General definition of Azure Synapse Link
Hi, I'm searching a good and clear definition of Azure Synapse Link not related to Azure Cosmos DB or Dataverse or other data stores. Any helps to me, please? Thanks
asked 2024-07-31T09:05:46.7066667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 41%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
pmscorca
882
Reputation points
answered 2024-08-01T08:50:22.1733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,695
Reputation points Microsoft Vendor
0 answers
Facing issues to connect with synapse workspace/azure sql db via oauth
I want to connect to and access my Synapse Workspace and SQL Pool using OAuth. For this purpose, I have created an app in Azure and assigned the following API permissions: Microsoft Graph: Directory.Read.All (Delegated) Directory.ReadWrite.All…
asked 2024-08-01T05:01:12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 61%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
Subham Kumar
0
Reputation points
edited the question 2024-08-01T07:58:41.56+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 86%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
AmaranS
4,425
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Why is FailureWebHook not executed in this case?
Please consider the following pipeline. The Execute Pipeline activity failed, so the ProcessTMONData notebook was skipped. Why was the failure webhook not triggered, as it's supposed to trigger when EITHER: ForEachEndpoint fails ProcessTMONData is…
asked 2024-07-23T12:10:36.8466667+00:00
Psychotechnopath
31
Reputation points
accepted 2024-08-01T07:21:08.96+00:00
Psychotechnopath
31
Reputation points
1 answer
Azure Apache Spark pool stuck in ResourceInUnupdatableState
At 16.09 GMT+3, first tried to delete the pool and Azure failed. The pool then went into a state “ResourceInUnupdatableState” All attempts since 17.03 GMT+3 have failed because the pool is stuck in this “ResourceInUnupdatableState” state How can I now…
asked 2024-07-30T18:50:26.5233333+00:00
Yaroslav Kazakov
5
Reputation points
answered 2024-08-01T06:03:21.44+00:00
PRADEEPCHEEKATLA-MSFT
86,131
Reputation points Microsoft Employee
0 answers
Azure Synapse CI/CD Pipeline - Override Apache Spark Pool Name in Notebooks
I'm working on setting up a CI/CD pipeline for an Azure Synapse workspace, and I need to create custom parameters in the deployment process to handle environment-specific values. Specifically, I need to override the Apache Spark pool name used in the…
asked 2024-07-30T12:12:14.7433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 65%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETK%3C/text%3E%3C/svg%3E)
Tsu Kernik
0
Reputation points
commented 2024-08-01T05:45:47.3666667+00:00
Smaran Thoomu
12,695
Reputation points Microsoft Vendor
1 answer
MS SQL Server SELECT not showing all fields in tables, how to fix?
We use an Azure Synapse SQL server, which contains a copy of our data from a Postgresql server, and I'm trying to list all the table names and fields in each table and display them in a viz in Power BI. Since I'm doing work in PBI this makes it…
asked 2024-07-31T09:56:03.7+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 77%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECR%3C/text%3E%3C/svg%3E)
Chuck Roberts
65
Reputation points
commented 2024-08-01T03:00:20.9+00:00
LiHongMSFT-4306
25,801
Reputation points
1 answer
DataSourceError from PowerBI when trying to access Synapse Serverless View on ADLS2
We have an issue with a particular user connecting to our Serverless SQL pool via PowerBI. I created an Azure Synapse workspace, which contains the built in serverless SQL pool which has some Views set up to pull data from some Delta tables. As the…
asked 2024-07-31T07:58:19.4166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(176, 15%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHC%3C/text%3E%3C/svg%3E)
Hobday, Colin
20
Reputation points
commented 2024-08-01T00:20:06.1166667+00:00
Hobday, Colin
20
Reputation points
2 answers
One of the answers was accepted by the question author.
synapse pyspark write dataframe to sql azure
I want to use Pyspark datawrite.write method to write dataframe to sql azure database with linked service. How can I achieve it?
asked 2024-07-26T23:35:52.9533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(249.60000000000002, 49%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESZ%3C/text%3E%3C/svg%3E)
Simon Zhang
26
Reputation points Microsoft Employee
accepted 2024-07-31T16:15:59.19+00:00
Simon Zhang
26
Reputation points Microsoft Employee
1 answer
Changing source of existing semantic model to lakehouse delta tables
Hi, We newly created a lakehouse in the existing power bi workspace, and I want to change the source of the semantic model to the lakehouse. But it is throwing the following error. "Semantic model connectivity with the XMLA endpoint" 'XMLA…
asked 2024-07-25T20:34:36.7666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(57.599999999999994, 44%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESP%3C/text%3E%3C/svg%3E)
Sunay Pistulkar
5
Reputation points
edited the question 2024-07-31T15:38:57.8633333+00:00
Smaran Thoomu
12,695
Reputation points Microsoft Vendor
2 answers
synapse analytics deployment error
I'm using my student account which gives $100 creidt. {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…
asked 2024-07-25T21:30:54.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 9%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESH%3C/text%3E%3C/svg%3E)
Sahu, Hardeep - (hardeepsahu)
20
Reputation points
commented 2024-07-31T15:36:08.3433333+00:00
Smaran Thoomu
12,695
Reputation points Microsoft Vendor
0 answers
How to copy D365 data into Azure SQL db
Hello, This is going to be long winded so please bear with me. For the past year I've been extracting data out of D365 using the basic set up of a Synapse Link with incremental folder updates in Power Apps for the dumping of data in a storage account and…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 16%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 76%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
0 answers
Reading single large parquet file fails
Cluster details spark 3.4 5 executors (Large Pool) nodes with x16 cores and 112GB RAM Parquet file details provided via 3rd party source file in adls single 20GB .parquet file 68 million rows 1,599 columns 5034 row groups I'm trying to write…
asked 2024-07-29T21:19:10.9033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 75%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBR%3C/text%3E%3C/svg%3E)
Brian Ross
0
Reputation points
commented 2024-07-31T12:26:36.7666667+00:00
Brian Ross
0
Reputation points
0 answers
TEMPDB ran out of space during spilling out in Azure Synapse SQL pool
Hi All, we are facing the Issue with TEMPDB full in Synapse SQL Pool. Due to this, our Daily jobs getting failed.# Does anyone come across this issue? Kindly help to clear off TEMPDB space in synapse SQL pool. Thanks in Advance
asked 2024-07-31T12:06:28.34+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 41%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKY%3C/text%3E%3C/svg%3E)
Kalidas Yerravarapu
0
Reputation points
asked 2024-07-31T12:06:28.34+00:00
Kalidas Yerravarapu
0
Reputation points
1 answer
Azure Synapse Analytics: How to quickly move/replicate work (Integration Datasets, Pipelines, etc.) from one Dev workspace to another Dev workspace (when connected to DevOps)
I have a workspace in Azure Synapse Analytics that is connected to a DevOps repo. I've created a "template" of work that basically is just some pipelines, dataflows, and integration datasets. I would like to move all of this work to another Dev…
asked 2024-07-29T21:38:19.7833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 94%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Joshua
20
Reputation points
commented 2024-07-31T11:10:42.8233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
795
Reputation points Microsoft Vendor
0 answers
Transfer / pass a parameter outside databricks workflow
Hello, in a synapse pipeline, through a web activity i call / execute a databricks workflow job. The job has couple of notebooks that execute depending on some logic inside the job itself. When the notebooks finish, i want to output some…
asked 2024-07-31T11:09:22.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 22%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBP%3C/text%3E%3C/svg%3E)
Boris Perchinkov
0
Reputation points
asked 2024-07-31T11:09:22.9333333+00:00
Boris Perchinkov
0
Reputation points
0 answers
rename of pipeline failed part-way, now I have both source and destination pipeline and cant remove them
Hi we have a pipeline A that was being renamed to pipeline B, and the rename has failed. now we have pipeline A with an EntityState of "Deleting", and Pipeline B with an EntityState of "Creating". they are linked by Source and Target…
asked 2024-05-08T15:53:18.18+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 65%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERV%3C/text%3E%3C/svg%3E)
Robert Vaughan
0
Reputation points
edited a comment 2024-07-31T10:48:17.79+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 2%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDP%3C/text%3E%3C/svg%3E)
Darren Price
0
Reputation points
1 answer
Will the Azure Synapse/Data Factory Salesforce (Legacy) connector still work after the deprecation date?
Hello, I'm hoping to get additional details about the deprecation of the Azure Synapse/Data Factory Salesforce (Legacy) connector. The article linked below does not specify whether it will become unusable or just not be supported. Will it continue to…
asked 2024-07-26T18:42:02.56+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 28.999999999999996%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Richard
0
Reputation points
commented 2024-07-31T09:54:14.4233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NIKHILANETHIKUNTA
160
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Azure Synapse Error : This query cannot be executed because we can't get enough capacity for optimal performance in time. This can be an intermittent issue. Please retry later.
Getting the "Cant get enough capacity" error on synapse pipeline runs since 7am this morning. Any idea of a fix timeline? UK South
asked 2024-07-30T08:35:04.0933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 72%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECW%3C/text%3E%3C/svg%3E)
Charlie Wilson
25
Reputation points
accepted 2024-07-31T08:38:13.48+00:00
Charlie Wilson
25
Reputation points
2 answers
Facing issues to connect with synapse workspace/azure sql db via oauth
I want to connect to and access my Synapse Workspace and SQL Pool using OAuth. For this purpose, I have created an app in Azure and assigned the following API permissions: Microsoft Graph: Directory.Read.All (Delegated) Directory.ReadWrite.All…
asked 2024-07-15T05:04:01.89+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 23%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESK%3C/text%3E%3C/svg%3E)
SUBHAM KUMAR
0
Reputation points
commented 2024-07-31T02:52:57.67+00:00
SUBHAM KUMAR
0
Reputation points