Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,841 questions
1 answer
getting CLUSTER_CREATION_TIMED_OUT issue
Hi, my jobs are failing without spark session is starting and getting timed out issue. all my pools are XXL configuration but inside pipeline calling Small or medium.
asked 2024-09-06T22:45:27+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 99%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVP%3C/text%3E%3C/svg%3E)
Venkateswarlu Pottapalli
0
Reputation points
accepted 2024-09-07T23:22:52.3933333+00:00
Venkateswarlu Pottapalli
0
Reputation points
1 answer
Columns disappear when I extract data from dataverse using synapse
I am trying to extract data from dataverse source, but when I execute the pipeline, the output file does not contain some columns, I thought it was my fetchXML query but when I executed it using external tools the columns are shown, so : It is not the…
asked 2024-09-06T16:55:18.29+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 12%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAD%3C/text%3E%3C/svg%3E)
Arquitectura Datos
0
Reputation points
answered 2024-09-07T15:41:06.88+00:00
Amira Bedhiafi
22,616
Reputation points
1 answer
Dynamically Select Columns to Partition by in a Window Activity for an Azure Synapse Data Flow
I have an Azure Synapse Analytics Data Flow and am using a Window activity to add a column to show the number of rows with duplicated values for a certain column. I have no problem with any of my other dataflow expression builder expressions, but in the…
asked 2024-09-04T20:43:15.92+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 94%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Joshua
20
Reputation points
answered 2024-09-07T07:19:56.0233333+00:00
AnnuKumari-MSFT
32,661
Reputation points Microsoft Employee
1 answer
The AuthHeaders won't stay in REST API linked service
In a linked service used to connect to Airtable, I can input the Auth Headers, publish the change, and execute properly a pipeline on the fly. At that moment, I can also see in the underlying JSON the portion relating to the…
asked 2024-09-05T21:15:11.35+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 51%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVL%3C/text%3E%3C/svg%3E)
Vincent Labrecque
0
Reputation points
answered 2024-09-06T20:48:59.6366667+00:00
Vincent Labrecque
0
Reputation points
1 answer
Azure Synapse Delta Table with Varchar(max)
Hi all, I did save a Dataframe as Delta-format with pyspark and created a managed table in a Lake Database, to access it aswell with SQL Script and the Serverless-Endpoint raw_stream\ .writeStream\ .format("delta")\ …
asked 2024-09-04T17:02:08.1366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 42%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Axel
0
Reputation points
commented 2024-09-06T19:13:48.9666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
14,300
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
Medallion in Synapse or Fabric?
I'm evaluating the Medallion architecture for a data lakehouse setup, and I am trying to decide whether Azure Synapse Analytics or Microsoft Fabric is better suited for implementing this architecture. I would appreciate insights into which platform…
0 answers
How accessing to a serverless SQL pool with a Microsoft Entra user without the related login
Hi, I need to access to a serverless SQL pool with my Microsoft Entra user (with MFA). My user is a Synapse Administrator for the related Synapse workspace. In the pool I haven't any login built with my Microsoft Entra user. Using SSMS I cannot access to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 41%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
0 answers
Deploying Dacpac to Synapse serverless pool
Hi, I'm trying to deploy the dacpac created from Synapse Serverless pool DB. I'm having an external data source that is used to get the data from the Blob Storage. I've downloaded the SQLPackage to allow the extraction and publication of the dacpac.…
asked 2024-09-04T08:44:45.0466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 91%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJM%3C/text%3E%3C/svg%3E)
Jabu Msiza
0
Reputation points
commented 2024-09-06T17:13:53.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
10,010
Reputation points Microsoft Vendor
2 answers
Error when using the CosmosDB Analytical Store for source queries in a Synapse ADF Dataflow
How can I resolve the error message I receive when using the CosmosDB Analytical Store as source queries in a Synapse ADF Dataflow? I created the source with Analytical Store selected as explained in this how-to link:…
asked 2024-09-06T10:59:31.9366667+00:00
Jude Moore
0
Reputation points
answered 2024-09-06T16:11:00.35+00:00
Amira Bedhiafi
22,616
Reputation points
1 answer
Dynamic Mapping of Source to JSON Sink in Azure Data Factory
We are able to preview the source data from the Salesforce linked service in ADF, and I can also view the sink data using the REST linked service for Business Central in ADF. However, I'm facing an issue where importing the schema is not supported…
asked 2024-09-06T12:01:43.23+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 4%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAB%3C/text%3E%3C/svg%3E)
Apoorva Belsare
0
Reputation points
answered 2024-09-06T15:53:19.94+00:00
Amira Bedhiafi
22,616
Reputation points
2 answers
Auzure Synapse - REST Linked Service doesn't save Auth headers parameters after publish
Hello, I have a Synapse workspace and last Monday I have discovered this bug: 1.Synapse is in Synapse Live mode 2.Open Manage - Linked Services - New - select REST 3.Fill all required fields and select Authorization type "Anonymous" as shown…
asked 2024-09-04T07:30:25.59+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 39%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIK%3C/text%3E%3C/svg%3E)
Ilya Kutsenko
15
Reputation points
edited an answer 2024-09-06T15:18:14.4433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 77%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECM%3C/text%3E%3C/svg%3E)
Chris Meesters
5
Reputation points
1 answer
How detecting the failed login attempts to a Synapse Analytics serverless SQL pool
Hi, I need to know how detecting and analyzing the failed login attempts to a Synapse serverless SQL pool. Does it exist a step-by-step procedure to follow in order to accomplish a such task, please? Thanks
1 answer
Creating a Dedicated SQL Pool, no option to use a sample data source
Step 5 of the documentation that I linked below tells the user to select "Sample", for Use Existing Data. I am following this documentation and I do NOT have an option to select "Sample". My only options are "None", and…
asked 2024-09-04T17:59:11.6166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 2%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDS%3C/text%3E%3C/svg%3E)
David Stump
0
Reputation points
commented 2024-09-06T14:17:22.26+00:00
Smaran Thoomu
14,300
Reputation points Microsoft Vendor
1 answer
Medallion Architecture
Hi Our company is trying to migrate to Synapse. Could you explain how the Medallion architecture can be implemented in Azure Synapse Analytics? Specifically, I'm interested in understanding the best practices for organizing data layers, leveraging…
asked 2024-09-03T14:24:52.8733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 53%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
DataCoder
140
Reputation points
commented 2024-09-06T14:11:37.6666667+00:00
Smaran Thoomu
14,300
Reputation points Microsoft Vendor
2 answers
In Azure synapse analytics i have created a database in serverless pool, but the database is not visible under the Workspace option
Even after refreshing the Synapse the database is not visible in the workspace
asked 2024-09-05T10:48:28.3633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 1%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Mahantha MV
15
Reputation points
answered 2024-09-06T10:37:23.2433333+00:00
Smaran Thoomu
14,300
Reputation points Microsoft Vendor
0 answers
Best practise to copy updating parquet files into sql database
I have to copy over 300 million rows from parquet files to Azure SQL Database. (The Parquet files come from Synapselink for dataverse.) I have tried using copy activity but because the parquet files update constantly, it feels funky. I have also tried…
asked 2024-09-05T08:52:05.1166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 7.000000000000001%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJH%3C/text%3E%3C/svg%3E)
Jani Hämäläinen
60
Reputation points
commented 2024-09-06T06:19:18.79+00:00
AnnuKumari-MSFT
32,661
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
I can't delete a Synapse Spark Pool
When I try to delete a Synapse Spark Pool, I get this error: $ az synapse spark pool delete --workspace-name myws --resource-group myrg -n poolname Are you sure you want to perform this operation? (y/n): y (DeleteSparkComputeAdfError) The document cannot…
asked 2024-09-04T21:11:41.5433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(236.8, 37%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EML%3C/text%3E%3C/svg%3E)
Mathieu Longtin
96
Reputation points Microsoft Employee
commented 2024-09-06T04:08:54.0166667+00:00
PRADEEPCHEEKATLA-MSFT
88,471
Reputation points Microsoft Employee
1 answer
Unable to open Synapse Studio after creating the workspace using AZ CLI
I created a synapse workspace using the Azure CLI. I am able to open the workspace settings. When I click on Synapse Studio, the studio only flashes the loading message. I have tried opening studio by using the link from the workspace. I also tried just…
asked 2024-08-28T20:30:55.2066667+00:00
Oscar Garcia @ozkary
1
Reputation point
commented 2024-09-05T19:55:48.3866667+00:00
Erland Sommarskog
109.8K
Reputation points MVP
0 answers
Apache Spark 3.3 will retire but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3
Received email from MS mentioned that Apache Spark 3.3 will retire soon but Azure Synapse Link use spark pool for delta conversion only support Apache Spark 3.3 Any advises on this ?
asked 2024-08-13T00:46:23.4633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 0%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECZ%3C/text%3E%3C/svg%3E)
Chan Zhen Seng - EYSI
0
Reputation points
commented 2024-09-05T19:30:05.9333333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT
30,576
Reputation points Microsoft Employee
1 answer
Missing and duplicate columns when fetching data from DynamicsCRM i azure synapse copy activity
Hi. When fetching data from Dynamics CRM and copying it to a DW, one of the columns appears in the preview data in the source of the copy activity, but it is not created in the DW ("LeadId"). Moreover, it doe not appear when importing schema…
asked 2024-09-02T15:15:44.0533333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 94%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECL%3C/text%3E%3C/svg%3E)
Catarina Leiria
0
Reputation points
commented 2024-09-05T18:20:59.2733333+00:00
Smaran Thoomu
14,300
Reputation points Microsoft Vendor