Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,504 questions
0 answers
How to parse nested json array of document in ADF data flow
Hi all I am trying to fitch the values from a nested josh array of document , I have used aggregate to convert into objects but not able to fitch the values of all child nodes like as below itOffer.item itOffer.item.SplOfr itOffer.item.buy …
asked 2024-05-02T15:44:57.8633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 6%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
venkat rao
45
Reputation points
commented 2024-05-24T09:38:47.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
6,885
Reputation points Microsoft Vendor
1 answer
SQL Access Strategy
I would like a strategy for the use of Azure SQL with our cloud environment. The DB is in azure SQL. I would like to come up with a solution for giving access to developers and extended/other teams for dev/support needs. WE have to add users and give…
asked 2024-05-23T06:06:17.2233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 54%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Santhi Dhanuskodi
165
Reputation points
commented 2024-05-24T05:19:17.94+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 4%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESM%3C/text%3E%3C/svg%3E)
ShaktiSingh-MSFT
14,081
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Suggested naming convention for Azure Data Factory and Synapse Analytics objects
Hi, I'd like to know if it exists any suggested or official naming conventions about linked services, data sets, pipelines, mapping data flows of Azure Data Factory and Synapse Analytics. F.e., I could use the prefix "ls" for a linked service…
asked 2023-12-16T17:30:42.0766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 41%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
pmscorca
837
Reputation points
edited a comment 2024-05-23T22:21:29.9833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 91%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
Radhakrishnan, Sankar (Allianz UK)
0
Reputation points
1 answer
One of the answers was accepted by the question author.
Connectors or replicators available for IBM DB2- AS400 with Microsoft for Synapse
Is Microsoft offering Replicators to copy the data from IBM DB2 to SQL Server or Synapse
asked 2023-09-01T13:21:16.6466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 56.00000000000001%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHD%3C/text%3E%3C/svg%3E)
Hanuman Devineni
31
Reputation points
accepted 2024-05-23T20:52:32.1833333+00:00
Hanuman Devineni
31
Reputation points
2 answers
One of the answers was accepted by the question author.
Azure Synapse database: How to fix HY000 "login failed" error
I'm getting an error when using my Python program to connect to an Azure Synapse MS SQL server. My info: Using Python 3.11 on Windows 10 Pro. And using the pyodbc 5.1.0 module. Server: [blahserver.sql.azuresynapse.net]. This is an Azure Synapse MS SQL…
asked 2024-05-23T10:56:39.69+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 77%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECR%3C/text%3E%3C/svg%3E)
Chuck Roberts
65
Reputation points
edited the question 2024-05-23T19:18:16.3166667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
BhargavaGunnam-MSFT
27,976
Reputation points Microsoft Employee
1 answer
Complex query performance optimization in Azure Synapse
I am working on a complex ETL process using Azure Synapse Analytics and I need some expert advice on optimizing the performance of a particularly challenging query. I have a large dataset stored in an Azure Synapse dedicated SQL pool. The dataset…
asked 2024-05-17T08:11:46.83+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 56.00000000000001%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM6%3C/text%3E%3C/svg%3E)
MulluriNivas-6816
40
Reputation points
commented 2024-05-23T17:37:29.9833333+00:00
AnnuKumari-MSFT
31,731
Reputation points Microsoft Employee
1 answer
Where are the DataSets for the Prepare and transform data with Azure Synapse Analytics
Hello i am learning via the Microsoft Learning Modulle "Prepare and transform data with Azure Synapse Analytics" and try to reproduce the exercise. But i don't have acces to the datasets and the data sets are also not mentioned in the training…
asked 2024-05-20T11:48:08.3133333+00:00
Erik van der Hoeven
0
Reputation points
commented 2024-05-23T17:36:10.2466667+00:00
AnnuKumari-MSFT
31,731
Reputation points Microsoft Employee
1 answer
Azure Synapse Deployment Failure with "Exception has been thrown by the target of an invocation."
0 Failure to deploy azure synapse pipelines with below error: Set-AzSynapsePipeline : Exception has been thrown by the target of an invocation. 2024-05-08T08:29:52.7382260Z [31;1m[31;1m+ … $deploy = Set-AzSynapsePipeline -WorkspaceName $WorkspaceName…
asked 2024-05-22T05:37:02.1733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 55.00000000000001%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Sree
0
Reputation points
commented 2024-05-23T17:34:28.3+00:00
AnnuKumari-MSFT
31,731
Reputation points Microsoft Employee
2 answers
Can't able to connect the VM installed postgresql from ADF
Hi Team, We are unable to access the PostgreSQL from the ADF linked server. it's a azure PostgreSQL flexible server, and we have enabled the "Allow public services" setting within Azure for this server. However, we are still unable to create a…
asked 2024-05-14T06:10:02.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 79%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Aravind
20
Reputation points
commented 2024-05-23T16:51:12.9166667+00:00
ShaikMaheer-MSFT
38,291
Reputation points Microsoft Employee
1 answer
how to retrieve the path to workspace_publish branch OR any branch in devops , use that path in azure powershell script to read file from that branch.
I want to retrieve path to the branch and folder inside it, basically i wan to read the jsons here and change the dev keyword with uat and save the file back to the sam folder in workspace_publish branch. I can change dev to uat, but am not able to…
asked 2024-05-15T12:58:55.19+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(256, 24%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
Wasim
20
Reputation points
commented 2024-05-23T16:49:52.46+00:00
ShaikMaheer-MSFT
38,291
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Is it possible to run Azure Synapse Pipelines with user impersonation?
We would like to run analysis scripts (Azure synapse pipeline) on user defined data (Azure storage), but we don't want to bother to get access to every possible storage account on our end. For this it would be beneficial to just use user impersonation…
asked 2024-05-09T07:16:35.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 19%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Miklós Mezei
20
Reputation points
accepted 2024-05-23T16:47:34.0966667+00:00
Miklós Mezei
20
Reputation points
4 answers
Start up Synapse Spark Pool Once in ADF
Hello, I am using Azure Synapse Analytics and I have set up 1 single Spark Pool. I created 4 notebooks in Synapse and would like to schedule them to run in one single ADF pipeline. The problem is that it takes about 4-5 minutes to run each…
asked 2021-03-11T14:26:16.05+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(0, 57.99999999999999%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECH%3C/text%3E%3C/svg%3E)
Courtney Haedke
151
Reputation points
commented 2024-05-23T16:45:47.57+00:00
Ibrahim Mukaila
0
Reputation points
1 answer
Query about Terraform cmd for synapse database
Hi, I'm using Terraform scripts through Azure DevOps Pipelines to set up Azure resources. I don't need to create a "Lake Database / Serverless Database" in Synapse. I checked the Terraform documentation but couldn't find a command for this. Am…
asked 2024-05-22T15:31:49.22+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 86%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ET%3C/text%3E%3C/svg%3E)
Thomasville99
280
Reputation points
commented 2024-05-23T15:06:01.4333333+00:00
BhargavaGunnam-MSFT
27,976
Reputation points Microsoft Employee
2 answers
"Continuous DataFlow execution failed" error on Link connection, while following Synapse Link tutorial
While following this tutorial on creating a Synapse Link, I get an unclear error when trying to start the Link Connection. I can't find any information on google about this error code. Continuous DataFlow execution failed. Error…
asked 2024-05-21T01:47:59.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 41%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
Dario Ruben Scanferlato
0
Reputation points
commented 2024-05-23T09:48:06.94+00:00
PRADEEPCHEEKATLA-MSFT
80,491
Reputation points Microsoft Employee
1 answer
Synapse Python/Spark Notebook code with SQL to query data from linked service to SQL Server
In Synpase, I have linked service to a SQL Server database. I'm looking for a sample notebook code, either in python or spark, that I can run a complex SQL qery within this code to get data from multiple SQL Server tables, put the rsults in a dataframe…
asked 2024-04-24T13:45:40.7233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 27%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EY%3C/text%3E%3C/svg%3E)
ylycfj88
10
Reputation points
commented 2024-05-23T08:45:47.8466667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 99%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEC%3C/text%3E%3C/svg%3E)
Eswar Chitirala
0
Reputation points
1 answer
Is it possible to hide a pipeline created in Azure Data Factory or Azure Synapse Analytics for a particular user/s?
Scenario : Lets say there are number of department in any organisation. Adf pipeline of one department can only be visible to respective department , not to other department. For ex. if the adf pipeline created by Data ETL related Department then…
asked 2024-05-22T06:43:06.7966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 34%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERP%3C/text%3E%3C/svg%3E)
Rachit Pandya
0
Reputation points
edited a comment 2024-05-23T05:45:58.4666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(12.8, 48%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Harishga
4,485
Reputation points Microsoft Vendor
1 answer
Synapse>>Power BI
Hello- We have some sensitive data in azure synapse, the synapse view will be accessed by Power BI user for reporting. What is the best practice for sensitive data (PII) for production , do we mask the columns that has sensitive information ? If we…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 35%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Cant choose Key for upsert, in Copy Data-activity
I want to copy Data from an Azure SQL to a comsosdb container, with the copy data activity of Azure Synapse. As I cannot enter the uniqe key column, for the upsert behaviour, i receive a unique key violation error. Why is there no option to select the…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 57.99999999999999%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
How to prevent eventual "An insufficient number of arguments were supplied for the procedure or function cdc.fn_cdc_get_net_changes_" in Synapse?
I have a Data Flow that takes various tables from an Azure SQL Database source. All of these tables have CDC enabled at the Database level as well as having CDC enabled on the Source Connector (set to "Full on the first run, then…
asked 2023-08-03T04:03:42.9033333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 77%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Matty Stubbs
190
Reputation points
commented 2024-05-22T06:23:16.2633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
11,045
Reputation points Microsoft Vendor
1 answer
One of the answers was accepted by the question author.
Do you know how to install the 'ODBC Driver 17 for PostgreSQL' on a Azure Databricks cluster?
I am attempting to run postgreSQL stored procedures , through Azure Databricks notebook. We have stored procedure written in Azure Database for PostgreSQL and we want to run postgreSQL stored procedures through Azure Databricks Notebook (using…
asked 2024-04-30T11:06:56.06+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(96, 57.99999999999999%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Anuj, Singh (Cognizant)
50
Reputation points
commented 2024-05-22T04:46:59.1066667+00:00
Anuj, Singh (Cognizant)
50
Reputation points