Configuring Linked Service for Dev to Prod Movement in Azure Synapse Analytics
In Azure Synapse Analytics, I have a linked service of type Azure SQL Database Managed Instance, and I have two linked services, one for dev and one for prod. How can I move from dev to prod without changing the linked service manually? How can I make it…
Workspace is in non-terminal state Failed and cannot be updated
Hello, I was working on creating a new workspace in Azure Synapse Analytics. During deployment, error is encountered. I tried to delete and re-create the workspace but same error. Tried to re-deploy, still error persisted. Any advice? Workspace is in…
Missing columns in CDM entities with Dataverse D365 Synapse Link to ADLS
We have a synapse link setup to load data from Dataverse D365 into Data lake gen2. It has a table 'Contact' and it has around 780+ columns and the synapse link loads this table as Common Data Model and the dataflow reads the CDM. There were columns…
create store procedure in Synapse
Hi , How to create store procedure in synapse to create tables Regards
How can we connect Blackboard DDA (a SaaS using PostgreSQL to store data ) via Azure Synapse analytics using SSL certificate for authentication in SHIR for Private Vnet enabled networks.
Blackboard DDA is a SaaS application which uses PostgreSQL as DB to store data. The DB uses a SSL certificate key to authenticate and we have private Vnet enabled. How to create a linked service for this DB and where do we store certificate in SHIR. Are…
Why 'Custom App' option is not shown under 'Add Source' in event stream of Microsoft Fabric.
We are trying to consume messages from Kafka. Created a new event stream in Microsoft Fabric. 'Custom App' option is not shown under 'Add Source' or 'New Source' in event stream of Microsoft Fabric real-time analytics
Can't create a datalake storage account Gen2 when creating an azure synapse resource
Hi all, When trying to create a new data lake gen2 storage account (while creating a azure Synapse resource), I keep on getting an error message that the account name can't be verified and that I need to try again. I've waited for a couple of hours…
Meta data activity Child item unable to load all the files from different folders via file system as a source
Hello, I have been trying to dynamically get the files from different folders and mapping into the dynamic folder within Datalake. However, when I used Childitems under metadata, I could only load files from circled folder in the attached below. is…
check if the value is a number and output in iif logic of derived transformation
I am checking if the input value is a number then output as '100' else 'invalid' in derived transformation in dataflow. In the documentation, I found 'isLong' function. But, how do we use this function in an iif…
Deploy the ETL code from Dev Synapse Analytics workspace to Another Workspace (different Resource group and Different subscription)
Hi all, I had an issue earlier and I had a great response and it has been resolved now. I need to know what's the best approach to: Deploy all ETL code (pipelines/ copy , data flows) produced on Synapse and stored on DevOps on different branches to…
How do i integrate my hubspot account in azure synapse to extract the customer details from the data pipeline?
I linked the hubspot account into the azure synapse data but when i click on data preview it has some missing columns which i need to extract. I want to access the full customer details from hubspot into the data pipeline.
Unable to create synapse workspace
Hi while trying to create my workspace through I encounter the following error {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for more…
Complex query performance optimization in Azure Synapse
I am working on a complex ETL process using Azure Synapse Analytics and I need some expert advice on optimizing the performance of a particularly challenging query. I have a large dataset stored in an Azure Synapse dedicated SQL pool. The dataset…
Getting InvalidUserAssignedMiCredential when trying to deloy Synapse Artifacts
Hi, I am trying to deploy synapse artifacts. I am getting error { "ArtifactName": "DevUserAssignedMI", "ArtifactType": "Credentials", "StatusCode":…
External Tables and Polybase in Synapse and Sql Server
So, I thought I knew external tables well in azure but I was reading about external tables with Sql Server: https://learn.microsoft.com/en-us/sql/t-sql/statements/create-external-table-transact-sql?view=sql-server-ver16&tabs=dedicated and it seems…
Synapse Link for Dataverse-SYN-806: Default storage container in Synapse workspace is not accessible error while enbling tables
Hi, I'm trying to setup a synapse link via dataverse to F&O. I'm able to setup the connection but when I enable tables sync status is throwing out error . Error details - SYN-806: Default storage container in Synapse workspace is not…
Synapse spark V3.4 bug??
I am unable to create a database using Spark 3.4. Is there any existing issue with spark 3.4?
self-hosted integration from sharepoint to synapse
Hello, I successfully connect my synapse to file system by setting up self-hosted integration. However, previous I would like to connect my sharepoint to synapse but it keeps on having this error. We investigated, was wondering if we also need…
Can't able to connect the VM installed postgresql from ADF
Hi Team, We are unable to access the PostgreSQL from the ADF linked server. it's a azure PostgreSQL flexible server, and we have enabled the "Allow public services" setting within Azure for this server. However, we are still unable to create a…
Connect SharePoint Online List with Synapse Integrated Runtime Managed Virtual Network
Getting an error when attempting to create a Linked Service for SharePoint Online List in Synapse. I've followed the instructions and prerequisites on MS documentation, but getting the following error when testing the connection: An error occurred while…