Azure Synapse Sql pool not receiving data from Azure Synapse Studio Dataflow

0
votes

Background: I am working my way through an exercise where I use a dataflow in Azure Synapse Studio to transform data inside a Azure Synapse SQL pool.

Here is the exercise: https://docs.microsoft.com/en-gb/learn/modules/populate-slowly-changing-dimensions-azure-synapse-analytics-pipelines/4-exercise-design-implement-type-1-dimension

I have gotten all the way though the exercise to the last part - testing. The data preview shows the correct data:

enter image description here

but after I trigger the pipeline, wait for it to run & refresh the database, I get no output from the pipeline:

enter image description here

and no data in the DimCustomer table:

enter image description here

I have run a test on the connection and it come back fine.

Any assistance would be great! I hope/suspect I am missing something obvious.

My current guess is that the issue is between the sink and the pipeline outcome.

1
azureazure-synapseazure-data-factory-pipeline

1 Answers

0
votes

When you trigger the pipeline , does it show you something like below ? If the answer is NO , then thats the problem . As the table which you are quering is the last step of the pipline . If the pipeline was never triggered , the data never reached the sink .

enter image description here

Can you please check how you have configured if one the sink by mistake you have not selected "Delete option" ?