Add environment parameter is Azure Synapse

2
votes

I´m wondering if it´s possible to read an environment variable (Azure resource tag) from Azure Synapse Notebooks and Pipelines.

It would be useful since in many use cases the Azure resource names comprehend the environment name/code in it - i.e. they differ from environment to environment (dev, test, prod...). Reading the Azure resource environment tag within a Synapse pipeline or notebook would allow parametrizing the code, therefore making it more flexible and reusable.

Thanks in advance for any hint!

2
azureazure-synapse

2 Answers

0
votes

The closest thing is probably a Global Variable in Azure Data Factory (ADF). Unfortunately these are not yet supported in Synapse pipelines but you can add your upvote for it here:

https://feedback.azure.com/forums/307516-azure-synapse-analytics/suggestions/42113842-using-global-parameters

It's also worth keeping an eye on the item status for updates - it might get changed to "Started" or "Complete" one day. I have heard MS say the goal is to have as little difference as possible between ADF and Synapse pipelines so it's worth keeping an eye on.

The other method would probably be Azure Key Vault integration which is supported. Create your secret, get the secret identifier and then use it in your pipeline.

0
votes

if username is parameter in data factory, then find below code in python to read in synapse notebook. python code :

name=f"{username}"