Azure Data Factory CI/CD - automatic publish after merge to master branch

Question

we are building CI/CD solution over our Azure Data Factory, and what I'm missing and what I was not able to get answer for after some searching is if there is possibility to automate publishing from collaboration branch to our adf_publish branch. So desired workflow should be:

1. Create feature branch
2. When you are satisfied with changes create pull request
3. Pull request is approved and merged to collaboration(master) branch
4. After merge, pipeline will automatically publish changes to development Azure Data Factory service and reflect the changes in adf_publish branch. Without someone pushing Publish button in UI.
5. If necessary release pipelines are triggered from adf_publish branch to other environments

Answer 1

This feature is currently unavailable in adf, kindly vote for the adf feedback link below: https://feedback.azure.com/forums/270578-data-factory/suggestions/40556329-please-allow-users-to-automate-publish

Answer 2

This has been added to Azure Data Factory and Azure DevOps Pipelines as of early 2021.

https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment-improvements#the-new-cicd-flow

Answer 3

Recently, Microsoft has announced that they now support automated Azure Data Factory publish using ADFUtilities NPM (@microsoft/azure-data-factory-utilities) library. Read more about it at https://azureops.org/articles/automated-azure-data-factory-publish/