azure devops for ADF and databricks

2
votes

I am trying to create an azure ci/cd pipeline for my azure data factory in which I have used databricks notebook. Pipeline got created successfully with the ARM template for ADF but I am not able to see any override parameter for databricks workspace URL, that's why i got the same databricks URL in my dev and prod environment.

Can anyone help me to set databricks workspace URL for Dev and prod dynamically?

1
azure-devopsazure-data-factoryazure-databricks
all linked services, including the databricks ones, are parameterised by default. Can you see any other linked services? What ARM parameter templates do you have? - Nick.McDermaid
It showing me only data bricks accessToken in ARM parameters but i also want "Databrick Workspace URL" as parameters as its it different for every environment. - Jaydeepsinh
This is the way I fixed that.... ask questions if you can't follow it. keepsecure.ca/blog/fixing-adf-databricks-linked-service - Nick.McDermaid
Also see this stackoverflow.com/questions/64818057/… - Nick.McDermaid
@Jaydeepsinh You can post an answer to end this question. Your answer can be benefit to others. - Steve Zhao

1 Answers

0
votes

you need to create a token in qa and prod and use that in ur ci cd pipeline..tokens are unique all over and automatically linked to respective service