Multiple Source To a copy activity in Azure Data Factory

0
votes

On-premise stored procedure accepts two parameters and returns multiple records, which needs to be written to azure data lake store(adls). Those 2 parameters are existing in two different files, which I trying to read from 2 individual Look UP activities in ADF.

Unfortunately Copy activity where stored procedure is being executed, accepts only one dependent input link. So how can I pass these two parameters to copy activity?

Are there any work arounds to look up two different files and pass the returned values to stored procedure?

1
azureazure-data-factory

1 Answers

1
votes

suppose the 2 parameters store in two different blob files and the stored procedure is invoked in copy source side, please follow the below step:

  1. Create two lookup activity referring to blob dataset, this step is for look up 2 parameters. Let's suppose these 2 parameters reside in the first row of the 2 files respectively, so check the "First row only" in lookup activity.

  2. Create a copy activity with the condition of these two lookup activity running successfully, invoke the stored procedure in copy source.

  3. Import the two parameters of the stored procedure, here we name them as "para1" and "para2", the pass "@activity('Lookup1').output.firstRow" and "@activity('Lookup2').output.firstRow" to 2 parameters.

The following pic shows this example: enter image description here