Azure Data Factory Automated publishing for continuous integration and delivery

Question

I’m following the new CICD guide for ADF https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment-improvements Looks like I'm missing files credential and managedVirtualNetwork. Do I need to set up authentication with the npm module and Azure packages?

Getting these errors:

LocalFileClientService: Unable to list files for: credential, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/credential'
…
LocalFileClientService: Unable to list files for: managedVirtualNetwork, error: Error: ENOENT: no such file or directory, scandir '/home/vsts/work/1/s/managedVirtualNetwork'
…

ERROR === CmdApiApp: Failed to run resource validation. Error: {"stack":"TypeError: Cannot read property 'concept' of undefined\n    at Function.<anonymous> (/home/vsts/work/1/s/downloads/main.js:1271:27040)\n    at /home/vsts/work/1/s/downloads/main.js:16:2243\n    at Object.next (/home/vsts/work/1/s/downloads/main.js:16:2348)\n    at o (/home/vsts/work/1/s/downloads/main.js:16:1087)","message":"Cannot read property 'concept' of undefined"}
…
error code ELIFECYCLE
error errno 1
error @ build: `node node_modules/@microsoft/azure-data-factory-utilities/lib/index "validate" "/home/vsts/work/1/s" "subscriptions/xxxxxxx/resourceGroups/xxxxxxx/providers/Microsoft.DataFactory/factories/xxxxxxxx”
error Exit status 1
error Failed at the @ build script.
error This is probably not a problem with npm. There is likely additional logging output above.
##[error]Error: Npm failed with return code: 1

Could you try running run build export directly to see if the arm template can be exported? — Levi Lu-MSFT
@LeviLu-MSFT thanks, I also got similar errors running it locally npm run build export <rootFolder> <factoryId> — Manrique Vargas

Abhishek Krishna Abhishek Krishna · Accepted Answer · 2021-03-08T10:56:35

The missing credential and managedVirtualNetwork folders are not an issue. I am able to validate and export the ARM template even without having those folders.

I was able to reproduce the error with an incorrect ADF Resource ID. The leading / before 'subscriptions' is missing. Changing the Resource ID to /subscriptions/xxxxxxx/resourceGroups/xxxxxxx/providers/Microsoft.DataFactory/factories/xxxxxxxx should work.

Azure Data Factory Automated publishing for continuous integration and delivery

1 Answers