How to use azure functions to create trigger event based on files received in azure data lake store

0
votes

I have a .csv file in Azure data lake store, can I Use a function app to trigger an Azure Data Factory (ADF) event whenever the .csv file gets loaded in the data lake store. Current ADF supports event's for blob storage but not for data lakes.

Thanks, Ravi

1
azureazure-functionsazure-data-factoryazure-function-app
please clarify if you are talking about Data Lake Store Gen1 or Gen2 – silent
we are using Data Lake Store Gen1 – Ravi
Data Lake Store Gen1 does not support to emit events when new files are created (and thus trigger anything: Functions, ADF, etc.). – silent

1 Answers

0
votes

ADF pipeline can be triggered by rest API and power shell. Maybe you can use azure function to call rest API or powershell script to control ADF pipeline run.

https://docs.microsoft.com/en-us/powershell/module/azurerm.datafactoryv2/Invoke-AzureRmDataFactoryV2Pipeline?view=azurermps-6.13.0