Is there a way to schedule a Data Factory trigger that runs multiple times everyday BUT ONLY DURING A SPECIFIC TIME FRAME?

1
votes

I've created a pipeline with a web activity that uses REST API calls to my Synapse instance and pauses it at the end of every day. I'm trying to schedule it in Data Factory but the problem is I can't schedule it in the way I need. I want the pipeline to be triggered every hour but only between 6 PM and 10 PM everyday.

But ADF doesn't seem to provide this facility where a pipeline could be run only between a fixed timeframe every single day. I don't want my Synapse instance to be paused every hour during the day time.

Is there a way to bypass this limitation of Azure Data Factory scheduling?

2
azure-data-factory
Hi LearneR, If my answer is helpful for you, you can accept(mark) it as answer. This can be beneficial to other community members. Thank you. – Leon Yue
Hello LearneR, did you get the answer you want? – Leon Yue

2 Answers

1
votes

You can using Azure logic app Recurrence trigger to achieve that: enter image description here

Create a Recurrence trigger to call the data factory pipeline run with Get a pipeline run action.

Trigger the pipeline runs in [18,19,20,21,22](6 PM~10 PM) clock every day.

Hope this helps.

0
votes

Do not use Logic App or anything else if you want to be good with Data Factory. Can use does not mean should use. just put 18 into Hours box then click anywhere blank outside the box, repeat this with 19 and any other hours will give your Schedule execution times 08:00,19:00,20:00 ...