Problem Statement
Is it possible to trigger Synapse / ADF Pipeline in 15-minute intervals between the Mth hour and Nth hour on a daily basis?
Prerequisites
- Synapse / Data Factory
Solution
Synapse / ADF has two different types of triggers: Schedule & Tumbling window, which provides the flexibility of running a pipeline in every 15-minute intervals, as seen below.
a) Schedule
b) Tumbling Window
However, the above two types of triggers out-of-the-box functionality do not provide the flexibility to run the pipelines in a specific interval on a daily basis.
So in order to trigger Synapse / ADF Pipeline in 15-minute intervals between Mth hour and Nth hour on a daily basis, we would have to follow the below custom logic aspect. For our use case, we would consider M=8 AM and N=2 PM
We would have to create 2 different triggers to achieve this scenario.
- Create a Schedule Trigger 1 with Recurrence as Daily and different 15-minute interval time probabilities
This would cover all times from 8 AM till 1:45 PM.
- Create a Schedule Trigger 2 with Recurrence as Daily and the final aspect of 2 PM slot.