How To Trigger Synapse/ADF Pipeline

Problem Statement

Is it possible to trigger Synapse / ADF Pipeline in 15-minute intervals between the Mth hour and Nth hour on a daily basis?

Prerequisites

  1. Synapse / Data Factory

Solution

Synapse / ADF has two different types of triggers: Schedule & Tumbling window, which provides the flexibility of running a pipeline in every 15-minute intervals, as seen below.

a) Schedule

Trigger Synapse/ADF Pipeline

b) Tumbling Window

Trigger Synapse/ADF Pipeline

However, the above two types of triggers out-of-the-box functionality do not provide the flexibility to run the pipelines in a specific interval on a daily basis.

So in order to trigger Synapse / ADF Pipeline in 15-minute intervals between Mth hour and Nth hour on a daily basis, we would have to follow the below custom logic aspect. For our use case, we would consider M=8 AM and N=2 PM

We would have to create 2 different triggers to achieve this scenario.

  1. Create a Schedule Trigger 1 with Recurrence as Daily and different 15-minute interval time probabilities
    Trigger Synapse/ADF Pipeline
    This would cover all times from 8 AM till 1:45 PM.
     
  2. Create a Schedule Trigger 2 with Recurrence as Daily and the final aspect of 2 PM slot.
    Trigger Synapse/ADF Pipeline