Azure Data Factory Triggers

Azure Data Factory Triggers

If you have a set of pipelines that must be run on a specific timing with multiple recurrences daily, then triggers are very useful. Triggers are the ones that can associate with pipelines to run the job on specified timings. We can even set run parameters for each trigger; hence the same pipeline can be run using multiple triggers with a different set of run parameter values.

Note. There are ADF serves us 4 types of triggers.

Scheduled Trigger

• Schedule triggers are run based on the time schedule defined in the trigger.
• These are very flexible by providing multiple options to schedule, like minutes, hours, weeks, and months. Hence allows us to choose multiple dates and times.
• These have many to many relationships with pipelines, like one trigger can be used to run multiple pipelines, and one pipeline can be run by many triggers.
• Schedule triggers can be run only for future dated loads.
  

Tumbling Window Trigger

• A tumbling window triggers fires at a periodic time interval from a specified start time.
• Tumbling window triggers are non-overlapping, fixed-size triggers.
• A tumbling trigger has a one-to-one relationship with a pipeline. Hence one trigger can be used to run only a single pipeline.
• These can be configured to trigger past-dated as well as future-dated loads.
  

Storage Events Trigger

• These types of triggers are run when there is any event happened on the storage.
• For example: For any specific file created or deleted on the storage container, the event gets triggered.
  

Custom Event Trigger

• Custom event trigger runs the pipelines by subscribing to the events coming to a topic in Azure Event Grid.