Section 1 : Introduction

Important Prerequisites (1)

• Course objective : To serve you as a reference for your daily operator
  • How to use in the best possible way the Python Operator?
  • How to create that dependencies and which way is better thatn another way?
  • What are the most important parameters whenever you create an operator?
  • You want to create some conditions in your data pipelines and you know the branch operator, but you don't know that there are other operators as well
• What you are looking for about a specific operator!
• Prerequisites
  • Airflow
  • Python
  • Docker

Course Objectives (3)

• BaseOperator
  • All parameters that you can use in your operators e.g. how to create priorities between your tasks?
  • How to create dependencies between your tasks accors DagRuns?
  • How to be properly notified whenever a task fails and what you can do about it
  • How to set accelerators for your critical tasks and what you need to know about them?
  • How to limit the number of tasks that you can execute at the same time?
  • How can you version your dags in order to make sure that you won't mess up with your modifications
• Common Operators
  • PythonOperator
  • BashOperator
  • PostgresOperator
• Choose your path
  • BranchPythonOperator
  • Other BranchOperators
• DAG dependencies
  • There are different ways of creating dependencies in Airflow
• And much more

Section 2 : The BaseOperator Exposed

Section 3 : The Most Common Operators

Section 4 : Choose your path

Section 5 : DAG Dependencies

Section 6 : The Exotic Ones

Section 7 : Last Words!