Course Introduction
  • Important Prerequisites
  • Course Objectives
  • Who am I?
  • Development Environment
Getting Started with Airflow
  • Introduction
  • Why Airflow?
  • What is Airflow?
  • How Airflow works?
  • [Practice] Installing Airflow 2.0
  • [Practice] The CLI in Airflow 2.0
  • [Practice] What you need to know about the UI
  • Quiz Time!
  • Key Takeaways
Coding Your First Data Pipeline with Airflow
  • Introduction
  • What is a DAG?
  • [Practice] Time to code your first DAG
  • [Practice] DAG Skeleton
  • What is an Operator?
  • [Practice] Creating Table
  • [Practice] The secret weapon!
  • [Practice] Is API available?
  • [Practice] Extracting users
  • [Practice] Processing users
  • [Practice] Storing users
  • [Practice] Order matters!
  • [Practice] You data pipeline in action!
  • Dag scheduling
  • [Practice] Backfilling and catchup
  • Quiz Time!
Databases and Executors
  • Introduction
  • The default configuration
  • [Practice] Start scaling with the Local Executor
  • Scale to the infinity with the Celery Executor
  • [Practice] Scaling Airflow with the Celery Executor in action!
  • [Practice] Changing the executor
  • Concurrency, the parameters you must know!
  • [Practice] Concurrency in practice
  • Wait a second!
  • Quiz Time!
Implementing Advanced Concepts in Airflow
  • Introduction
  • Adios repetitive patterns
  • [Practice] Minimising DAGs with SubDAGs
  • [Practice] Adios SubDAGs, Welcome TaskGroups!
  • Sharing data between tasks with XComs
  • [Practice] XComs in action!
  • Choosing a specific path in your DAG
  • [Practice] Executing a task according to a condition
  • Trigger rules or how tasks get triggered
  • [Practice] Changing the way your tasks are triggered
  • Quiz Time!
Creating Airflow Plugins with Elasticsearch and PostgreSQL
  • Introduction
  • Installing Elasticsearch
  • How the plugin system works?
  • [Practice] Creating a hook interacting with Elasticsearch
  • [Practice] Creating the PostgresToElasticOperator
  • Quiz Time!
Using Apache Airflow with Docker
  • Introduction
  • Quick Reminder About Docker
  • [Practice] Running Airflow on Docker with the Celery Executor
  • [Practice] Running Airflow on Docker with the Local Executor
  • Quiz Time!
  • Recap
Airflow 2.0
  • What to expect from Airflow 2.0?
BONUS - APPENDIX
  • [BLOG POST] How to use the DockerOperator with Templating and Apache Spark
  • [BLOG POST] Apache Airflow with Kubernetes Executor
  • [BLOG POST] How to use templates and macros in Apache Airflow
  • [BLOG POST] How to use timezones in Apache Airflow
  • [BLOG POST] How to use the BashOperator
  • [BLOG POST] Variables in Apache Airflow: The Guide
  • [BLOG POST] Best Practices in Apache Airflow (part 1)
  • [VIDEO] Running Apache Airflow on a multi-nodes Kubernetes cluster locally
  • [BLOG POST] The PostgresOperator: All you need to know
  • COUPON FOR MY OTHER COURSES!