academy.astronomer.ioAstronomer Academy

Back Sign In Searching... Plans Paths Modules Lessons Reset Learn Apache Airflow Free Airflow courses taught by the Astronomer experts behind the project. Grow your skills to create powerful, scalable and reliable data pipelines based on industry and data engineering best practices. From anywhere, at anytime. Get Certified Explore All Modules → Marc Lamberti Course Instructor Introducing Learning Bytes: 10-min videos on new features for quick learning → New to Airflow? Airflow 101 Learning Path This learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow. Start Learning New to Astro? Astro Onboarding Learning Path This learning path shows you how to run Airflow on Astronomer’s managed service. Deploy your first DAG in minutes. Start Learning Take the official Airflow certification exam. $150 Learn More [separator] Popular Airflow Modules Free separator Airflow: Datasets Learn how to take advantage datasets to create data-aware scheduled DAGs. Free 0 hr 16 min Beginner Data Engineer Astro Runtime Intermediate Airflow Module Airflow: The KubernetesPodOperator Master the KubernetesPodOperator (KPO) to better manage resources and dependencies of DAG tasks. Free 0 hr 13 min Data Engineer Astro Runtime Advanced Kubernetes Airflow Module Airflow: Trigger Rules Learn how to effectively control the task execution flow using trigger rules. Free 0 hr 6 min Data Engineer Astro Runtime Intermediate Airflow Module [separator] Popular Astro Modules Free separator Astro: Cloud IDE Learn about the Cloud IDE which makes it simple for someone new to Airflow and Astronomer users to write a data pipeline. Free 0 hr 37 min Beginner 101 Astro Module Astro: HTTP Provider Interact with HTTP Resources by making Web Requests to an API. Free 0 hr 35 min Beginner Astro Providers Module Astro: Deployments Organize and configure your deployments to better run your workflows Free 0 hr 14 min Beginner 101 Astro Module Airflow: Dynamic DAGs Learn how to avoid duplicating DAGs with Dynamic DAGs. Free 0 hr 8 min Data Engineer Astro Runtime Advanced Airflow Module Airflow: Pools Learn how to define how many tasks run in parallel for a set of tasks with Airflow pools. Free 0 hr 7 min Data Engineer Astro Runtime Intermediate Airflow Module Airflow: Deferrable Operators Learn how to efficiently manage resources by using Deferrable Operators. Free 0 hr 9 min Data Engineer Astro Runtime Intermediate Airflow Module Astronomer Software 101 Get started with Software and get the most out of the platform for your workflows Free 5 Modules Astronomer Platform Beginner Astronomer Enterprise Admin 101 Airflow 101 The Airflow 101 learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow. This includes the core concepts, the Airflow UI, creating your first data pipeline following best practices, how to schedule this data pipeline efficiently and more! Free 12 Modules Learning Path Airflow Airflow: Basics Explore how Apache Airflow works under the hood and the basics of how a DAG is built! Free Beginner 101 Airflow Airflow: XComs 101 Learn the basics of sharing data between tasks using XComs Free 0 hr 10 min Beginner 101 Astro Runtime Airflow Module Astro 101 Get started with Astro quickly and learn how to get the most out of it! Free 8 Modules Beginner 101 Astro Learning Bytes: Customer Managed Workload Identity An overview of the Customer Managed Workload Identity feature on Astro! Free 5 min Astro Runtime Learning Byte Airflow: DAGs 101 Learn the basics of how to create a data pipeline in Airflow. Free 0 hr 17 min Beginner 101 Astro Runtime Airflow Module Airflow: Local Development Environment Set up a local development environment for Airflow! Free Beginner Airflow Learning Bytes: Reporting An overview of the reporting feature on Astro! Free 7 min Astro Astro Runtime Learning Byte Learning Bytes: Custom Deployment Roles An overview of the custom deployment roles feature on Astro! Free 8 min Astro Astro Runtime Learning Byte Introduction to Orchestration and Airflow An overview of the world of data orchestration and Apache Airflow! Free Beginner Airflow Module Astro: User permissions Define the right permissions to the right users in Astro Free 0 hr 12 min Beginner 101 Astro permissions Module Astro: CI/CD Make reliable and resilient deployments with CI/CD Free 0 hr 27 min Beginner 101 Astro cicd Module Airflow: Templating Learn how to pass dynamic data to tasks at runtime. Free 0 hr 12 min Beginner Data Engineer Astro Runtime Intermediate Templating Airflow Module Software: Metrics What are the key metrics to know, what to do if something goes wrong, let’s find out! Free 0 hr 17 min Astronomer Platform Beginner Astronomer Enterprise Admin Monitoring Software Module Astro: SDK Speed up your DAG development with the Astro SDK Free 0 hr 50 min Astro Data Engineer Astro Runtime Intermediate Module Airflow: Branching Learn how to branch in order to tell the DAGs to not to run all dependent tasks, but instead to pick and choose one or more paths to go down. Free 0 hr 26 min Beginner 101 Intermediate Airflow Module Airflow: Task Groups Learn how to optimize DAGs and clean up the Airflow UI with Task Groups. Free 0 hr 18 min Beginner Astro Runtime task groups Airflow Module Airflow: Connections 101 Learn how to interact with systems from data pipelines with connections. Free 0 hr 7 min Beginner 101 Airflow Module Astro: Local Development Environment Set up your local development environment with the Astro CLI and speed up your DAGs development Free 0 hr 9 min Beginner 101 Astro Module Software: User Permissions Setting the proper permissions and roles for your users can be a pain. Let us help you make it more enjoyable and straightforward. Free 0 hr 15 min Beginner Astronomer Enterprise Admin Software Module Software: Alerting Be notified when something goes wrong and know what to do Free 0 hr 12 min Beginner Astronomer Enterprise Admin Software Module Astro: Environment Variables The fundamentals of how to apply Environment Variables in Astro Free 0 hr 18 min Beginner 101 Astro environment variables Module Software: Workspaces Learn how to better organize your Airflow deployments and Users with Workspaces. Free 0 hr 16 min Astronomer Platform Beginner Astronomer Enterprise Admin Workspace Software Module Astro: Onboarding Discover Astro and Airflow by building and deploying a data pipeline! Free 01:17:53 101 Astro Module Astro: Metrics Monitor your deployments and quickly spot failures Free 0 hr 10 min Beginner 101 Astro Module Software: Deployment Resources Don’t get your tasks killed anymore. Learn how to define your resources according to your needs. Free 0 hr 17 min Astronomer Platform Beginner Astronomer Enterprise Admin resources Software Module Astro: Deployment Analytics Learn how to interpret powerful insights relating to your deployment Free 0 hr 9 min Beginner Monitoring 101 Astro analytics Module Astro: Secrets Backend The fundamentals of how to configure an external secrets backend in Astro Free 0 hr 13 min Beginner modules 101 Astro AWS secrets backend secrets Module Airflow: Command Line Interface (CLI) Learn how to use the Airflow CLI to perform a variety of operations. Free 0 hr 19 min Beginner Airflow Module Airflow: Variables 101 Learn how to store data with variables and make DAGs more dynamic. Free 0 hr 6 min Beginner 101 Astro Runtime Airflow Module Airflow: DAG Scheduling Learn about how DAGs are scheduled. Free 0 hr 10 min Beginner Data Engineer Astro Runtime Scheduling Airflow Module Airflow: Taskflow API Learn how to use the Taskflow API to create DAGs faster. Free 0 hr 28 min Data Engineer Astro Runtime Airflow Module Airflow: Sensors Learn how to use Airflow sensors to wait for events before triggering tasks. Free 0 hr 15 min Beginner 101 Airflow Module Airflow Project: Dynamic Task Mapping with S3 Build a DAG that interacts with S3 buckets using Dynamic Task Mapping. Free...