Apache Airflow® provides many plug-and-play operators that are ready to execute your tasks on Google Cloud Platform, Amazon Web Services, Microsoft Azure and many other third-party services. This makes Airflow easy to apply to current infrastructure and extend to …

What is Airflow®?¶ Apache Airflow® is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows. Airflow’s extensible Python framework enables you to build workflows connecting with virtually any technology.

The installation of Airflow is straightforward if you follow the instructions below. Airflow uses constraint files to enable reproducible installation, so using pip and constraint files is recommended. Set Airflow Home (optional): Airflow requires a …

Apache Airflow® Apache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation. Read the documentation »

Here you can find detailed documentation about each one of the core concepts of Apache Airflow® and how to use them, as well as a high-level architectural overview. Architecture Airflow components

Airflow is a platform that lets you build and run workflows. A workflow is represented as a DAG (a Directed Acyclic Graph), and contains individual pieces of work called Tasks , arranged with dependencies and data flows taken into account.

Once you have Airflow up and running with the Quick Start, these tutorials are a great way to get a sense for how Airflow works.

This page describes installations options that you might use when considering how to install Airflow®. Airflow consists of many components, often distributed among many physical or virtual machines, therefore installation of Airflow might be quite complex, depending on …

This tutorial walks you through some of the fundamental Airflow concepts, objects, and their usage while writing your first DAG.

The Airflow UI makes it easy to monitor and troubleshoot your data pipelines. Here’s a quick overview of some of the features and visualizations you can find in the Airflow UI.