Airflow

This is a reference configuration of the Airflow Helm Chart and a few DAGs serving as demos.

Prerequisites

The installation requires that the user has setup:

• A working Kubernetes install (this configuration assumes a single-node cluster)

• The Helm Package Manager

• Python 3.8+

Installing

• Add the Airflow Helm Repository to Helm.

helm repo add airflow-stable https://airflow-helm.github.io/charts

• Update repositories.

helm repo update

• Apply manifest files.

It is highly recommended to generate new secrets/passwords and keys for the manifest/airflow-secrets.yaml file. Instructions can be found in the comments of the file.

kubectl apply -f manifest/

• Install Airflow.

helm upgrade --cleanup-on-fail --namespace airflow --install airflow airflow-stable/airflow -f airflow.yaml