airflow-common

Common operators and tasks for Airflow

Build Status codecov License PyPI

Overview

airflow-common provides common operators, topology helpers, and library management tasks for Apache Airflow workflows.

Key features:

  • Common Operators: Convenience operators like Skip, Fail, and Pass for workflow control

  • Topology Helpers: Functions like all_success_any_failure and if_booted_do for building complex DAG topologies

  • Library Management: Pydantic models for PipLibrary, CondaLibrary, and GitRepo with corresponding operators for package installation

  • Infrastructure Tasks: Operators for system maintenance like JournalctlClean

Note

This library is built on airflow-pydantic for Pydantic-based Airflow constructs, and integrates seamlessly with airflow-config for YAML-driven DAG definitions using Hydra.

Installation

You can install from pip:

pip install airflow-common

Or via conda:

conda install airflow-common -c conda-forge

License

This software is licensed under the Apache 2.0 license. See the LICENSE file for details.

Note

This library was generated using copier from the Base Python Project Template repository.