Apache Airflow

Apache Airflow

airflow.apache.org

1

About this website

Apache Airflow is an open-source workflow engine for authoring scheduling and monitoring complex data pipelines and ETL processes as directed acyclic graphs of tasks. Airflow provides a web UI for monitoring pipeline execution a scheduling system for time-based triggers and extensive integration with data sources like Hadoop Spark and cloud platforms. The platform supports branching conditional execution and parallel task processing. Companies use Airflow for data engineering ETL pipelines ML workflows and any process requiring complex task orchestration.

Tags & Categories

Categories

Tags

Statistics

1
Views
0
Clicks
0
Like
0
Dislike

Comments

Log In to post a comment

No comments yet. Be the first!