Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

An orchestration platform for the development, production, and observation of data assets.

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable,…

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

A fast and reliable background task processing library for Python 3.

🪓 An orchestration engine for background tasks, AI agents, and durable workflows

Fast and reliable background jobs in Go

Maestro: Netflix’s Workflow Orchestrator

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Common project repo for all Argo Projects

Build, Manage and Deploy AI/ML Systems

The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Trigger.dev – build and deploy fully‑managed AI agents and workflows

Temporal service