Lightweight function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
-
Updated
Jun 13, 2024 - Python
Lightweight function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
A distributed, fault-tolerant task queue
Workflow Engine for Kubernetes
Go Implementation of the Spacemesh protocol full node. 💾⏰💪
A scalable inference server for models optimized with OpenVINO™
Monadic directed acyclic graph datastructures for Scala
Substrate Python SDK
Open data platform based on Kubernetes. Scaleph supports SeaTunnel、Flink and Doris backended by SeaTunnel on Flink engine、Flink Kubernetes Operator and Doris operator.
一个无任何第三方依赖的跨平台自定义编排执行步骤的API, 基于DAG实现了依赖步骤依次顺序执行、非依赖步骤并发执行的调度功能. 提供API远程操作方式,批量执行Shell、Powershell、Python等命令,轻松完成运行自动化运维脚本等常见管理任务,轮询进程、安装或卸载软件、更新应用程序以及安装补丁。
A high performance Python graph library implemented in Rust.
The WfCommons JSON Schema for workflow instances and generators
Hathor core is the official and reference client for operating a full node in Hathor Network.
An Apache Airflow ETL pipeline to process employee data by downloading, validating, transforming, and loading it into a PostgreSQL database.
Iris is an extensible asynchronous header-only framework written in pure modern C++, including a M:N task scheduler (with coroutine support for C++ 20 optionally) and an advanced DAG-based task dispatcher.
Add a description, image, and links to the dag topic page so that developers can more easily learn about it.
To associate your repository with the dag topic, visit your repo's landing page and select "manage topics."