The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
-
Updated
Jun 12, 2024 - Python
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
EPAM Delivery Platform helm charts
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
vSNP -- validate SNPs
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
This project showcases the deployment of a classic Tetris game using CI/CD pipelines. The game is containerized with Docker and utilizes Azure DevOps and Jenkins for automation.
Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Declarative Continuous Deployment for Kubernetes
A free and open-source tool that allows engineering teams to add visual interest to their README files through the use of customized animated GIFs.
Bacterial typing pipeline for clinical NGS data. Written in NextFlow, Python & Bash.
A collection of modules and sub-workflows for Nextflow
Data intensive science for everyone.
SolAR is an open-source framework released under Apache license 2.0 making it possible to easily create your own camera pose estimation solution to develop augmented reality applications.
Customize Kubernetes Change Context (KUBECONFIG)
A Snakemake workflow to split, filter, normalize, integrate and select highly variable features of count matrices resulting from experiments with sequencing readout (e.g., RNA-seq, ATAC-seq, ChIP-seq, Methyl-seq, miRNA-seq,...) including diagnostic visualizations.
Add a description, image, and links to the pipeline topic page so that developers can more easily learn about it.
To associate your repository with the pipeline topic, visit your repo's landing page and select "manage topics."