Apache Doris is an easy-to-use, high performance and unified analytics database.

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

YTsaurus is a scalable and fault-tolerant open-source big data platform.

Python - Java/Scala API for the Hopsworks feature store

The MongoDB Spark Connector

Apache Spark - A unified analytics engine for large-scale data processing

Python SQL Parser and Transpiler

This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination of Spark metrics, making it a practical choice for both developers and data engineers.

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

A large-scale entity and relation database supporting aggregation of properties

REST API for Apache Spark on K8S or YARN

Uniffle is a high performance, general purpose Remote Shuffle Service.

Simple and Distributed Machine Learning

High Performance HTTP Sidecar Load Balancer

Apache DataFusion Comet Spark Accelerator

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

PawMark is a platform for developers to build, schedule and monitor data pipelines.

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式