A high-throughput and memory-efficient inference and serving engine for LLMs
-
Updated
Jun 11, 2024 - Python
A high-throughput and memory-efficient inference and serving engine for LLMs
The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈
MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK
Workflow Engine for Kubernetes
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
This is an AI-Gemini Chatbot LLM And Large Image Model Application. You can use this project run into local and ask you images like your talking with in realtime
AI Observability & Evaluation
Checklists and LLM prompts for efficient and effective test creation in data analysis
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
An orchestration platform for the development, production, and observation of data assets.
Homeworks and capstone project of MLOps Zoomcamp 2024 from DataTalksClub
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
Open source AI platform for rapid development of advanced AI and AGI pipelines.
Standardized Serverless ML Inference Platform on Kubernetes
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
🦋 A personal research and development (R&D) lab that facilitates the sharing of knowledge.
Add a description, image, and links to the mlops topic page so that developers can more easily learn about it.
To associate your repository with the mlops topic, visit your repo's landing page and select "manage topics."