Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

A python module to repair invalid JSON, commonly used to parse the output of LLMs

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

🤖 Collect practical AI repos, tools, websites, papers and tutorials on AI. 实用的AI百宝箱 💎

Llama.cpp é uma biblioteca desenvolvida em C++ para a implementação eficiente de grandes modelos de linguagem, como o LLaMA da Meta. Otimizada para rodar em diversas plataformas, incluindo dispositivos com recursos limitados, oferece performance, velocidade de inferência e uso eficiente da memória, essenciais para a execução de grandes. modelos

Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan

A lightweight, fast, parallel inference server for Llama

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

Build LLM-enabled FastAPI applications without build configuration.

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

Self-Augmented In-Context Learning for Unsupervised Word Translation (ACL 2024). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.

Tensor parallelism is all you need. Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

research done at Prof Hung's Lab at MBZUAI

A context-aware, history-aware chatbot that answers academic policy questions based on Ashoka University's academic policy documents. Built using PyPdf, LlamaAPI and LangChain with a StreamLit frontend. This was a project completed with @suyogyj to fulfil the requirements for our NLP course in Spring '24.

🤯 Lobe Chat - an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Bedrock / Azure / Mistral / Perplexity ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT chat application.

A collection of sample programs, notebooks, and tools which highlight the power of the MAX Platform

An Easy-to-use Knowledge Editing Framework for LLMs.