Use your locally running AI models to assist you in your web browsing

A generalized information-seeking agent system with Large Language Models (LLMs).

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

Model swapping for llama.cpp (or any local OpenAPI compatible server)

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Run MemGPT-AutoGEN-Local LLM Together

The .NET library to build AI systems with 100+ LLM APIs: Anthropic, Azure, Cohere, DeepInfra, DeepSeek, Google, Groq, Mistral, Ollama, OpenAI, OpenRouter, Perplexity, vLLM, Voyage, xAI, and many more!

A nifty little library for working with Ollama in Elixir.

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

The PyVisionAI Official Repo

MVP of an idea using multiple local LLM models to simulate and play D&D

Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on different ports and loading/unloading them on demand

OpenLocalUI: Native desktop app for Windows, MacOS and Linux. Easily run Large Language Models locally, no complex setups required. Inspired by OpenWebUI's simplicity for LLM use.

Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.

Chat with your pdf using your local LLM, OLLAMA client.(incomplete)

The client for the Symmetry peer-to-peer inference network. Enabling users to connect with each other, share computational resources, and collect valuable machine learning data.

A local chatbot for managing docs

Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral

LLMProxy is an intelligent large language model backend routing proxy service.