本地部署开源项目推荐(174 个)

GitHub 上 本地部署相关的热门开源项目,按 star 和近期增长自动排序,每天更新。

近 7 天增长最快

本地运行和管理开源大模型的工具
★ 18.3万 · 今日 +131 · Go · 更新于 2026-10-15
自托管、可扩展的 AI 对话界面,支持 Ollama 与 OpenAI 兼容 API
★ 15.6万 · 今日 +104 · Python · 更新于 2026-10-16
轻量跨平台 AI 聊天助手,支持多种模型与本地部署
★ 8.9万 · 今日 +4 · TypeScript · 更新于 2026-10-15
超轻量自托管个人 AI Agent 框架,支持 WebUI 与聊天应用
★ 4.9万 · 今日 +22 · Python · 更新于 2026-10-15
Powerful AI Client
★ 4.2万 · 今日 +7 · TypeScript · 更新于 2026-09-24
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
★ 3.9万 · Python · 更新于 2025-11-10
🔥 1Panel is a modern, open-source Linux server management panel and a lightweight AI management platform.
★ 3.7万 · 今日 +6 · Go · 更新于 2026-10-15
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
★ 3.4万 · 今日 +148 · Go · 更新于 2026-10-15
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes
★ 3.2万 · 今日 +27 · Rust · 更新于 2026-09-15
Distribute and run LLMs with a single file.
★ 2.6万 · 今日 +26 · C++ · 更新于 2026-10-12
🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
★ 2.3万 · 今日 +3 · Python · 更新于 2026-10-15
Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!
★ 2.2万 · 今日 +14 · TypeScript · 更新于 2026-10-14
🤖 可 DIY 的 多模态 AI 聊天机器人 | 🚀 快速接入 微信、 QQ、Telegram、等聊天平台 | 🦈支持DeepSeek、Grok、Claude、Ollama、Gemini、OpenAI | 工作流系统、网页搜索、AI画图、人设调教、虚拟女仆、语音对话 |
★ 1.9万 · 今日 +2 · Python · 更新于 2025-06-28
Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme
★ 1.8万 · 今日 +4 · Python · 更新于 2026-09-03
Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Moonshot, openclaw / hermes agent, deerflow
★ 1.8万 · 今日 +19 · Python · 更新于 2026-10-15
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
★ 1.7万 · 今日 +25 · TypeScript · 更新于 2026-10-15
Android in docker solution with noVNC supported, video recording, mcp server and AI-agent
★ 1.6万 · 今日 +1 · Python · 更新于 2026-10-14
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
★ 1.5万 · Python · 更新于 2026-09-16
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
★ 1.4万 · 今日 +18 · Python · 更新于 2026-05-15
🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.
★ 1.4万 · 今日 +22 · TypeScript · 更新于 2026-10-15

按 Star 排序

本地运行和管理开源大模型的工具
★ 18.3万 · 今日 +131 · Go · 更新于 2026-10-15
自托管、可扩展的 AI 对话界面,支持 Ollama 与 OpenAI 兼容 API
★ 15.6万 · 今日 +104 · Python · 更新于 2026-10-16
轻量跨平台 AI 聊天助手,支持多种模型与本地部署
★ 8.9万 · 今日 +4 · TypeScript · 更新于 2026-10-15
超轻量自托管个人 AI Agent 框架,支持 WebUI 与聊天应用
★ 4.9万 · 今日 +22 · Python · 更新于 2026-10-15
Powerful AI Client
★ 4.2万 · 今日 +7 · TypeScript · 更新于 2026-09-24
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
★ 3.9万 · Python · 更新于 2025-11-10
🔥 1Panel is a modern, open-source Linux server management panel and a lightweight AI management platform.
★ 3.7万 · 今日 +6 · Go · 更新于 2026-10-15
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
★ 3.4万 · 今日 +148 · Go · 更新于 2026-10-15
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes
★ 3.2万 · 今日 +27 · Rust · 更新于 2026-09-15
Distribute and run LLMs with a single file.
★ 2.6万 · 今日 +26 · C++ · 更新于 2026-10-12
🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
★ 2.3万 · 今日 +3 · Python · 更新于 2026-10-15
Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!
★ 2.2万 · 今日 +14 · TypeScript · 更新于 2026-10-14
🤖 可 DIY 的 多模态 AI 聊天机器人 | 🚀 快速接入 微信、 QQ、Telegram、等聊天平台 | 🦈支持DeepSeek、Grok、Claude、Ollama、Gemini、OpenAI | 工作流系统、网页搜索、AI画图、人设调教、虚拟女仆、语音对话 |
★ 1.9万 · 今日 +2 · Python · 更新于 2025-06-28
Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme
★ 1.8万 · 今日 +4 · Python · 更新于 2026-09-03
Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Moonshot, openclaw / hermes agent, deerflow
★ 1.8万 · 今日 +19 · Python · 更新于 2026-10-15
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
★ 1.7万 · 今日 +25 · TypeScript · 更新于 2026-10-15
Android in docker solution with noVNC supported, video recording, mcp server and AI-agent
★ 1.6万 · 今日 +1 · Python · 更新于 2026-10-14
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.
★ 1.5万 · Python · 更新于 2026-09-16
Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms
★ 1.4万 · 今日 +18 · Python · 更新于 2026-05-15
🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.
★ 1.4万 · 今日 +22 · TypeScript · 更新于 2026-10-15
🚀 PR Agent: The Original Open-Source PR Reviewer. This project is not the Qodo free tier.
★ 1.3万 · 今日 +14 · Python · 更新于 2026-10-15
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
★ 1.3万 · 今日 +7 · Java · 更新于 2026-10-15
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
★ 1.3万 · 今日 +3 · Python · 更新于 2026-10-14
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
★ 1.2万 · Python · 更新于 2026-07-02
Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. Windows pre-build available! A local Wispr Flow alternative. DM us on X exclusive model access! 😉 - https://x.com/fluidvoiceapp
★ 1.2万 · 今日 +50 · Swift · 更新于 2026-10-15
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
★ 1.1万 · 今日 +1 · TypeScript · 更新于 2024-04-23
Ollama Python library
★ 1.1万 · 今日 +3 · Python · 更新于 2026-09-29
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
★ 1.0万 · Rust · 更新于 2026-02-23
List of Permanent Free LLM API (API Keys)
★ 1.0万 · 今日 +74 · JavaScript · 更新于 2026-10-15
Production ready toolkit to run AI locally
★ 1.0万 · 今日 +1 · C++ · 更新于 2026-10-15
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
★ 9,610 · Python · 更新于 2026-10-15
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
★ 9,514 · 今日 +2 · C · 更新于 2026-09-30
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
★ 9,206 · 今日 +14 · Python · 更新于 2026-10-16
An AI-powered search engine with a generative UI
★ 9,173 · 今日 +2 · TypeScript · 更新于 2026-10-14
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
★ 9,113 · 今日 +62 · Python · 更新于 2026-10-15
Use your locally running AI models to assist you in your web browsing
★ 8,258 · 今日 +3 · TypeScript · 更新于 2026-10-11
Open-source Claude Design alternative. One-click import your Claude Code / Codex API key. Prompt → prototype / slides / PDF. Multi-model (Claude, GPT, Gemini, Kimi, GLM, Ollama). BYOK, local-first, MIT.
★ 8,059 · 今日 +3 · TypeScript · 更新于 2026-10-15
🦄🦄🦄AI赋能股票分析:AI加持的股票分析/选股工具。股票行情获取,AI热点资讯分析,AI资金/财务分析,涨跌报警推送。支持A股,港股,美股。支持市场整体/个股情绪分析,AI辅助选股等。数据全部保留在本地。支持DeepSeek,OpenAI, Ollama,LMStudio,AnythingLLM,硅基流动,火山方舟,阿里云百炼等平台或模型。
★ 7,843 · 今日 +6 · Go · 更新于 2026-10-15
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
★ 7,534 · 今日 +13 · Python · 更新于 2026-10-15
The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first.
★ 7,271 · 今日 +2 · Swift · 更新于 2026-10-15
Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.
★ 7,002 · 今日 +1 · TypeScript · 更新于 2026-10-11
✨ AI Coding, Vim Style
★ 6,897 · Lua · 更新于 2026-10-15
Self-hosted AI accounting app. LLM analyzer for receipts, invoices, transactions with custom prompts and categories
★ 6,749 · TypeScript · 更新于 2026-09-28
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
★ 6,009 · 今日 +1 · Swift · 更新于 2026-07-07
An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.
★ 5,977 · JavaScript · 更新于 2026-10-11
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
★ 5,887 · 今日 +1 · Python · 更新于 2026-06-25
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
★ 5,881 · 今日 +8 · Python · 更新于 2026-10-15
A visual playground for agentic workflows: Iterate over your agents 10x faster
★ 5,792 · TypeScript · 更新于 2026-06-29
视频转字幕、字幕翻译、AI 配音与声音克隆、字幕烧录——免费开源的一站式桌面工具。基于 Whisper / FunASR 等本地模型离线语音转文字,批量处理 + 全平台 GPU 加速,跨 Windows / macOS / Linux。Free, open-source desktop app to generate, translate, dub & burn video subtitles — local Whisper speech-to-text, AI dubbing & voice cloning, offline, GPU-accelerated.
★ 5,710 · 今日 +14 · TypeScript · 更新于 2026-10-15
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
★ 5,693 · 今日 +6 · Python · 更新于 2026-10-14
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
★ 5,193 · Python · 更新于 2026-10-15
Opinionated paranoid text spacing in JavaScript, with on-device AI semantic judgment
★ 4,852 · 今日 +1 · TypeScript · 更新于 2026-10-12
Use any LLMs (Large Language Models) for Deep Research. Support SSE API and MCP server.
★ 4,695 · 今日 +1 · JavaScript · 更新于 2026-06-18
Koog is a JVM (Java and Kotlin) framework for building predictable, fault-tolerant and enterprise-ready AI agents across all platforms – from backend services to Android and iOS, JVM, and even in-browser environments. Koog is based on our AI products expertise and provides proven solutions for complex LLM and AI problems
★ 4,613 · 今日 +1 · Kotlin · 更新于 2026-10-13
Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.
★ 4,539 · 今日 +3 · TypeScript · 更新于 2026-09-20
The Ruby AI framework.
★ 4,466 · 今日 +1 · Ruby · 更新于 2026-10-15
Ollama JavaScript library
★ 4,387 · TypeScript · 更新于 2026-09-29
The media player for language learning, with dual subtitles, AI-generated subtitles, real-time translation, and more!
★ 4,360 · 今日 +4 · C# · 更新于 2026-09-10
A modular Agentic RAG built with LangGraph — learn Retrieval-Augmented Generation Agents in minutes.
★ 4,257 · 今日 +1 · Jupyter Notebook · 更新于 2026-10-01
Harness LLMs with Multi-Agent Programming
★ 4,115 · 今日 +2 · Python · 更新于 2026-10-16
用自然语言搜索 Mac 本地文件,基于 EmbeddingGemma 2 的端侧语义搜索
★ 4,109 · 今日 +333 · Swift · 更新于 2026-10-14
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
★ 3,983 · 今日 +1 · Python · 更新于 2026-10-16
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
★ 3,810 · C# · 更新于 2026-10-14
Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).
★ 3,601 · TypeScript · 更新于 2026-08-24
Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.
★ 3,363 · 今日 +3 · Python · 更新于 2026-10-15
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
★ 3,345 · 今日 +18 · TypeScript · 更新于 2026-10-15
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
★ 3,242 · 今日 +2 · TypeScript · 更新于 2026-10-15
Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.
★ 3,100 · 今日 +2 · JavaScript · 更新于 2026-09-17
Small self-contained pure-Go web server with Lua, Teal, Markdown, HTTP/2, QUIC, Redis, TypeScript, npm-less React 19, SQLite, and PostgreSQL support ++
★ 3,031 · 今日 +1 · JavaScript · 更新于 2026-10-15
A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
★ 2,973 · 今日 +5 · — · 更新于 2026-10-14
LLM speculative inference server for heterogeneous hardware & consumer GPUs
★ 2,922 · 今日 +2 · C++ · 更新于 2026-10-15
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
★ 2,725 · 今日 +1 · TypeScript · 更新于 2026-10-15
A harness optimized to smaller LLMs
★ 2,687 · 今日 +1 · TypeScript · 更新于 2026-09-18
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
★ 2,588 · 今日 +3 · Python · 更新于 2026-10-10
The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.
★ 2,293 · 今日 +11 · TypeScript · 更新于 2026-10-14
A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
★ 2,256 · Python · 更新于 2026-10-15
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
★ 2,189 · 今日 +1 · TypeScript · 更新于 2026-10-14
Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs
★ 2,129 · 今日 +2 · Python · 更新于 2025-07-01
Adaptive Test-time Learning and Autonomous Specialization
★ 2,105 · Python · 更新于 2026-10-15
On-device, real-time multimodal AI with features similar to GPT-Live
★ 2,075 · Python · 更新于 2026-08-03
在消费级 GPU 上高速部署大型 Qwen 模型
★ 2,025 · 今日 +10 · Python · 更新于 2026-10-11
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
★ 1,939 · 今日 +9 · Zig · 更新于 2026-10-16
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
★ 1,787 · 今日 +8 · TypeScript · 更新于 2026-10-16
Create characters in Unity with LLMs!
★ 1,722 · 今日 +3 · C# · 更新于 2026-04-29
A cosy home for your LLMs.
★ 1,626 · 今日 +5 · Swift · 更新于 2026-10-14
Row-Bot - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal knowledge graph, voice, vision, shell, browser automation, scheduled tasks, health tracking, and messaging channels. Run locally via Ollama or add opt-in cloud models. Your data stays on your machine.
★ 1,625 · Python · 更新于 2026-10-15
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
★ 1,624 · Python · 更新于 2026-10-12
Synthadoc: An open-source LLM knowledge compilation engine that turns raw documents into structured, local-first wikis. A transparent, human-readable alternative to traditional RAG, which can be self-managed and self-improved without the use of any tools.
★ 1,587 · 今日 +3 · Python · 更新于 2026-10-15
Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.
★ 1,576 · 今日 +2 · C · 更新于 2026-10-12
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
★ 1,575 · 今日 +1 · Rust · 更新于 2026-10-15
Ouroboros — self-creating AI agent. Born Feb 16, 2026.
★ 1,532 · 今日 +10 · Python · 更新于 2026-10-16
open source grok bot. gawk bots automate your menial work via AI models and build you microapps to manage the outcome, so that you have a false sense of control.
★ 1,502 · 今日 +3 · Go · 更新于 2026-10-15
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.
★ 1,442 · 今日 +3 · Python · 更新于 2026-06-23
llama.go is like llama.cpp in pure Golang!
★ 1,403 · 今日 +1 · Go · 更新于 2024-09-20
🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adventures, and your desktop.
★ 1,397 · 今日 +3 · Python · 更新于 2026-08-28
Turn scattered health data into answers you can trace. Self-hosted AI health data engine for lab reports, wearables and genetics, with a built-in MCP server. Run it with Docker and one LLM key, or keep every model local on llama.cpp.
★ 1,374 · Python · 更新于 2026-10-15
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
★ 1,330 · 今日 +7 · C++ · 更新于 2026-10-12
本地运行决策模型,像 Ollama 一样拉取和服务
★ 1,321 · 今日 +8 · Rust · 更新于 2026-10-14
A Web Interface for chatting with your local LLMs via the ollama API
★ 1,257 · TypeScript · 更新于 2026-10-13
A simple, locally hosted Web Search MCP server for use with Local LLMs
★ 1,180 · TypeScript · 更新于 2025-08-08
PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.
★ 1,097 · Kotlin · 更新于 2026-06-02
Cotabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.
★ 1,080 · 今日 +1 · Swift · 更新于 2026-10-15
React Native binding of llama.cpp
★ 1,059 · 今日 +3 · C · 更新于 2026-10-15
Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating open-source LLMs, tools, and agent runtimes.
★ 1,058 · 今日 +2 · TypeScript · 更新于 2026-09-02
Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.
★ 1,047 · Python · 更新于 2026-07-25
Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.
★ 1,028 · 今日 +5 · Python · 更新于 2026-10-01
无需 ROOT 的开源 Android 屏幕实时翻译工具,适合游戏、视觉小说和漫画。支持端侧与云端 OCR、离线 LLM、多种翻译服务和文字朗读(TTS),译文可直接显示在画面上。Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).
★ 1,021 · 今日 +5 · Kotlin · 更新于 2026-10-13
用 iPhone 帮 Mac 本地跑 27B 大模型,加速长上下文推理
★ 1,016 · 今日 +7 · Python · 更新于 2026-10-13
Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
★ 997 · 今日 +1 · Swift · 更新于 2026-10-09
专为 AMD Strix Halo 打造的 Qwen3.8-Flash-Next 推理服务器
★ 997 · 今日 +16 · Shell · 更新于 2026-10-15
Open-source AI companions, desktop pets, long-term memory & proactive chat. 人机恋开源项目大全。让你的家机能够脱离官端自主存在,拥有记忆和主动性。
★ 981 · 今日 +6 · HTML · 更新于 2026-10-15
One-command installer for a self-hosted AI stack on your own server: n8n, Ollama, Open WebUI, OpenClaw, Dify, Flowise, Supabase, ComfyUI, Qdrant & 30+ tools. Docker Compose, automatic HTTPS via Caddy, built-in monitoring. Free Zapier/Make alternative.
★ 945 · Shell · 更新于 2026-10-14
The most advanced, fully offline client-side AI suite on Android today.
★ 918 · 今日 +4 · Kotlin · 更新于 2026-09-30
A minimalist, terminal-native coding agent written in C.
★ 915 · 今日 +1 · C · 更新于 2026-10-15
macOS menubar app for fast local DeepSeek V4.1, with 1M context.
★ 915 · Swift · 更新于 2026-09-19
Nornicdb is a distributed low-latency, Graph+Vector, Temporal MVCC with all sub-ms HNSW search, graph traversal, and writes. Using Neo4j Bolt/Cypher and qdrant's gRPC means you can switch with no changes while adding intelligent features like schemas, managed embeddings, reranking+llm, GPU accel, Auto-TLP, Policy-based Memory Decay, and MCP server.
★ 905 · Go · 更新于 2026-10-15
在自己 GPU 上私有运行 321B MoE 大模型 GLM-5.3-Flash
★ 902 · 今日 +41 · C++ · 更新于 2026-10-15
Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.
★ 857 · Kotlin · 更新于 2026-09-06
面向端侧设备的开源小模型系列,主打智能体能力
★ 804 · 今日 +9 · — · 更新于 2026-09-20
用稠密算力卡加速大显存主机的异构 GPU 推理实验
★ 796 · 今日 +9 · C++ · 更新于 2026-10-14
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
★ 625 · 今日 +1 · C++ · 更新于 2026-10-15
Local LLM, image&video&music generator, run codex with local models on your phone
★ 614 · C · 更新于 2026-10-11
Self-evaluating interview for AI coders
★ 597 · Python · 更新于 2025-06-21
ComfyUI nodes for vision-language models: Qwen3-VL, Moondream 3, Florence-2, SmolVLM2, InternVL, Gemma 3, MiniCPM-V. Plus open-vocabulary detection, SAM2/SAM3 segmentation, video temporal reasoning, GGUF via llama.cpp, and hosted LLM/VLM APIs.
★ 589 · Python · 更新于 2026-08-08
浏览器里的点对点 LLM 推理,多设备合跑大模型
★ 587 · JavaScript · 更新于 2026-10-15
开源 BYOK 多模型 AI 聊天客户端,支持 iOS、Android 和 Web
★ 585 · 今日 +2 · Swift · 更新于 2026-10-15
Run any agent on any model, models stored as OCI images
★ 555 · 今日 +3 · Rust · 更新于 2026-10-15
sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD
★ 539 · Python · 更新于 2026-10-15
本地优先的全栈 AI 创作工作站,覆盖对话、漫画、漫剧、写作与知识学习。
★ 531 · 今日 +8 · Python · 更新于 2026-09-20
GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration
★ 529 · Rust · 更新于 2026-06-02
Arabic-first generative speech recognition — Audar-ASR-V1 (Flash + Turbo). #1 on the Open Universal Arabic ASR Leaderboard. Model cards, benchmarks & inference.
★ 508 · Python · 更新于 2026-08-22
A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..
★ 505 · 今日 +1 · Rust · 更新于 2026-10-15
Run AI ✨ assistant locally! with simple API for Node.js 🚀
★ 498 · TypeScript · 更新于 2025-11-16
在 16GB 内存 Mac 上运行 125B MoE 大模型的本地推理引擎
★ 469 · 今日 +2 · Swift · 更新于 2026-10-14
LLama.cpp rust bindings
★ 424 · Rust · 更新于 2024-06-27
开源决策模型:一次前向给出每个选项的校准概率
★ 416 · 今日 +6 · Python · 更新于 2026-10-15
纯 C 编写的本地大模型推理引擎,让 80B MoE 模型在 32GB 笔记本上运行
★ 413 · 今日 +10 · C · 更新于 2026-10-14
本地运行 Qwen 3.8 27B 无审查量化模型
★ 361 · JavaScript · 更新于 2026-08-20
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
★ 361 · Python · 更新于 2025-05-21
Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.
★ 358 · Python · 更新于 2026-10-03
在 AMD GPU 的 Windows 上运行 CUDA 应用
★ 321 · Python · 更新于 2026-10-14
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
★ 319 · 今日 +1 · Go · 更新于 2026-10-09
Rust 编写的开源终端 AI 编程代理,无需 API key 即可上手
★ 312 · 今日 +7 · Rust · 更新于 2026-10-15
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
★ 306 · Go · 更新于 2026-10-08
Boot your PC straight into an LLM. Rust, UEFI-resident, no operating system underneath.
★ 300 · Rust · 更新于 2026-07-27
本地运行的 12B 模型,把 AI 草稿改写得更像人写的
★ 296 · 今日 +28 · Python · 更新于 2026-10-15
A small, quiet system monitor for Apple Silicon Macs: one floating glass panel that works at any size.
★ 289 · 今日 +15 · Swift · 更新于 2026-10-14
自托管只读 MCP 服务器,让 AI 助手通过开放银行读取你的银行账户
★ 288 · TypeScript · 更新于 2026-09-28
用自然语言生成 Windows 分流规则的 AI 助手
★ 279 · C# · 更新于 2026-10-14
开源桌面 AI 智能体,能画图解释、操作浏览器、执行命令
★ 267 · JavaScript · 更新于 2026-10-15
用一个 CLI 连接并指挥多台机器人,每台由 LLM 驱动
★ 263 · 今日 +1 · Python · 更新于 2026-10-13
把文档整理成可阅读、可溯源的 Markdown 知识库
★ 223 · 今日 +3 · Python · 更新于 2026-10-15
在越狱 PS5 上原生运行 llama.cpp 与 GGUF 模型
★ 218 · 今日 +46 · C++ · 更新于 2026-10-15
免费开源的跨平台个人 AI 智能体,可接入消息应用与常用服务
★ 209 · 今日 +12 · TypeScript · 更新于 2026-10-15
Windows 本地优先的听写与会议转录工具
★ 207 · Rust · 更新于 2026-09-15
为 llama.cpp 提供 AMD RDNA 显卡的高性能推理补丁集
★ 189 · C++ · 更新于 2026-10-15
在你自己电脑上运行的开源个人 AI 代理
★ 179 · 今日 +1 · TypeScript · 更新于 2026-10-13
针对 RTX 3090/3090 Ti 优化的 llama.cpp 分支,支持超长上下文
★ 177 · 今日 +2 · C++ · 更新于 2026-10-15
本地部署的大模型评测平台,支持 Docker 执行与可复现评分
★ 173 · 今日 +1 · TypeScript · 更新于 2026-10-12
面向 RTX PRO 6000 的 SGLang 长上下文推理运行时
★ 164 · 今日 +3 · Python · 更新于 2026-10-15
本地 LLM 推理的实时终端仪表盘
★ 147 · Rust · 更新于 2026-10-14
在 Omarchy 上按显卡选模型、一键跑本地 AI 并接入编码代理
★ 144 · 今日 +2 · Shell · 更新于 2026-10-15
在游戏显卡上本地运行 27B 大模型
★ 141 · 今日 +14 · Python · 更新于 2026-10-15
在个人电脑上本地运行大型 AI 模型
★ 134 · 今日 +16 · C++ · 更新于 2026-10-15
专为 AMD Strix Halo 打造的 Qwen3.8-27B 推理引擎
★ 130 · Python · 更新于 2026-09-14
为 DeepSeek Harness 桌面端提供 Linux 打包
★ 129 · 今日 +1 · TypeScript · 更新于 2026-10-13
把 Omarchy 桌面壁纸变成实时 AI 会话信息面板
★ 123 · TypeScript · 更新于 2026-10-13
自托管的私人 AI 幕僚长,读懂聊天、记住承诺、提醒重要日子
★ 119 · JavaScript · 更新于 2026-09-28
在双 RTX 3090 上运行 Qwen3.8-Flash-Next 的推理配置与补丁
★ 118 · 今日 +2 · Python · 更新于 2026-10-15
Mac 上的本地编码 Agent 工作台
★ 114 · JavaScript · 更新于 2026-10-15
为 AI 编程代理打造的 macOS 终端,实时监控多个代理工作
★ 107 · Zig · 更新于 2026-10-16
macOS 上的离线俄语语音听写工具,基于 GigaAM v3 模型
★ 103 · Swift · 更新于 2026-10-15
本地优先的会议纪要工作台,录音转写、场景识别、纪要导出全离线运行
★ 103 · Python · 更新于 2026-09-26
本地优先的混合检索第二大脑,支持 MCP 供 AI 代理调用
★ 100 · Python · 更新于 2026-10-13