ScriptsMar 31, 2026·2 min read

AnythingLLM — All-in-One AI Knowledge Base

All-in-one AI app: chat with documents, RAG, agents, multi-user, and 30+ LLM/embedding providers. Desktop + Docker. Privacy-first, no setup needed. 57K+ stars.

TO
TokRepo精选 · Community
Quick Use

Use it first, then decide how deep to go

This block should tell both the user and the agent what to copy, install, and apply first.

Desktop app (easiest): Download from anythingllm.com — macOS, Windows, Linux.

Docker (self-hosted):

docker run -d -p 3001:3001 \
  -v anythingllm:/app/server/storage \
  mintplexlabs/anythingllm

Open http://localhost:3001, choose your LLM provider, and start chatting.


Intro

AnythingLLM is an all-in-one AI productivity app. Upload documents (PDF, DOCX, TXT, web pages) and chat with them using RAG. Supports 30+ LLM providers (OpenAI, Anthropic, Ollama, local models), 15+ embedding engines, and 10+ vector databases. Includes AI agents with tool use, multi-user workspaces, and a built-in API. Privacy-first with on-device processing. 57,000+ GitHub stars, MIT licensed.

Best for: Teams and individuals who want a private ChatGPT + document Q&A without complex setup Works with: OpenAI, Anthropic, Ollama, LM Studio, Google, Azure, Groq, Together, Perplexity


Key Features

Document Chat (RAG)

Upload any file and ask questions. Supports PDF, DOCX, TXT, CSV, audio, video, web pages, and GitHub repos.

30+ LLM Providers

OpenAI, Anthropic Claude, Ollama (local), LM Studio, Azure, Google Gemini, Groq, Together, Perplexity, and more.

AI Agents

Built-in agents with web browsing, code execution, file management, and RAG search tools.

Multi-User Workspaces

Create separate workspaces with different documents and permissions. Role-based access control.

Desktop App

Native desktop application — no Docker or terminal needed. Download and run.

Privacy-First

  • Documents processed locally (no data sent to cloud unless you choose a cloud LLM)
  • Full offline mode with Ollama
  • Self-hosted Docker deployment

Developer API

Full REST API for embedding AnythingLLM into your own applications.


FAQ

Q: What is AnythingLLM? A: An all-in-one AI app for chatting with documents, RAG, AI agents, and multi-user workspaces. Supports 30+ LLM providers. 57K+ GitHub stars, MIT licensed.

Q: Can I use it fully offline? A: Yes, pair AnythingLLM with Ollama for a completely offline setup — no internet required after initial model download.


🙏

Source & Thanks

Created by Mintplex Labs. Licensed under MIT. Mintplex-Labs/anything-llm — 57,000+ GitHub stars

Related Assets