What is Jan?
Jan is an open-source desktop AI app that runs LLMs locally. ChatGPT-like interface, fully offline, with an OpenAI-compatible API.
In one sentence: Open-source local AI desktop app — one-click model download, offline chat, OpenAI-compatible API, supports Llama/Mistral/Gemma — 26k+ stars.
For: Developers prioritizing privacy or needing local AI.
Core Features
1. One-Click Download
Built-in model hub for Llama, Mistral, Gemma, and more.
2. Local API
OpenAI-compatible API at localhost:1337 for integration with other tools.
3. Cross-Platform
Mac (Metal acceleration), Windows (CUDA), Linux.
FAQ
Q: Hardware requirements? A: 7B models need at least 8GB RAM; 16GB+ recommended.
Q: Can it serve as Claude Code backend? A: Yes — Jan exposes an OpenAI-compatible API.