PrivateGPT

PrivateGPT is an API-first RAG framework. While it has a UI, its primary usage is as a private developer library to build local document search pipelines. The core architecture is completely dedicated to semantic, private file ingestion and querying. The application exposes a comprehensive local API and SDK for developers to build private AI applications.

It gives users:

• Standard messages API (streaming, async, token counting)
• File and artifact ingestion
• Retrieval with citations and agentic RAG
• Built-in tools mirroring the Claude API (web search, web fetch, code execution)
• Custom tools and MCP connectors
• Structured access to databases and CSVs
• Embeddings and orchestration

PrivateGPT is free and open source, and requires a running OpenAI-compatible LLM server (e.g. Ollama).