LiteLLM

LiteLLM is an open-source AI gateway and large language model (LLM) proxy for platform teams. It provides an OpenAI-compatible application programming interface (API) that centralizes access to LLM providers, agent tools, and Model Context Protocol (MCP) servers.