NVIDIA Dynamo

NVIDIA Dynamo is open-source AI Model Serving & Inference software for multi-GPU and multi-node large language model (LLM) inference. It is the orchestration layer above inference engines: it does not replace SGLang, NVIDIA TensorRT-LLM, or vLLM. It coordinates those engines into one cluster that loads trained weights, runs prefill and decode, and returns tokens through an OpenAI-compatible HTTP API. A single model on a single GPU does not need Dynamo; the engine alone is enough.