← all releases
NVIDIA·Aug 11, 2026·v0.2.0·open source

Switchyard

Switchyard is a Rust-based proxy and library designed to route LLM traffic across various providers and models. It enables developers to maintain native OpenAI and Anthropic API compatibility while implementing flexible routing, benchmarking, and cost-optimization strategies.

LLMRustProxyAI Infrastructure
overview

Switchyard is a Rust-based proxy and library designed to route LLM traffic across various providers and models. It enables developers to maintain native OpenAI and Anthropic API compatibility while implementing flexible routing, benchmarking, and cost-optimization strategies.

key features
  • 01Protocol translation between OpenAI Chat, Anthropic Messages, and OpenAI Responses formats
  • 02Multi-backend routing with support for random, LLM-classifier, and stage-router algorithms
  • 03Operational metrics tracking including latency, token usage, and routing overhead via Prometheus
  • 04Flexible deployment options as a standalone proxy, CLI launcher, or embedded Rust library
  • 05Native compatibility with existing coding agents and OpenAI-compatible endpoints