Meet Switchyard: A Rust Proxy and Library That Routes and Translates LLM Traffic Across OpenAI and Anthropic APIs

Switchyard is a Rust proxy and library that routes requests across different large language model APIs, translating between OpenAI and Anthropic formats so clients can use their native API regardless of which backend processes the request. Teams using coding agents face the problem that different agents speak different API languages while the actual model they want to use sits behind a different service entirely, and Switchyard solves this by decoding inbound requests into provider-neutral types, selecting a backend through a routing algorithm, and re-encoding the response in the format the client expects. The tool supports four routing strategies: passthrough to a single target, random distribution across targets, LLM-classifier routing based on capability verdicts, and stage-router selection based on agent signals. Switchyard is currently pre-alpha and experimental, released under Apache 2.0 for evaluation only, with NVIDIA explicitly warning it is not suitable for production use.