What is Decision 3.0? vLLM Semantic Router’s New Open Decision Models

Decision 3.0 is a set of open decision models that process text, JSON, and images to answer structured questions by returning probability scores rather than generated text. These models are designed to help developers classify, route, and filter requests without needing to parse text output. The models come in five sizes ranging from 0.8 billion to 27 billion parameters and are built on Qwen base models with integrated vision encoders. Performance improvements over the previous generation include a 9-billion-parameter model that outperforms the prior generation's 27-billion-parameter model on benchmark evaluations.