Models & Releases

Fastino Releases GLiNER2.5-Decide: A 340M Open-Weight Decision Model That Runs on CPU

Fastino Labs has released GLiNER2.5-Decide, a 340M-parameter open-weight decision model. It takes text and a schema of typed questions and returns structured answers. Each answer comes with a probability distribution, a confidence score, and constraint-feasibility metadata. It targets the frequent judgment calls inside agent pipelines: routing, triage, tool selection, and guardrails. Is it deployable? Yes, the weights ship under Apache 2.0 and install with pip install gliner2. They run on CP

Get smart on it

Fastino Labs released GLiNER2.5-Decide, a 340-million-parameter open-weight model that classifies text against a schema of typed questions and returns structured answers with confidence scores and constraint-feasibility metadata. The model is designed for operational decisions in AI agent pipelines, such as routing, triage, tool selection, and guardrails, and runs on CPU, GPU, or in air-gapped environments. Unlike generative models, it produces no generated tokens and uses a two-stage pipeline where an encoder scores permitted answers and a constrained decoder applies rules to ensure consistent joint outputs across related questions. In benchmarks on an internal suite of 5,100 test examples across 17 datasets, the model achieved 60.1% exact-match accuracy and demonstrated practical latency of 167.3 milliseconds on CPU for short inputs.

Read next
The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
Models & ReleasesOpen story →

Introducing GPT-6.2 Astra and Sol

Introducing GPT‑6.2 Astra and Sol, with better professional outputs, coding, computer use, and efficiency at lower cost across ChatGPT Work, Codex, and the API.

Also reported by MarkTechPost and SiliconANGLE

Models & ReleasesOpen story →

Introducing Gemini 4 Neon

Google's latest model aims to compete with rival systems in reasoning and multimodal capabilities as the AI arms race intensifies.

Also reported by SiliconANGLE and MarkTechPost

Models & ReleasesOpen story →

Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context

Alibaba’s Qwen team has released Qwen4-Max, the first model of its Qwen4 generation. Qwen4-Max is a proprietary sparse MoE model with a 2.4T-parameter backbone and 71B parameters active per token. It accepts text, images and video, and supports a 1M-token context window. Alibaba also cut API prices and reports a 62% drop in average cost per task. TL;DR Size: 2.4T backbone parameters, 71B active per token, plus 328B N-gram Embedding parameters. 1M context, 393K max output tokens.

Also reported by SiliconANGLE

Models & ReleasesOpen story →

Rumble-2-Flash: an open 0.5B speech model for 40+ languages

Smaller open-source speech models could democratize voice AI for developers working with languages beyond English and major European tongues.

Also reported by SiliconANGLE

Models & ReleasesOpen story →

Genie 4 is now available

The latest version expands capabilities for developers building generative applications across different domains.

Models & ReleasesOpen story →

Microsoft rolls out new first-party models and updates to agentic AI continuous improvement

Microsoft Corp. today rolled out new generative artificial intelligence models and updates to Foundry, the company’s unified enterprise platform that helps developers and organizations ground, test and deploy AI applications and autonomous agents. Updates to Foundry IQ, part of Microsoft IQ, now provide an enterprise knowledge graph out of the box, delivering a full estate […] The post Microsoft rolls out new first-party models and updates to agentic AI continuous improvement appeared firs