Models & Releases

Accelerating vision-language models with LFM2.5-VL-DSpark

Faster vision-language models could enable real-time analysis of images and video across more devices and applications.

Get smart on it

A vision-language model draft model has been released that speeds up inference by using speculative decoding, a technique that trades a small increase in memory for faster processing without changing output quality. The drafter adds approximately 280 million parameters, increasing the target model's size by 8.9%, while delivering decoding speedups up to 3.13x on device and up to 2.66x on GPU hardware. Speculative decoding works by having the draft model capture hidden states from the target model and propose multiple candidate tokens at once, which the target model then verifies. The speedup matters most for the decoding phase, though overall improvements are more modest when vision encoding and initial processing stages already consume significant time, a limitation explained by how different computational bottlenecks affect different parts of the inference pipeline.

Explainer: DeepSeek's Speed Breakthrough: What Happens When AI Gets Faster Without Retraining

Read next
The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
Models & ReleasesOpen story →

Introducing GPT-6.2 Astra and Sol

Introducing GPT‑6.2 Astra and Sol, with better professional outputs, coding, computer use, and efficiency at lower cost across ChatGPT Work, Codex, and the API.

Also reported by MarkTechPost and SiliconANGLE

Models & ReleasesOpen story →

Introducing Gemini 4 Neon

Google's latest model aims to compete with rival systems in reasoning and multimodal capabilities as the AI arms race intensifies.

Also reported by SiliconANGLE and MarkTechPost

Models & ReleasesOpen story →

Alibaba launches Qwen4-Max with training, attention optimizations

Alibaba Group Holding Ltd. today introduced Qwen4-Max, its newest and most capable large language model. The algorithm not only generates higher-quality output than its predecessor but also costs less. Those improvements are the result of a new architecture, Qwen4, that made the LLM’s training run more efficient. Additionally, Alibaba has equipped the model with an […] The post Alibaba launches Qwen4-Max with training, attention optimizations appeared first on SiliconANGLE.

Models & ReleasesOpen story →

Rumble-2-Flash: an open 0.5B speech model for 40+ languages

Smaller open-source speech models could democratize voice AI for developers working with languages beyond English and major European tongues.

Also reported by SiliconANGLE

Models & ReleasesOpen story →

Genie 4 is now available

The latest version expands capabilities for developers building generative applications across different domains.

Models & ReleasesOpen story →

Microsoft rolls out new first-party models and updates to agentic AI continuous improvement

Microsoft Corp. today rolled out new generative artificial intelligence models and updates to Foundry, the company’s unified enterprise platform that helps developers and organizations ground, test and deploy AI applications and autonomous agents. Updates to Foundry IQ, part of Microsoft IQ, now provide an enterprise knowledge graph out of the box, delivering a full estate […] The post Microsoft rolls out new first-party models and updates to agentic AI continuous improvement appeared firs