Models & Releases

Liquid AI Releases LFM2.5-VL-3B-DSpark: Speculative Decoding for Vision-Language Models With Up to 3.13x Faster Decoding

Liquid AI has announced LFM2.5-VL-3B-DSpark, an experimental speculative-decoding draft model for its LFM2.5-VL-3B vision-language model. The drafter adds about 280M parameters and speeds up decoding without changing the model’s output. Liquid AI team reports up to 3.13x faster decoding on Apple silicon and up to 2.66x on an NVIDIA H100. Is it deployable? Yes, Weights are live on Hugging Face in Safetensors and GGUF, with day-one support in SGLang, MLX-VLM, and llama.cpp. Liquid AI tea

Get smart on it

Speculative decoding is a technique that speeds up vision-language models by using a smaller "drafter" model to propose multiple tokens ahead, which a larger model then verifies in one pass instead of generating tokens one at a time. A new drafter model has been released that adds about 280 million parameters to an existing vision-language model and achieves up to 3.13 times faster decoding on Apple silicon and up to 2.66 times faster on an NVIDIA H100. The drafter works by reading hidden states from the target model's layers and predicting the next several tokens, with the key insight being that the technique works regardless of whether the input is text or image data since both are represented as tensors in the hidden layers. The speedup is most noticeable during the decoding phase, while image encoding and initial processing remain at the same speed, which limits the total end-to-end acceleration especially on edge devices where these other steps take up a larger share of the total time.

Explainer: Why AI Is Getting Faster Without Getting Smarter: Speculative Decoding Explained

Read next
The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
Models & ReleasesOpen story →

Introducing GPT-6.2 Astra and Sol

Introducing GPT‑6.2 Astra and Sol, with better professional outputs, coding, computer use, and efficiency at lower cost across ChatGPT Work, Codex, and the API.

Also reported by MarkTechPost and SiliconANGLE

Models & ReleasesOpen story →

Introducing Gemini 4 Neon

Google's latest model aims to compete with rival systems in reasoning and multimodal capabilities as the AI arms race intensifies.

Also reported by SiliconANGLE and MarkTechPost

Models & ReleasesOpen story →

Alibaba launches Qwen4-Max with training, attention optimizations

Alibaba Group Holding Ltd. today introduced Qwen4-Max, its newest and most capable large language model. The algorithm not only generates higher-quality output than its predecessor but also costs less. Those improvements are the result of a new architecture, Qwen4, that made the LLM’s training run more efficient. Additionally, Alibaba has equipped the model with an […] The post Alibaba launches Qwen4-Max with training, attention optimizations appeared first on SiliconANGLE.

Models & ReleasesOpen story →

Rumble-2-Flash: an open 0.5B speech model for 40+ languages

Smaller open-source speech models could democratize voice AI for developers working with languages beyond English and major European tongues.

Also reported by SiliconANGLE

Models & ReleasesOpen story →

Genie 4 is now available

The latest version expands capabilities for developers building generative applications across different domains.

Models & ReleasesOpen story →

Microsoft rolls out new first-party models and updates to agentic AI continuous improvement

Microsoft Corp. today rolled out new generative artificial intelligence models and updates to Foundry, the company’s unified enterprise platform that helps developers and organizations ground, test and deploy AI applications and autonomous agents. Updates to Foundry IQ, part of Microsoft IQ, now provide an enterprise knowledge graph out of the box, delivering a full estate […] The post Microsoft rolls out new first-party models and updates to agentic AI continuous improvement appeared firs