Models & Releases

Multi-Vector (Late Interaction) Embedding Models with Sentence Transformers

These models improve search accuracy by capturing multiple semantic meanings per word, helping systems better match user intent with relevant results.

Get smart on it

Sentence Transformers version 6.0 introduces a new model type called MultiVectorEncoder for multi-vector embedding models, which keep one vector per token instead of compressing entire texts into a single vector. Multi-vector models defer the interaction between query and document until scoring time using the MaxSim operator, which compares every query token against every document token to find the best matches. This approach preserves token-level matching information and performs better on queries requiring specific pieces of documents or multiple requirements at once, particularly on out-of-domain data, but the tradeoff is a substantially larger index size since one vector per token generates many more vectors than traditional single-vector models.

Read next
The biggest AI stories, once a day

One short email a day with the stories that matter. Free. Unsubscribe with one click.

Relevant courses

Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.

Browse AI courses on Maven
Related news
Models & ReleasesOpen story →

Alibaba Releases Qwen4-Max: 2.4T MoE, 71B Active, 1M Context

Alibaba’s Qwen team has released Qwen4-Max, the first model of its Qwen4 generation. Qwen4-Max is a proprietary sparse MoE model with a 2.4T-parameter backbone and 71B parameters active per token. It accepts text, images and video, and supports a 1M-token context window. Alibaba also cut API prices and reports a 62% drop in average cost per task. TL;DR Size: 2.4T backbone parameters, 71B active per token, plus 328B N-gram Embedding parameters. 1M context, 393K max output tokens.

Also reported by SiliconANGLE

Models & ReleasesOpen story →

Introducing Gemini 4 Hydrogen

Google's latest model aims to compete with other frontier AI systems in reasoning and multimodal capabilities across text, image, audio, and video.

Also reported by Ars Technica

Models & ReleasesOpen story →

Google’s latest Search upgrade promises better answers to your most complicated questions

Powered by Gemini 4 Hydrogen, Google's AI Mode is getting better at understanding complex queries, surfacing relevant links, and delivering richer visual responses.

Also reported by The Verge, SiliconANGLE, MarkTechPost and The Decoder

Models & ReleasesOpen story →

Bland Launches Tofu-1, a Full-Duplex Speech-to-Speech Model for Calls

Bland, the San Francisco voice-AI company, has released Tofu-1, a full-duplex speech-to-speech model in research preview. The Tofu-1 speech-to-speech model targets calls from moving cars, hospital rooms and weak-signal lines. It listens while it speaks and reasons while it talks. For phone-agent teams, one model now handles audio in and audio out, with no transcript between. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension. What is Tofu-1?

Models & ReleasesOpen story →

ElevenLabs Scribe v3 Live uses conversational context to stop voice agents from cutting off callers mid-sentence

ElevenLabs has released Scribe v3 and Scribe v3 Live, two new speech recognition models designed to transcribe accurately through background noise and crosstalk. Benchmarks from Artificial Analysis confirm that Scribe v3 narrowly beats competitors like OpenAI, Google, and Microsoft on accuracy. That precision comes at a cost, though. Rivals like Microsoft and xAI run many times faster and charge roughly half the price. The article ElevenLabs Scribe v3 Live uses conversational context to

Models & ReleasesOpen story →

Google Deepmind shifts genomics AI from bulk tissue predictions to single cell type resolution with AlphaGenome 2

Google Deepmind has unveiled AlphaGenome 2, an AI model that analyzes genetic variants for individual cell types rather than across bulk tissue. Trained on more than 107 million cell profiles, it identifies nearly twice as many disease-relevant gene changes as its predecessor. The model is available for noncommercial research through an API and is set to be integrated into Google's agentic platform Antigravity. The article Google Deepmind shifts genomics AI from bulk tissue predictions