Vercel Labs open-sources agent-desktop tool
MarkTechPost: Vercel Labs Open-Sources agent-desktop for Agent Computer Use
Vercel Labs has released agent-desktop, an open-source CLI for AI agent computer use on macOS, Windows and Linux. agent-desktop reads each app through the operating system’s accessibility tree, not through screenshots. An agent gets a JSON snapshot with a ref for every element it can act on. Version 1.0.2 shipped on October 30, 2026, under Apache-2.0. For developers, any shell-capable coding agent can now drive native apps without a vision model. TL;DR Library: Rust CLI and a C lib
Get smart on it
agent-desktop is an open-source tool that allows AI agents to control desktop applications by reading the operating system's accessibility tree rather than analyzing screenshots. This approach reduces the number of tokens required to operate applications, with reported reductions of 78 to 96 percent on dense applications compared to screenshot-based methods. The tool works headlessly by default, meaning it can operate applications without moving the cursor or stealing focus from the user. It runs on macOS, Windows, and Linux and is available for free under an open-source license.
Relevant courses
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenRelated news
An AI Agent Injected Drugs Into a Live Mouse’s Brain
A biotech startup let an agent choose a gene therapy and successfully inject the treatment, offering a startling glimpse of the future of research labs.
Sam Altman sympathizes with mathematicians, but says OpenAI’s math onslaught won’t stop
After months of bombarding mathematicians with a relentless stream of AI-generated results, OpenAI CEO Sam Altman says he sympathizes with researchers struggling to make sense of it all. But he has no intention of stopping - and hints there could be much more to come from the company's stockpile of discoveries. "I think, on net, the world deserves to understand how the universe works," Altman said during an episode of the Cheeky Pint podcast released Thursday. "But I do have e
AI agents cut critical research time for humanitarian teams in conflict zones
Humanitarian groups working in conflict zones are finding that agentic AI can shorten the research cycle between a crisis and an informed response. Cloudera Inc. has built its AI strategy around deployment flexibility, and one nonprofit partner is testing that approach on the front lines. But the aim is to give analysts a faster starting […] The post AI agents cut critical research time for humanitarian teams in conflict zones appeared first on SiliconANGLE.
Chrome’s AI-powered Autofill can now dig through your Gmail to fill out forms
The autofill update lets Chrome pull flight confirmations, tracking info, order details, and other information from your inbox, with your permission.
Also reported by The Verge
You can generate and edit Google Docs files directly in Gemini chats now
Now you can generate, preview, and edit PDFs, Google Docs, Google Sheets, slide decks, Markdown files, TXT files, and code directly within Google Gemini. The new file editing capabilities are available starting today for all Gemini users, and while PDF previews/editing works on both the web and mobile, all other file formats are only in the web version for now. Google added support for generating and downloading files in Gemini earlier this year, but now you can tweak those fil
Microsoft’s AI future has fewer jobs
To anyone listening closely to what Microsoft CEO Satya Nadella has been saying over the past couple of years, this week felt like the clearest sign yet that AI is about to fundamentally change the size of Microsoft's workforce. Microsoft is now offering voluntary buyouts to around 60,000 employees across the US, UK, Canada, and India. It's the first time the company has presented such an offer to so many employees, expanding greatly upon the retirement offer that was limited t