
“It’s important for service members to understand the uncertainty inherent to LLMs," a GovAI research scholar warns.
A military aircraft were already in the air during an armed operation against a Chinese vessel when U.S. officials discovered that the intelligence supporting the mission had been fabricated by an AI chatbot. A Special Operations Command analyst had used the chatbot to synthesize open source and classified intelligence, but the system misidentified the ship's cargo, then was used again to format the false findings into an official summary that circulated through command channels. The operation was aborted at the last minute, averting a potential conflict with China. This incident highlights a growing concern among military officials and experts: as decision-makers increasingly rely on AI systems, errors can move up the chain of command before being questioned. The Pentagon is racing to integrate AI to accelerate decision-making, but experts warn that this speed advantage may allow hallucinations to spread without sufficient human oversight, particularly in high-stakes decisions involving use of force.

As the US and China race to become the dominant power in the AI industry, the countries also appear to be figuring out ways to communicate on national security issues.

OpenAI CEO Sam Altman discusses AI safety, human control, and international cooperation in remarks to the United Nations Security Council.

Paolo Benanti tells WIRED that hysteria over whether godlike AI could destroy humanity is distracting from the need for public debate about how to govern the technology.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on Maven