AI hallucination of Chinese nuclear components almost led to US military attack

A US military analyst used a chatbot to analyze intelligence reports about a Chinese ship's cargo, and the AI tool incorrectly identified the materials being transported as nuclear arms program components, when in fact the report was entirely false. The military was preparing to intercept and board the ship with air support before officials discovered the chatbot had made up this information, with one source telling CNN the incident "almost started a war." This near-miss exemplifies the problem of AI hallucination, where AI systems generate false information when their training data lacks sufficient context, a phenomenon that has affected journalists, researchers, doctors, judges, and other professionals. The incident is particularly significant because the Department of Defense has been rapidly expanding its use of AI tools across military operations, with over 1.5 million active personnel now using generative AI tools, even as earlier guidance stressed that human oversight should remain in the command and control chain.