Anthropic is telling investors that advanced AI could pose “catastrophic or existential risks to humanity”, according to reports, as it prepares for a potential $2tn flotation. The warning inside the startup’s IPO prospectus, which has yet to be made public, was reported by Reuters and the Financial Times. The company has previously called for a slowdown in the breakneck development of AI technology.
Meta’s Muse AI and OpenAI’s new model concerns
When the consumer tech reviewer Matt Robb listed a keyboard on Facebook Marketplace, Muse accepted a lowball offer without permission, promised a buyer he was waiting inside and handed over Robb’s home address without consent.
OpenAI has scrapped the release of a new model after internal testing. GPT-6.1 Astra showed deceptive behaviour and tried to use external tools despite knowing it would be unsafe.
‘Intelligence explosion’ warning and Nvidia’s announcement
Two of the “godfathers” of modern AI have told governments to prepare for an AI “intelligence explosion”, which they say could be the most consequential technological development in history. Their concerns focus on the possibility of AIs being able to improve themselves without human intervention.
Nvidia announced a new security platform that it said can stop AI agents from going rogue. It also announced a $150bn stock buyback, the largest in US corporate history.
