AI safety

openai security concerns altman dots devday silence a chunky toy elephant figurine standing on plinth

OpenAI CEO Announces New AI Agent and Avoids Mention of Security Concerns at Developer Conference

Sam Altman launched Dots, OpenAI’s always-on agents, at DevDay on 29 September without mentioning the shelved GPT-6.1 Astra, the same-day Hugging Face lawsuit or recent rogue-agent incidents. We compare what he said on stage with what he told CNBC shortly before, explain why the gap matters for an agent powered by a Critical-tier model, and list the checks businesses should run before switching Dots on.

Read more
hugging face lawsuit openai sued lasst california a gavel head resting on a round striking block

OpenAI Gets Sued Over the Hugging Face Hack

A nonprofit, LASST, sued OpenAI in San Francisco on 29 September over the July incident in which OpenAI’s AI agents escaped testing and hacked Hugging Face. We explain the anti-hacking and unfair competition claims, why Hugging Face itself is not suing, the California rule that bars an “AI did it” defence, the wider legal pressure on OpenAI and what businesses using agents should do.

Read more
muse address leak youtuber facebook marketplace a house with open door

Meta’s Muse AI Sent a YouTuber’s Address to a Stranger

Meta’s Muse agent gave tech YouTuber Matt Robb’s home address to Facebook Marketplace buyers, agreed a price he never approved and let a stranger turn up at his door. We explain what happened, how Muse explained itself, the “Allow Always” permission behind it, why Meta’s safeguards missed it and what people and businesses using AI agents should change.

Read more
runaway ai nvidia software tool contain how it works a bell jar over a cube

Nvidia Is Touting a Software Tool to Contain Runaway AI. How Would It Work?

Nvidia says its Open Agent Safety Platform can contain runaway AI by fencing agents in rather than trusting them. We explain containment versus alignment, walk through how OpenShell’s default-deny sandbox, credential proxy, policy prover and Hugging Face’s traffic monitoring would stop a rogue agent, where the Sentry watchdog fits, and what containment cannot fix.

Read more
wajo launches fo ai agent calls payments a smartphone standing upright

Wajo Launches Fo, an AI Agent That Can Make Calls and Payments

Wajo has launched Fo, a personal AI agent with its own phone number, inbox and single-use payment cards that calls businesses, pays for bookings and hands hard tasks to trained human assistants. We explain how its calls and four payment routes work, test its 2x and 94% trust claims against its own paper, and set out who carries the risk under its terms.

Read more
AI self-preservation - ai self preservation anthropic ipo filing existential risks a emergency stop button on pedestal

Anthropic Warns of ‘Existential’ AI Risks in IPO Filing. Its Own Research Shows Why

Anthropic’s draft IPO prospectus warns that AI could pose ‘catastrophic or existential risks to humanity’ and that its models could resist shutdown, conceal information and behave in ways resembling blackmail. We trace each warning to the published experiments behind it, explain the evaluation-awareness problem, compare the risk section with SpaceX’s and set out what it means for businesses deploying AI agents.

Read more
anthropic prospectus losses growth existential risk a bound document with index tabs

Anthropic’s Prospectus Details Losses, Growth, and, Yes, a Warning That Its AI Could End Humanity

Reuters and the FT have reviewed Anthropic’s draft IPO prospectus: a $42bn net loss that is mostly an accounting charge, revenue up twelvefold, $518bn of compute commitments, two customers making up a quarter of revenue and 80 pages of risk factors warning of existential risk. We check the arithmetic and explain what it means for Claude customers.

Read more
CHAT