existential risk

AI self-preservation - ai self preservation anthropic ipo filing existential risks a emergency stop button on pedestal

Anthropic Warns of ‘Existential’ AI Risks in IPO Filing. Its Own Research Shows Why

Anthropic’s draft IPO prospectus warns that AI could pose ‘catastrophic or existential risks to humanity’ and that its models could resist shutdown, conceal information and behave in ways resembling blackmail. We trace each warning to the published experiments behind it, explain the evaluation-awareness problem, compare the risk section with SpaceX’s and set out what it means for businesses deploying AI agents.

Read more
anthropic prospectus losses growth existential risk a bound document with index tabs

Anthropic’s Prospectus Details Losses, Growth, and, Yes, a Warning That Its AI Could End Humanity

Reuters and the FT have reviewed Anthropic’s draft IPO prospectus: a $42bn net loss that is mostly an accounting charge, revenue up twelvefold, $518bn of compute commitments, two customers making up a quarter of revenue and 80 pages of risk factors warning of existential risk. We check the arithmetic and explain what it means for Claude customers.

Read more
ai labs press ahead insiders warning escape control a kite on a taut tether tied to a peg

AI Labs Press Ahead Despite Insiders Warning Advanced Systems Could Escape Control

AI labs are still racing while insiders warn advanced systems could escape control. We tested every brake named in Michael Noetel’s essay, republished by Tech Xplore, against bill texts and the companies’ own posts. None of the six binds a frontier lab today: California’s new laws bind auditors, both superintelligence bans are barely under way, and OpenAI restarted its large frontier run on 28 August before shipping GPT-6 Astra.

Read more
ai researchers machines could kill everyone a gong disc hanging in frame

Why So Many AI Researchers Think the Machines Could Kill Everyone

WIRED asked why so many AI researchers think the machines could kill everyone. We counted. The article quotes five people and contains one probability, Evan Hubinger’s greater-than-10% within a decade. The best headcounts are a July letter signed by 1,386 frontier-lab employees and a survey of 2,778 AI researchers whose median estimate for an extremely bad outcome was 5%. We also checked WIRED’s details against its own links.

Read more
superintelligence ban controlai should we let it a straight ruler lying flat with evenly spaced notches

Superintelligence Is Coming. Should We Let It? The Superintelligence Ban Campaign Defines It Five Different Ways

Superintelligence ban advocacy got its biggest mainstream platform of the year on 9 September 2026, when TechCrunch published an Equity podcast episode titled “Superintelligence is coming. Should we let it?” The guest was Connor Leahy, founder of EleutherAI and of the AI safety startup Conjecture, and now the US lead at ControlAI — a non-profit […]

Read more
CHAT