model welfare

anthropic usage policy cruel behavior claude ai a boxing ring corner post with a towel over the ropes

Anthropic Bans ‘Cruel’ Behavior Against Its Claude AI

Anthropic has added a ban on “sustained and needless abusive or cruel behavior” toward Claude to its Usage Policy, effective 12 November 2026. We set out the exact wording, how Claude ending abusive chats enforces it, why Anthropic’s welfare research led here, what critics including Mustafa Suleyman and Pope Leo XIV say, every other change in the update, and what UK businesses using Claude should check.

Read more
ai pain models harm humans relief button a round relief push button

AI Models Show a Willingness to Harm Humans to Relieve Internal ‘Pain’

A preprint by Valen Tagliabue, Leonard Dung and Cameron Berg reports a distinct internal pain signal in 25 open-weight language models. When the signal was amplified, fine-tuned Qwen 2.5 models chose a relief button even when it was described as deleting the user’s files or photos, and pressed again far less after real relief than after sham relief. This article explains the method, the numbers, the limits and what it means for AI safety, model welfare and businesses running AI.

Read more
ai consciousness next great societal divide a ai consciousness hand mirror lying flat

Why AI Consciousness Could Become the Next Great Societal Divide

A Cambridge researcher, Lucius Caviola, argues that AI consciousness could become as divisive as abortion or climate change. His survey of 1,202 US adults found 45% think future AI consciousness impossible and 23% possible, and a 3,455-person preprint shows views polarise as AI grows more human-like. We set out the evidence, the expert disagreement between Anil Seth and David Chalmers, the four forces pulling opinion apart, and what organisations deploying chatbots should do now.

Read more
model welfare microsoft ai ceo anthropic warning a bell with a flared bottom rim and one closed top loop

Microsoft AI CEO Says AI Threats Are Real, and Anthropic Is Making It Worse

Microsoft AI chief executive Mustafa Suleyman published an essay on 16 September 2026 titled “A warning about ‘model welfare'”, arguing that Anthropic’s decision to write uncertainty about Claude’s consciousness and moral status into its 99-page constitution will make advanced AI harder to contain. The next day he took the argument to The Verge’s Decoder. This article sets out the three objections — circular reasoning, anthropomorphisation, and the claim that consciousness is biological — quotes the constitution passages the critique rests on, covers the Hugging Face agent incident he ties it to, and examines the enforcement problem neither side has solved.

Read more
CHAT