Artificial Intelligence

ai benchmarks tests grade ai wrong a carnival high striker with a bell and mallet

The Tests That Grade AI May Be Getting It Wrong

Two Stanford-led studies for COLM 2026 test AI benchmarks the way psychologists test exams. Across 56 benchmarks and 53 models, safety tests with the same label often disagreed, capability tests blurred together, and the scoring format mattered more than the topic. We explain the findings and what they mean for choosing a model.

Read more
safety case altman openai wont go public until models safe a stone arch with a raised keystone

Sam Altman Says OpenAI Won’t Go Public Until Its Models Are Safe

Sam Altman told CNBC and reporters at DevDay on 29 September 2026 that OpenAI has no IPO timeline and must first run a few safety cases and be able to make confident safety claims. We explain what a safety case is, how Anthropic and Google DeepMind use the term, what OpenAI’s own documents call the same thing, why the claim is harder to make to public investors, and how to tell when the condition has been met.

Read more
AI self-regulation - ai self regulation trump touts ai boss pledge a stepped pyramid of four tiers

Trump Touts AI Boss Pledge to Self-Regulate

President Trump and six technology bosses signed a one-page White House accord on 29 September 2026 promising four layers of controls and audits for frontier systems. We set out the text word for word, who signed and who only came to lunch, what the pledge leaves out, how it compares with the 2023 voluntary commitments, the EU AI Act and California SB 53, and what buyers should ask their suppliers.

Read more
CHAT