1-bit LLM

prismml tiny llm bonsai 2 27b on device ai a prismml bonsai tree in a shallow pot

PrismML Hopes Its Tiny LLM Will Change How We All Use AI

PrismML, a Caltech spin-out, has released Ternary Bonsai 2 27B, a compressed Qwen3.8 27B that fits in 5.9 GB and retains 98.2% of the original’s aggregate benchmark score. We break down where it keeps and loses capability, the memory arithmetic behind the 9x claim, speed and energy figures, the Apple talks, where early coverage disagrees with the company, and what on-device models mean for businesses.

Read more
CHAT