AI Testing

ship contextqa regression testing pull requests a container ship stacked with cargo containers

Ship by ContextQA Automates Regression Testing on Pull Requests

ContextQA launched Ship on 5 October 2026, an AI “autonomous quality engineer” that maps each pull request’s blast radius, runs targeted regression tests against the deployed app before merge, reproduces bug reports and turns production anomalies into new tests. We explain how it works, how it compares with test-selection tools and AI code reviewers, what its $0.025 credits cost for three kinds of team, and how to run a fair 15-day trial.

Read more
AI red-teaming - ai red teaming what to test before launch a hexagonal shield upright

AI Red-Teaming: Essential Tests to Run Before a Safe Launch

Most AI systems reach launch having been tested only by people trying to make them work. Adversarial testing asks the other question: what happens when someone actively tries to make the system misbehave. This guide sets out what to test before go-live — how to scope the exercise and define harm in your own domain, the five attack classes that matter for business deployments, whether to run it internally, buy it in or automate it, how to score findings so severity cannot be renegotiated after the fact, which fixes actually hold, what the work costs in person-days and pounds, and the evidence pack that answers an enterprise security questionnaire and maps onto the EU AI Act, ISO 42001 and the NIST AI Risk Management Framework.

Read more
AI Agent Evaluation: Why Enterprise AI Has a Reality-Alignment Problem

AI Agent Evaluation: Why Enterprise AI Has a Reality-Alignment Problem

As enterprises increasingly adopt autonomous AI systems, the focus is shifting from building capable AI agents to ensuring they behave reliably in real-world environments. This is where AI agent evaluation becomes essential. While many organizations invest heavily in expanding test coverage and benchmarking AI performance, recent discussions within the industry suggest that the biggest challenge […]

Read more
CHAT