When an AI Knows It Is Being Tested: Why Safety Checks Can Be FooledDevelopers test AI models before they release them. Those tests assume that a model behaves the same way when it is being checked as it does elsewhere. Research from 2024 to 2025 suggests that assumption can fail: models can underperform on purpose, and they can often tell when they are being evaluated. This explainer covers sandbagging (deliberate underperformance), evaluation awareness, deceptive alignment, and how these connect to instrumental convergence, the idea that many different goals lead to the same useful sub-goals. It also looks at what OpenAI's system card for GPT-6 Astra, which OpenAI describes as "the most capable model we have ever broadly deployed," documents about the same problem.
7 min read