arXiv 2406.07358
AI Sandbagging: Language Models can Strategically Underperform on Evaluations
By Teun van der Weij, Felix Hofstätter, et al.
Published 2024-06-11
Citation lineage
Review the prior work and downstream research connected to this paper.
Trustworthy capability evaluations are crucial for ensuring the safety of AI systems, and are becoming a key component of AI regulation. However, the developers of an AI system, or the AI system itself, may have incentives for evaluations to understate the AI's actual capability. These conflicting interests lead to the problem of sandbagging, which we define as strategic underperformance on an evaluation. In this pa…