arXiv 2406.07358
AI Sandbagging: Language Models can Strategically Underperform on Evaluations
By Teun van der Weij, Felix Hofstätter, et al.
Published 2024-06-11
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Trustworthy capability evaluations are crucial for ensuring the safety of AI systems, and are becoming a key component of AI regulation. However, the developers of an AI system, or the AI system itself, may have incentives for evaluations to understate the AI's actual capability. These conflicting interests lead to the problem of sandbagging, which we define as strategic underperformance on an evaluation. In this pa…