AppliedAIPrep logoAppliedAI/Prep

contamination

Applied AI interview questions tagged contamination, across every topic.

2 questions · 1 unlocked for you
Open full answer →
Open full answer →

Concepts behind "contamination"

The curriculum that explains the ideas these questions test.

Core
📊 Evaluation & ML FoundationsSign in
Benchmarks and Their LimitsPublic benchmarks like MMLU give a shared yardstick, but they saturate, leak into training corpora, and stop tracking real ability once labs optimize for them. Contamination (test items in the training data) and Goodhart's law (a measure that becomes a target stops measuring) are why a high leaderboard score can be meaningless on your workload. Applied AI interviews probe this to see whether you trust a number or build a private eval set on your own distribution.
Explore the full curriculum →