51Is a model's chain-of-thought faithful to its actual reasoning, and why does it matter?▼hardAnthropicOpenAIGoogle2 replies◆ premiumChain-of-thought looks like the model showing its work, but it may not reflect the real computation. The signal is knowing CoT can be a post-hoc story, with evidence, and what that breaks for safety and oversight.Open full answer →
77Two of your features are highly correlated. Does it hurt the model, and what do you do about it?▼mediumMetaAmazonDatabricks1 replies◆ premiumThe textbook reflex ('drop one') is usually the wrong instinct, and whether collinearity matters at all hinges on your model and what you need from it. This is the answer that separates rote from understanding.Open full answer →
84Stakeholders ask which features drive your model. Why is feature importance misleading, and what do you use instead?▼mediumDatabricksMetaAmazon2 replies◆ premiumThe built-in importance scores from XGBoost can rank a random ID above a vital feature, and stakeholders will make decisions on that bar chart. Here is why default importance lies and what a careful answer reports instead.Open full answer →
120Compare SHAP and LIME for explaining model predictions. What does SHAP guarantee that LIME does not?▼mediumGoogleMicrosoftAmazon2 replies◆ premiumBoth explain a single prediction by attributing it to features, but only one rests on a uniqueness theorem. The signal is knowing SHAP's game-theory guarantees, LIME's instability, and when each is the right tool. Here is the answer.Open full answer →
121Explain integrated gradients for attribution. Why use it over raw gradients, and how do you pick the baseline?▼hardGoogleGoogle DeepMindNVIDIA1 replies◆ premiumRaw gradient saliency maps are noisy and saturate. Integrated gradients fixes both with two axioms and a path integral, but the baseline choice quietly decides the answer. Here is what a careful candidate explains.Open full answer →
11What is the difference between explainability and interpretability, and how do you explain a model's decision?▼mediumGoogleMicrosoftIBM2 replies○ sign inRegulators and enterprises increasingly demand explanations for AI decisions, and the two terms get used loosely. The signal is separating inherently interpretable models from post-hoc explanations and naming the right technique for the stakes.Open full answer →