35Your ML monitoring is either too noisy to read or too quiet to trust. How do you design good alerts?▼mediumMetaGoogleStripe1 replies◆ premiumAn alert that fires constantly gets muted, and a model that fails with no alert is worse. Good ML alerting is a design problem with the same principles as SRE, plus ML-specific twists. Here is how to get it right.Open full answer →
52A model shipped bad predictions to production for six hours. Walk me through the incident response.▼mediumGoogleMetaStripe2 replies◆ premiumML incidents are slipperier than service outages: nothing crashed, the model was just wrong. The strong answer covers detection, mitigation, and a blameless postmortem that fixes the system, not the person.Open full answer →
