10Design a click-through-rate (CTR) prediction system for ads ranking at scale.▼hard★ EssentialMetaGoogleAmazon2 repliesunlockedAds ranking is where calibrated probabilities meet hard latency and money. The signal is knowing that CTR must be calibrated (not just ranked), the feature and serving design, and the auction context. Here is the design that goes beyond 'train a classifier.'Open full answer →
82Design an evaluation framework for an ads ranking system.▼hardMetaGoogleAmazon2 replies◆ premiumSeparate offline gates (AUC, calibration, NDCG) from the online verdict (A/B with revenue and advertiser guardrails), plus counterfactual replay between.Open full answer →