42Why does the learning rate matter so much, and how do warmup and decay schedules help?▼mediumNVIDIAGoogleOpenAI1 replies◆ premiumThe learning rate is the one hyperparameter that can NaN your run on step 50 or stall it forever. Modern training schedules it instead of fixing it. The signal is knowing exactly what warmup and decay each buy you. Here is the answer.Open full answer →
31What is model cold-start / warmup in serving, and how do you handle it for autoscaling?▼mediumAmazonMicrosoftGoogle1 replies◆ premiumA freshly started replica is slow on its first requests while it loads weights and compiles kernels, and that clashes with reactive autoscaling. The signal is naming the cold-start sources and the warmup and provisioning fixes.Open full answer →
