AppliedAIPrep logoAppliedAI/Prep

gradient descent

Applied AI interview questions tagged gradient descent, across every topic.

3 questions · 1 unlocked for you
Open full answer →
Open full answer →
Open full answer →

Concepts behind "gradient descent"

The curriculum that explains the ideas these questions test.

Foundational
📊 Evaluation & ML Foundations
Gradient Descent and OptimizersGradient descent is how models learn: compute the gradient of the loss with respect to the parameters and step opposite it to reduce error. Mini-batch SGD (a small batch per step) is the workhorse, balancing stable gradients with speed and GPU parallelism. Momentum smooths the path, and Adam (momentum plus per-parameter adaptive rates) is the default. The learning rate is the most important knob, scheduled with warmup and decay. Applied-AI interviews probe it because it underlies all training and the failure modes (divergence, getting stuck) are diagnosable.
Explore the full curriculum →