Skip to main content
New Self-paced AI courses — learn ML, deep learning, and agents on your schedule. Enroll free

Mathematics for machine learning

Stochastic optimization

SGD, mini-batches, variance reduction, and adaptive methods.

5 lessons Follow in order
Use the button below to sign in and unlock lessons.
Your path

Lessons in sequence

Work through these in order—each lesson builds on the previous one.

Sign in to learn

  1. Lesson 1 of 5

    SGD fundamentals

    Enroll to open · 8 min read

  2. Lesson 2 of 5

    Mini-batch trade-offs

    Enroll to open · 7 min read

  3. Lesson 3 of 5

    Variance reduction

    Enroll to open · 8 min read

  4. Lesson 4 of 5

    Adam and adaptive learning rates

    Enroll to open · 8 min read

  5. Lesson 5 of 5

    SGD in deep learning

    Enroll to open · 8 min read

← Back to course