Skip to main content
New Self-paced AI courses — learn ML, deep learning, and agents on your schedule. Enroll free

probability and statistics

Markov chains

Markov property, transition matrices, stationary distributions, mixing, HMMs.

5 lessons Follow in order
Use the button below to sign in and unlock lessons.
Your path

Lessons in sequence

Work through these in order—each lesson builds on the previous one.

  1. Lesson 1 of 5

    The Markov property

    Enroll to open · 6 min read

  2. Lesson 2 of 5

    Transition matrices

    Enroll to open · 7 min read

  3. Lesson 3 of 5

    Stationary distributions

    Enroll to open · 7 min read

  4. Lesson 4 of 5

    Mixing time and convergence

    Enroll to open · 7 min read

  5. Lesson 5 of 5

    Hidden Markov models — intro

    Enroll to open · 7 min read

← Back to course