Course Lectures

You can download the lectures here. We will try to upload lectures prior to their corresponding classes.

Introduction

Introduction

Aug 25, 2026
tl;dr: Introduction to Deep Generative Models, History, and Applications

Update: syllabus slides updated with new TA office hour locations (Sep 3).

Suggested Readings (Intro Chapter, DGM Book):

  • History of AI
  • History of Generative Models
  • Advent of Deep Generative Models
  • Applications of Deep Generative Models
Background

Background

Aug 27, 2026
tl;dr: Basics of Probability and Statistics, Information Theory, Maximum Likelihood Estimation

Update: new slides uploaded (Sep 3).

Suggested Readings (Appendix A and B, GPCA Book):

  • Basics of Probability and Statistics
  • Basics of Information Theory
  • Discriminative vs. Generative Models
  • Basics of Maximum Likelihood Estimation
  • Basics of Optimization
Background

Background

Sep 01, 2026
tl;dr: Gaussian Parameter Estimation, Latent Variable Models

Update: new slides for lec 2-3 uploaded (Sep 3).

Suggested Readings (Appendix B and Section 2.2, GPCA Book):

  • Gaussian Parameter Estimation via MLE
  • Introduction to Latent Variable Models
  • Basics of Probabilstic Principal Component Analysis
Background

Background

Sep 03, 2026
tl;dr: Probabilistic Principal Component Analysis (PPCA)

Suggested Readings (Section 2.2, GPCA Book):

  • Probabilistic Principal Component Analysis (PPCA)
  • Application of PPCA to Generating Images of Faces
Probabilistic Principal Component Analysis

Probabilistic Principal Component Analysis

Sep 08, 2026
tl;dr: Probabilistic Principal Component Analysis (PPCA)

Suggested Readings (Section 2.2, GPCA Book):

  • Probabilistic Principal Component Analysis (PPCA)
  • Application of PPCA to Generating Images of Faces
Probabilistic PCA

Probabilistic PCA

Sep 08, 2026
tl;dr: Latent Variable Models, Variational Inference, Expectation Maximization

Suggested Readings (Appendix B, GPCA Book):

  • Latent Variable Models
  • Introduction to Variational Inference
  • Introduction to Expectation Maximization
  • Expectation Maximization for Gaussian Mixture Model
Probabilistic PCA

Probabilistic PCA

Sep 10, 2026
tl;dr: Probabilistic Principal Component Analysis (PPCA)

Suggested Readings (Section 2.2, GPCA Book):

  • Probabilistic Principal Component Analysis (PPCA)
  • Application of PPCA to Generating Images of Faces
Variational Inference and Expectation Maximization

Variational Inference and Expectation Maximization

Sep 15, 2026
tl;dr: VAE (reparameterization trick) - application and hands-on session

Suggested Readings:

  • Variational Auto-Encoders (VAEs)
  • Reparameterization Trick
Variational Auto Encoders

Variational Auto Encoders

Sep 17, 2026
tl;dr: Markov Models, MLE for Markov Models

Suggested Readings:

  • Introduction to Markov Models.
  • Maximum Likelihood Estimation for Markov Models.
Variational Auto Encoders

Variational Auto Encoders

Sep 22, 2026
tl;dr:

Suggested Readings:

  • Introduction to Hidden Markov Models.
  • Inference, Deccoding, and Learning for Hidden Markov Models.
    • The Viterbi Algorithm.
    • The Baum-Welch Algorithm.
Variational Auto Encoders

Variational Auto Encoders

Sep 24, 2026
tl;dr:

Suggested Readings:

  • Introduction to Linear Dynamical Systems.
  • Filtering and Smoothing for Linear Dynamical Systems.
  • State Estimation for Linear Dynamical Systems.
  • EM for Linear Dynamical Systems.
Markov Models

Markov Models

Sep 29, 2026
tl;dr:

Suggested Readings:

  • Introduction to Markov Models.
  • Maximum Likelihood Estimation for Markov Models.
Hidden Markov Models

Hidden Markov Models

Oct 06, 2026
tl;dr:

Suggested Readings:

  • Introduction to Hidden Markov Models.
  • Inference, Decoding, and Learning for Hidden Markov Models.
    • The Viterbi Algorithm.
    • The Baum-Welch Algorithm.
Linear Dynamical Systems

Linear Dynamical Systems

Oct 08, 2026
tl;dr:

Suggested Readings:

  • Introduction to Linear Dynamical Systems.
  • Filtering and Smoothing for Linear Dynamical Systems.
  • State Estimation for Linear Dynamical Systems.
Dynamic Textures

Dynamic Textures

Oct 13, 2026
tl;dr:

Suggested Readings:

  • Introduction to Dynamic Textures.
Recurrent Neural Networks

Recurrent Neural Networks

Oct 15, 2026
tl;dr:

Suggested Readings:

  • Introduction to Recurrent Neural Networks.
Recurrent Neural Networks and Attention Mechanisms

Recurrent Neural Networks and Attention Mechanisms

Oct 20, 2026
tl;dr:

Suggested Readings:

  • Recurrent Neural Networks and Attention Mechanisms.
Transformers

Transformers

Oct 22, 2026
tl;dr:

Suggested Readings:

  • Transformers.
Transformers for Text

Transformers for Text

Oct 22, 2026
tl;dr:

Suggested Readings:

  • Transformers for Text.
Diffusion Models

Diffusion Models

Oct 27, 2026
tl;dr:

Suggested Readings:

  • Diffusion Models.
Diffusion Models

Diffusion Models

Oct 29, 2026
tl;dr:

Suggested Readings:

  • Diffusion Models.
Diffusion Models

Diffusion Models

Nov 03, 2026
tl;dr:

Suggested Readings:

  • Diffusion Models.
Latent Diffusion Models

Latent Diffusion Models

Nov 05, 2026
tl;dr:

Suggested Readings:

  • Applications of Diffusion Models.
Image Editing with Diffusion Models

Image Editing with Diffusion Models

Nov 10, 2026
tl;dr:

Suggested Readings:

  • Image Editing with Diffusion Models.
Score Matching with Diffusion Models

Score Matching with Diffusion Models

Nov 12, 2026
tl;dr:

Suggested Readings:

  • Score Matching with Diffusion Models.
Transformers for Vision and Language

Transformers for Vision and Language

Nov 17, 2026
tl;dr:

Suggested Readings:

  • Transformers for Vision and Language.
Transformers for Vision and Language

Transformers for Vision and Language

Nov 19, 2026
tl;dr:

Suggested Readings:

  • Transformers for Vision and Language.
Flow Matching

Flow Matching

Nov 24, 2026
tl;dr:

Suggested Readings:

  • Flow Matching.
Flow Matching

Flow Matching

Dec 01, 2026
tl;dr:

Suggested Readings:

  • Flow Matching.
Flow Matching

Flow Matching

Dec 03, 2026
tl;dr:

Suggested Readings:

  • Flow Matching.