Course Lectures
You can download the lectures here. We will try to upload lectures prior to their corresponding classes.
Introduction and Background
Aug 26, 2025
tl;dr: Introduction to Deep Generative Models, History, and Applications
Suggested Readings (Intro Chapter, DGM Book):
- History of AI
- History of Generative Models
- Advent of Deep Generative Models
- Applications of Deep Generative Models
Maximum Likelihood Estimation
Aug 28, 2025
tl;dr: Basics of Probability and Statistics, Information Theory, Maximum Likelihood Estimation
Suggested Readings (Appendix A and B, GPCA Book):
- Basics of Probability and Statistics
- Basics of Information Theory
- Discriminative vs. Generative Models
- Basics of Maximum Likelihood Estimation
- Basics of Optimization
Classes of Generative Models
Sep 02, 2025
tl;dr: Gaussian Parameter Estimation, Latent Variable Models
Suggested Readings (Appendix B and Section 2.2, GPCA Book):
- Gaussian Parameter Estimation via MLE
- Introduction to Latent Variable Models
- Basics of Probabilstic Principal Component Analysis
Latent Variable Models
Sep 04, 2025
tl;dr: Latent Variable Models, Variational Inference, Expectation Maximization
Suggested Readings (Appendix B, GPCA Book):
- Latent Variable Models
- Introduction to Variational Inference
- Introduction to Expectation Maximization
- Expectation Maximization for Gaussian Mixture Model