Course Lectures
You can download the lectures here. We will try to upload lectures prior to their corresponding classes.
Introduction
Update: syllabus slides updated with new TA office hour locations (Sep 3).
Suggested Readings (Intro Chapter, DGM Book):
- History of AI
- History of Generative Models
- Advent of Deep Generative Models
- Applications of Deep Generative Models
Background
Update: new slides uploaded (Sep 3).
Suggested Readings (Appendix A and B, GPCA Book):
- Basics of Probability and Statistics
- Basics of Information Theory
- Discriminative vs. Generative Models
- Basics of Maximum Likelihood Estimation
- Basics of Optimization
Background
Update: new slides for lec 2-3 uploaded (Sep 3).
Suggested Readings (Appendix B and Section 2.2, GPCA Book):
- Gaussian Parameter Estimation via MLE
- Introduction to Latent Variable Models
- Basics of Probabilstic Principal Component Analysis
Background
Suggested Readings (Section 2.2, GPCA Book):
- Probabilistic Principal Component Analysis (PPCA)
- Application of PPCA to Generating Images of Faces
Probabilistic Principal Component Analysis
Suggested Readings (Section 2.2, GPCA Book):
- Probabilistic Principal Component Analysis (PPCA)
- Application of PPCA to Generating Images of Faces
Probabilistic PCA
Suggested Readings (Appendix B, GPCA Book):
- Latent Variable Models
- Introduction to Variational Inference
- Introduction to Expectation Maximization
- Expectation Maximization for Gaussian Mixture Model
Probabilistic PCA
Suggested Readings (Section 2.2, GPCA Book):
- Probabilistic Principal Component Analysis (PPCA)
- Application of PPCA to Generating Images of Faces
Variational Auto Encoders
Suggested Readings:
- Introduction to Markov Models.
- Maximum Likelihood Estimation for Markov Models.
Variational Auto Encoders
Suggested Readings:
- Introduction to Hidden Markov Models.
- Inference, Deccoding, and Learning for Hidden Markov Models.
- The Viterbi Algorithm.
- The Baum-Welch Algorithm.
Variational Auto Encoders
Suggested Readings:
- Introduction to Linear Dynamical Systems.
- Filtering and Smoothing for Linear Dynamical Systems.
- State Estimation for Linear Dynamical Systems.
- EM for Linear Dynamical Systems.
Dynamic Textures
Suggested Readings:
- Introduction to Dynamic Textures.
Recurrent Neural Networks
Suggested Readings:
- Introduction to Recurrent Neural Networks.
Recurrent Neural Networks and Attention Mechanisms
Suggested Readings:
- Recurrent Neural Networks and Attention Mechanisms.
Transformers for Text
Suggested Readings:
- Transformers for Text.
Latent Diffusion Models
Suggested Readings:
- Applications of Diffusion Models.
Image Editing with Diffusion Models
Suggested Readings:
- Image Editing with Diffusion Models.
Score Matching with Diffusion Models
Suggested Readings:
- Score Matching with Diffusion Models.
Transformers for Vision and Language
Suggested Readings:
- Transformers for Vision and Language.
Transformers for Vision and Language
Suggested Readings:
- Transformers for Vision and Language.
Flow Matching
Suggested Readings:
- Flow Matching.
Flow Matching
Suggested Readings:
- Flow Matching.
Flow Matching
Suggested Readings:
- Flow Matching.