Important Information
- Meeting times: Mondays and Wednesdays, 15:30-16:45
- Room: Engineering Technology Center Room 310
Required Materials
- UDL: Understanding Deep Learning, by Simon J.D. Prince, https://udlbook.github.io/udlbook/
Recommended Materials
- DLFC: Deep Learning Foundations and Concepts, by Bishop and Bishop, https://www.bishopbook.com
- DDL: Dive into Deep Learning, by Ashton Zhang, et. al., https://d2l.ai
- DL: Deep Learning, by Goodfellow, Bengio and Courville, https://www.deeplearningbook.org
- LDL: Learning Deep Learning, by Ekman, https://ldlbook.com
- NND: Neural Network Design, by Hagan, et. al., https://hagan.okstate.edu/nnd.html
- DLI: Deep Learning Illustrated, by Jon Krohn: https://www.deeplearningillustrated.com
- ITLA: Information Theory, Inference and Learning Algorithms, by David MacKay, http://www.inference.org.uk/mackay/itila/book.html
Schedule
| Date | Topics | Reading/Resources | Exercises | Assignments | Reminders |
|---|---|---|---|---|---|
| Foundations | |||||
| Week 1 | |||||
| 2025-01-06 | Course Introduction |
Syllabus Meet Prof. Simpkins |
|||
| 2025-01-08 | Machine Learning | UDL: 1, 2 |
Registration Ends (2025-01-10) Payment Deadline (2025-01-10) |
||
| Week 2 | |||||
| 2025-01-13 | Shallow Networks | UDL: 3 | |||
| 2025-01-15 | Deep Networks | UDL: 4 |
Assigned: PS1 Assigned: Project |
Financial Aid Disbursement (2025-01-17) Graduation Petition Deadline (2025-01-17) |
|
| Week 3 | |||||
| 2025-01-20 | MLK Jr Day - No Class | ||||
| 2025-01-22 | Deep Networks | UDL: 4 | Assigned: PA1 | ||
| Week 4 | |||||
| 2025-01-27 | Probability |
UDL: Appendix A DLFC: 2, 3 ITLA 1, 2 |
|||
| 2025-01-29 | Loss Functions | UDL: 5 |
Due: PS1 Assigned: PS2 |
||
| Week 5 | |||||
| 2025-02-03 | Fitting Models |
UDL: 6 UDL: Appendix B.5 DLFC: Appendix A DDL: 2.3-2.4 Matrix Cookbook |
|||
| 2025-02-05 | Gradients and Initialization | UDL: 7 | Due: Project Proposal | ||
| Week 6 | |||||
| 2025-02-10 | Measuring Performance | UDL: 8 | |||
| 2025-02-12 | Regularization | UDL: 9 | Due: PA1 | ||
| Week 7 | |||||
| 2025-02-17 | Midterm Review |
Midterm Practice Midterm Practice Answers |
Due: PS2 | ||
| 2025-02-19 | Midterm Exam | ||||
| Supervised Deep Learning | |||||
| Week 8 | |||||
| 2025-02-24 | Convolutional Networks | UDL: 10 |
Assigned: PS3 Assigned: PA2 |
||
| 2025-02-26 | Convolutional Networks | UDL: 10 | |||
| Week 9 | |||||
| 2025-03-03 | Residual Networks | UDL: 11 | |||
| 2025-03-05 | Transformers | UDL: 12 | |||
| Week 10 | |||||
| 2025-03-10 | Spring Break - No Class | ||||
| 2025-03-12 | Spring Break - No Class | ||||
| Week 11 | |||||
| 2025-03-17 | Transformers | UDL: 12 | |||
| 2025-03-19 | Graph Neural Networks | UDL: 13 | Due: Project Results | Midterm Grades Due (2025-03-21) | |
| Generative Deep Learning | |||||
| Week 12 | |||||
| 2025-03-24 | Generative Adversarial Networks | UDL: 14,15 | |||
| 2025-03-26 | Generative Adversarial Networks | UDL: 14,15 |
Due: PS3 Assigned: PS4 |
Withdrawal Deadline (2025-03-28) | |
| Week 13 | |||||
| 2025-03-31 | Normalizing Flows | UDL: 16 | |||
| 2025-04-02 | Variational Autoencoders | UDL: 17 |
Due: PA2 Assigned: PA3 |
||
| Week 14 | |||||
| 2025-04-07 | Diffusion Models | UDL: 18 | |||
| Beyond Deep Learning | |||||
| 2025-04-09 | Reinforcement Learning | UDL: 19 | |||
| Week 15 | |||||
| 2025-04-14 | Deep Learning Philosophy | UDL: 20 | |||
| 2025-04-16 | Deep Learning Ethics | UDL: 21 | Due: PA3 | ||
| Week 16 | |||||
| 2025-04-21 | Project Presentations | ||||
| 2025-04-23 | Project Presentations | Due: Final Project Paper | |||
| Week 17 | |||||
| 2025-04-28 | Final Exam Review | Due: PS4 | |||