Important Information
- Meeting times: Mondays and Wednesdays, 15:30-16:45
- Room: Engineering Technology Center Room 310
Required Materials
- UDL: Understanding Deep Learning, by Simon J.D. Prince, https://udlbook.github.io/udlbook/
Recommended Materials
- DLFC: Deep Learning Foundations and Concepts, by Bishop and Bishop, https://www.bishopbook.com
- DDL: Dive into Deep Learning, by Ashton Zhang, et. al., https://d2l.ai
- DL: Deep Learning, by Goodfellow, Bengio and Courville, https://www.deeplearningbook.org
- LDL: Learning Deep Learning, by Ekman, https://ldlbook.com
- NND: Neural Network Design, by Hagan, et. al., https://hagan.okstate.edu/nnd.html
- DLI: Deep Learning Illustrated, by Jon Krohn: https://www.deeplearningillustrated.com
- ITLA: Information Theory, Inference and Learning Algorithms, by David MacKay, http://www.inference.org.uk/mackay/itila/book.html
Schedule
| Date | Topics | Reading/Resources | Exercises | Assignments | Reminders |
|---|---|---|---|---|---|
| Foundations | |||||
| Week 1 | |||||
| 2025-01-06 | Course Introduction |
Syllabus Meet Prof. Simpkins |
|||
| 2025-01-08 | Machine Learning | UDL: 1, 2 |
Registration Ends (2025-01-10) Payment Deadline (2025-01-10) |
||
| Week 2 | |||||
| 2025-01-13 | Shallow Networks | UDL: 3 | |||
| 2025-01-15 | Deep Networks | UDL: 4 |
Assigned: PS1 Assigned: Project |
Financial Aid Disbursement (2025-01-17) Graduation Petition Deadline (2025-01-17) |
|
| Week 3 | |||||
| 2025-01-20 | MLK Jr Day - No Class | ||||
| 2025-01-22 | Deep Networks | UDL: 4 | Assigned: PA1 | ||
| Week 4 | |||||
| 2025-01-27 | Workshop | ||||
| 2025-01-29 | Probability |
UDL: Appendix A DLFC: 2, 3 ITLA 1, 2 |
Assigned: PS2 | ||
| Week 5 | |||||
| 2025-02-03 | Loss Functions | UDL: 5 | Due 2025-02-04:PS1 | ||
| 2025-02-05 | Loss Functions | UDL: 5 | |||
| Week 6 | |||||
| 2025-02-10 | Fitting Models |
UDL: 6 UDL: Appendix B.5 DLFC: Appendix A DDL: 2.3-2.4 Matrix Cookbook |
Due: Project Proposal | ||
| 2025-02-12 | Gradients and Initialization | UDL: 7 | Due 2025-02-13: PA1 | ||
| Week 7 | |||||
| 2025-02-17 | Midterm Review |
Midterm Review Midterm Review Answers |
Due: PS2 | ||
| 2025-02-19 | Midterm Exam | ||||
| Week 8 | |||||
| 2025-02-24 | Midterm Grades Review | ||||
| 2025-02-26 | Measuring Performance | UDL: 8 | |||
| Week 9 | |||||
| 2025-03-03 | Regularization | UDL: 9 | |||
| 2025-03-05 | PyTorch Workshop | ||||
| Week 10: Spring Break | |||||
| 2025-03-10 | Spring Break - No Class | ||||
| 2025-03-12 | Spring Break - No Class | ||||
| Supervised Deep Learning | |||||
| Week 11 | |||||
| 2025-03-17 | Convolutional Networks | UDL: 10 | |||
| 2025-03-19 | Convolutional Networks | UDL: 10 | Midterm Grades Due (2025-03-21) | ||
| Week 12 | |||||
| 2025-03-24 | Residual Networks | UDL: 11 | |||
| 2025-03-26 | Residual Networks | UDL: 11 | |||
| Generative Deep Learning | |||||
| Week 13 | |||||
| 2025-03-31 | Transformers |
UDL: 12 Attention is All You Need |
Assigned: PS3 | ||
| 2025-04-02 | Transformers |
UDL: 12 Attention is All You Need |
|||
| Week 14 | |||||
| 2025-04-07 | Transformers |
UDL: 12 Attention is All You Need |
|||
| 2025-04-09 | Graph Neural Networks | UDL: 13 | Due 2025-04-11: Project Results | ||
| Week 15 | |||||
| 2025-04-14 | Deep Reinforcement Learning | UDL: 19 | Assigned: PS4 | ||
| 2025-04-16 | Deep Reinforcement Learning | UDL: 19 | |||
| Week 16 | |||||
| 2025-04-21 | Project Presentations | ||||
| 2025-04-23 | Project Presentations | ||||
| Week 17 | |||||
| 2025-04-28 | Final Exam Review |
Due: PS4 Final Project Paper |
|||
| Week 18 | |||||
| 2025-05-05 | Final Exam, 15:30-17:30 | ||||