UDL = Understanding Deep Learning
| Class # | Date | Topic | Reading | Assignment | Due |
| 1 | Tue, Jan 16 | campus closed | n/a | ||
| 2 | Thu, Jan 18 | Class Introduction | Syllabus UDL CH 1 | ||
| 3 | Tue, Jan 23 | Multi-Layer Neural Networks Background: Python Basics | UDL CH 2,3 Introduction to Python for Programmers (optional) | ||
| 4 | Thu, Jan 25 | Deep Neural Networks and Computing Gradients | UDL 4, 6.1 | ||
| 5 | Tue, Jan 30 | Backpropagation Algorithm | UDL 7 | ||
| 6 | Thu, Feb 1 | Our Computational Environment on Schooner a First Network Implementation | Be ready to ssh into Schooner and edit files UDL 6.3-6.6 | HW 0 | |
| 7 | Tue, Feb 6 | Training Deep Networks Expanding our First Network Implementation | UDL 8 | ||
| 8 | Thu, Feb 8 | Regularization Techniques | UDL 9 | HW 0 | |
| 9 | Tue, Feb 13 | Holistic Cross-Validation | n/a | HW 1 | |
| 10 | Thu, Feb 15 | Convolutional Neural Networks: Introduction | UDL 10-10.1 | ||
| 11 | Tue, Feb 20 | Convolutional Neural Networks: Details | UDL 10.2-10.4 | HW 2 | HW 1 |
| 12 | Thu, Feb 22 | Convolutional Neural Networks Image Classification | UDL 5-5.1, 5.4-5.7,10.5-10.6 | ||
| 13 | Tue, Feb 27 | Data Handling in TensorFlow | tf.data: A Machine Learning Data Processing Framework | ||
| 14 | Thu, Feb 29 | Homework 2 introduction | n/a | HW 3 | HW 2 |
| 15 | Tue, Mar 5 | Residual Networks Tensorflow Model API | UDL 11 | ||
| 16 | Thu, Mar 7 | U-Nets and Semantic Segmentation | Understanding Semantic Segmentation with UNets | ||
| 17 | Tue, Mar 12 | Recurrent Neural Networks: Introduction | Tutorial: Power of Recurrent Neural Networks | HW 4 | HW 3 |
| 18 | Thu, Mar 14 | Recurrent Neural Networks: Examples | Tutorial: Types of Recurrent Neural Networks | ||
| - | Tue, Mar 19 | Spring Break | |||
| - | Thu, Mar 21 | Spring Break | |||
| 19 | Tue, Mar 26 | Recurrent Neural Networks: Attention | UDL 12-12.2 | ||
| 20 | Thu, Mar 28 | Transformer Networks I | UDL 12.3-12.6 Transformer: Self Attention | HW 5 | HW 4 |
| 21 | Tue, Apr 2 | Transformer Networks II | UDL 12.7-12.9 The Illustrated Transformer | ||
| 22 | Thu, Apr 4 | Visual Transformers | UDL 12.10-12.11 | HW 6 | HW 5 |
| 23 | Tue, Apr 9 | Generative Adversarial Networks | UDL 14, 15-15.3 | ||
| 24 | Thu, Apr 11 | GAN Variations | UDL 15..4-15.7 | HW 7 | HW 6 |
| 25 | Tue, Apr 16 | Normalizing Flows | UDL 16 | ||
| 26 | Thu, Apr 18 | Autoencoders | UDL 17 | ||
| 27 | Tue, Apr 23 | Diffusion Models | UDL 18 | HW 8 | HW 7 |
| 28 | Thu, Apr 25 | Probabilistic Neural Networks | Adding Uncertainty to Neural Network Regression Tasks in the Geosciences | ||
| 29 | Tue, Apr 30 | Autoencoders for Discovery of Dynamics | Data-Driven Discovery of Coordinates and Governing Equations | ||
| 30 | Thu, May 2 | A Step Back | UDL 20 | HW 8 | |
| Tue, May 7 | No final exam | n/a |
Back to Main Web Page