Machine Learning School

M10-DEEP-LEARN: Deep Learning

11h 0min
Motivational examples: the deep learning boom; why depth helps; challenges to deep learning, modern deep learning; deep learning architectures; regularization in deep learning + popular tricks

Main Content
Acquisition
1 Lecture content
Content: – Motivational examples; – Why use deep neural nets: the intuition; – Why depth helps; – Neural nets can learn to preprocess; – Visualization of a deep embedding; – The challenges to deep learning in the past + modern deep learning; – Deep learning architectures; – Convolution; – Evolution of different components: ResNet, etc. – Regularization in deep learning: early stopping, dropout, BatchNorm, ... – Popular tricks: – Augmentation; – Transfer learning; – Label smoothing; – ...

2h 0min
Practice
2 Colab Notebooks
A set of colab notebooks, regarding especially these topics: – A model pretrained on ImageNet; – Training a CNN on MNIST; – Transfer learning; – Regularization in deep learning; – Illustration of popular building blocks, tricks, etc. – ...

3h 0min
0
Investigation
3 Independent study time + review
The estimated additional time required for studying the material independently, using the lecture videos/slides and also referencing other literature and material, as necessary. Facilitates correct understanding of the material. This activity also includes the time required for review before exams.

5h 30min
Assessment
4 Quiz activities
Quiz activities meant to provide quick, unassessed feedback to students regarding their grasp of the material.

30 min