Regularisation for Deep models #
- Generalization for regression
- Training Error and Generalization Error
- Underfitting or Overfitting
- Model Selection
- Weight Decay and Norms
- Generalization in Classification
- Environment and Distribution Shift
- Generalization in Deep Learning
- Dropout
- Batch Normalization
- Layer Normalization
- Code implementation (webinar)
Reference #
- Dive into deep learning. Cambridge University Press.. (T1 – Ch 3.6, 3.7, T1 - Ch 4.6, 4.7, T1 - Ch 5.5, 5.6, T1 - Ch 8.5, T1 - Ch 11.7