Speaker
Bruno Loureiro
(École Normale Supérieure - PSL)
Description
Feature learning - or the capacity of neural networks to adapt to the data during training - is often quoted as one of the fundamental reasons behind their unreasonable effectiveness. Yet, making mathematical sense of this seemingly clear intuition is still a largely open question. In this talk, I will discuss a simple setting where we can precisely characterise how features are learned by a two-layer neural network during the very first few steps of training, and how these features are essential for the network to efficiently generalise under limited availability of data.
External references
- 25040093
- 892bdc65-1684-40f8-96ff-8ab8784aa5a3
