Welcome to the website for the Deep Learning Theory Summer School at Princeton 2021. The school will run remotely from July 27 to August 4, 2021 and is aimed at graduate students interested in the theory of deep learning. The primary goal is to showcase, through three main courses and a variety of short talks, a range of exciting developments. An important secondary goal is to connect young researchers and foster a closer community within theoretical machine learning. All graduate students with a technical background are to apply.
There will be three principle courses. Each course will consist of five one-hour lectures as well as pre-readings, problem sets, and TA sessions. These courses are:
Modern Machine Learning and Deep Learning Through the Prism of Interpolation
Instructor: Misha Belkin (UCSD Halicioglu)
Deep Learning: a Statistical Viewpoint
Instructor: Andrea Montanari (Stanford)
Pre-Readings:    Linear algebra at a somewhat advanced level (eigenvalues inequalities, perturbation theory etc), high dimensional probability (e.g. Chapters 1-6 in Vershynin), and classical statistical learning theory is welcome but not required (e.g. Ben-David and Shalev-Shwartz).
Effective Theory of Deep Learning: Beyond the Infinite-Width Limit
Pre-Readings:    Chapters 0-2 in this book.
There will also be a number of individual talks from researchers in industry and academia, including Ben Adlam (Google), Leon Bottou (Facebook), Ethan Dyer (Google), Gintare Karolina Dziugaite (Element AI), Suriya Gunasekar (MSR), Guy Gur-Ari (Google), Daniel Park (Google), Jeffrey Pennington (Google), Marc'Aurelio Ranzato (Facebook), David Schwab (CUNY), Atlas Wang (Austin), Greg Yang (MSR).
Graduate students in any technical discipline with a strong interest in theory are encouraged to apply, and prior experience in deep learning is not required. To submit an application for this summer school, please send a CV and brief statement of interest (one page or less) to firstname.lastname@example.org. Also, please arrange for one letter of recommendation to be sent on your behalf to the same address. Full consideration will be given to applications completed by March 31, 2021.