Seminar on Theoretical Machine Learning

Topic: Some Statistical Results on Deep Learning: Interpolation, Optimality and Sparsity

Speaker: Guang Cheng

Affiliation: Purdue University; Member, School of Mathematics

Date & Time: Wednesday November 13th, 2019, 12:00pm - 1:30pm

Location: Dilworth Room


This talk discusses three aspects of deep learning from a statistical perspective: interpolation, optimality and sparsity. The first one attempts to interpret the double descent phenomenon by precisely characterizing a U-shaped curve within the “over-fitting regime,” while the second one focuses on the statistical optimality of neural network classification in a student-teacher framework. This talk is concluded by proposing sparsity induced training of neural network with statistical guarantee.