Abstract for the talk on 30.04.2020 (17:00 h)Math Machine Learning seminar MPI MIS + UCLA
Quynh Nguyen (University Saarbruecken)
Loss surface of deep and wide neural networks
See the video of this talk.
What are possible properties of the loss function and how they might change with the size of the network are among the fundamental questions that one could study to improve our understanding of deep learning. In this talk, I will present some results that we have obtained along this direction, including a topological analysis of sub-level sets, critical points with global optimality, and then show how to leverage this insight to get a convergence result for gradient descent.