• Lecturer: Nihat Ay
• Date: Thursday 11:15 - 12:45
• Room: MPI MiS, A3 01
• Language: English
• Target audience: MSc students, PhD students, Postdocs
• Keywords: Neural networks, universal approximation, statistical learning theory, support vector machines, deep learning, information geometry
• Remarks: First lecture will take place on April 18, 2019.

Abstract

This is a continuation of the course that I taught during the winter term 2018/2019. My general aim is to review core mathematical concepts and results that play an important role within the fields of neural networks and machine learning. I already presented various models and architectures of neural networks, together with their corresponding universal approximation properties. I will continue the course by addressing aspects of learning and generalisation within the framework of statistical learning theory. The generality of this theory will be exemplified in the context of neural networks and support vector machines. Further theoretical approaches to learning, in particular gradient-based approaches, will be reviewed. Here, the information-geometric perspective of the natural gradient method will be highlighted.