13.01.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Yuan Cao (University of California, LA)
• Towards Understanding and Advancing the Generalization of Adam in Deep Learning
• see video

20.01.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Philipp Petersen (University of Vienna)
• Optimal learning in high-dimensional classification problems
• see video

20.01.2022, 18:30 Uhr, Deep Learning Theory Group Seminar

• Ruhui Jin (University of Texas at Austin)
• Tensor-structured sketching for constrained optimizations

21.01.2022, 17:00 Uhr, Deep Learning Theory Group Seminar

• Tiffany Vlaar (University of Edinburgh)
• to be announced

27.01.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Daniel Russo (Columbia University)
• Adaptivity and Confounding in Multi-armed Bandit Experiments
• see video

04.02.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Song Mei (University of California, Berkeley)
• The efficiency of kernel methods on structured datasets
• see video

10.02.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Hui Jin (University of California, Los Angeles)
• Learning curves for Gaussian process regression with power-law priors and targets
• see video

17.02.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Maksim Velikanov (Skolkovo Institute of Science and Technology)
• Spectral properties of wide neural networks and their implications to the convergence speed of different Gradient Descent algorithms

24.02.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Danijar Hafner (Google Brain & University of Toronto)
• General Infomax Agents through World Models
• see video
• see slides

03.03.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Marco Mondelli (Institute of Science and Technology Austria)
• Gradient Descent for Deep Neural Networks: New Perspectives from Mean-field and NTK
• see video
• see slides

04.03.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Daniel McKenzie (UCLA)
• Implicit Neural Networks: What they are and how to use them.
• see video

10.03.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Gergely Neu (Universitat Pompeu Fabra, Barcelona)
• Generalization Bounds via Convex Analysis
• see video

11.03.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Uri Alon (CMU)
• Bottlenecks, over-squashing, and attention in Graph Neural Networks.
• see video

17.03.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Gabin Maxime Nguegnang (RWTH Aachen University)
• Convergence of gradient descent for learning deep linear neural networks
• see video

24.03.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Ohad Shamir (Weizmann Institute of Science)
• Implicit bias in machine learning
• see video
• see slides

31.03.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Benjamin Eysenbach (Carnegie Mellon University & Google Brain)
• The Information Geometry of Unsupervised Reinforcement Learning
• see video

07.04.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Chaoyue Liu (Ohio State University)
• Transition to Linearity of Wide Neural Networks
• see video

14.04.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Christoph Lampert (Institute of Science and Technology, Austria)
• Robust and Fair Multisource Learning
• see video

21.04.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Berfin Şimşek (Ecole Polytechnique Fédérale de Lausanne (EPFL))
• The Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetry-Induced Saddles and Global Minima Manifold
• see video
• see slides

05.05.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Noam Razin (Tel Aviv University)
• Generalization in Deep Learning Through the Lens of Implicit Rank Minimization
• see slides

12.05.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Zixiang Chen (UCLA)
• Benign Overfitting in Two-layer Convolutional Neural Networks
• see video
• see slides

19.05.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Sayan Mukherjee (MPI MiS, Leipzig + Universität Leipzig)
• Inference in dynamical systems and the geometry of learning group actions
• see video

26.05.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Melikasadat Emami (UCLA)
• Asymptotics of Learning in Generalized Linear Models and Recurrent Neural Networks
• see video

02.06.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Tan Nguyen (UCLA)
• Principled Models for Machine Learning
• see video

09.06.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Guang Cheng (UCLA)
• Nonparametric Perspective on Deep Learning
• see video

16.06.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Jingfeng Wu (Johns Hopkins University)
• A Fine-Grained Characterization for the Implicit Bias of SGD in Least Square Problems
• see video
• see slides

07.07.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Sebastian Kassing (University of Bielefeld)
• Convergence of Stochastic Gradient Descent for analytic target functions
• see video
• see slides

14.07.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Rong Ge (Duke University)
• Towards Understanding Training Dynamics for Mildly Overparametrized Models
• see video

21.07.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Mark Schmidt (University of British Columbia)
• Optimization Algorithms for Training Over-Parameterized Models
• see video
• see slides

28.07.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Arash A. Amini (UCLA)
• Target alignment in truncated kernel ridge regression
• see video

04.08.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Wei Hu (University of California, Berkeley)
• More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize
• see video
• see slides

12.08.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Francesco Di Giovanni (Twitter)
• Over-squashing and over-smoothing through the lenses of curvature and multi-particle dynamics
• see video
• see slides

18.08.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Aditya Golatkar (UCLA)
• Selective Forgetting and Mixed Privacy in Deep Networks
• see video

25.08.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Melanie Weber (Harvard University)
• Exploiting geometric structure in (matrix-valued) optimization
• see video

08.09.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Devansh Arpit (Salesforce)
• Optimization Aspects that Improve IID and OOD Generalization in Deep Learning
• see video
• see slides

15.09.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Lisa Maria Kreusser (University of Bath)
• Wasserstein GANs Work Because They Fail (to Approximate the Wasserstein Distance)
• see slides

22.09.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Gintare Karolina Dziugaite (Google Brain)
• Deep Learning through the Lens of Data
• see video

06.10.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Felix Dietrich (Technical University of Munich)
• Learning dynamical systems from data
• see video

13.10.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Chao Ma (Stanford University)
• Implicit bias of optimization algorithms for neural networks: static and dynamic perspectives
• see video
• see slides

20.10.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Joe Kileel (University of Texas at Austin)
• The Effect of Parametrization on Nonconvex Optimization Landscapes
• see video

27.10.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Lechao Xiao (Google Brain)
• Eigenspace restructuring: A Principle of space and frequency in neural networks
• see video

03.11.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Itay Safran (Purdue University)
• On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias
• see video

10.11.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• El Mehdi Achour (IMT Toulouse)
• The loss landscape of deep linear neural networks: A second-order analysis
• see video
• see slides

17.11.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Sebastian Goldt (SISSA Trieste)
• On the importance of higher-order input statistics for learning in neural networks

01.12.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Levon Nurbekyan (UCLA)
• Efficient natural gradient method for large-scale optimization problems
• see video

08.12.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Mojtaba Sahraee-Ardakan (UCLA)
• Equivalence of Kernel Methods and Linear Models in High Dimensions
• see video

15.12.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Nicolás García Trillos (University of Wisconsin-Madison)
• Analysis of adversarial robustness and of other problems in modern machine learning
• see video
• see slides

16.12.2022, 17:00 Uhr, Math Machine Learning seminar MPI MIS + UCLA

• Jona Lelmi (University of Bonn)
• Large data limit of the MBO scheme for data clustering
• see video
• see slides