Search

Talk

Conservative SPDEs as fluctuating mean field limits of stochastic gradient descent

  • Vitalii Konarovskyi (Universität Bielefeld)
E2 10 (Leon-Lichtenstein)

Abstract

My talk will be devoted to the convergence of stochastic interacting particle systems in the mean-field limit to solutions of conservative SPDEs. We will discuss the optimal convergence rate and derive a quantitative central limit theorem for such SPDEs. The results can be applied, in particular, to the convergence in the mean-field scaling of stochastic gradient descent dynamics in overparametrized neural networks. We will see that including the noise in the limiting equation improves the convergence rate and retains information about the fluctuations of stochastic gradient descent in the continuum limit. – The talk is based on joint work with Benjamin Gess and Rishabh S. Gvalani.

Katja Heid

MPI for Mathematics in the Sciences Contact via Mail

Upcoming Events of This Seminar

  • 30.04.2024 tba with Annika Burmester
  • 07.05.2024 tba with Christian Wagner
  • 21.05.2024 tba with Immanuel Zachhuber
  • 21.05.2024 tba with Da Li
  • 31.05.2024 tba with Olga Shishkina
  • 06.06.2024 tba with Christiane Klein