Events
Benchmarks in Leipzig
Published June 8, 2026
Designed by mathematics researchers for mathematics researchers, this hands-on event brought together participants to collaboratively develop research-level benchmarks aimed at exploring the limitations and capabilities of rapidly advancing AI models for mathematical reasoning.
The program combined practical sessions on prompting and benchmark design with collaborative working groups. Participants formulated, refined, and tested research-level mathematical problems. They also discussed the current landscape of AI in mathematics and reflected on what makes a problem genuinely challenging for today’s models.
The focus of the project was the interactive platform Science Bench, which was used to compile a dataset of research-level mathematics questions with known solutions.
The researchers evaluated 100 benchmark questions in three stages. After five state-of-the-art models attempted the questions in stage one, 41 questions remained unsolved. After additional 20 runs of the best three of those models in stage two, 16 questions remained unsolved. And after the final three runs of two "deep think" models, all except two questions were solved.
To share the outcomes with a broader community, the project leaders report the results - which are largely based on the contributions of the 35 participants of the Benchmark Conference, as well as the work of 14 external researchers – in a recent arXive article.
The evaluation results demonstrate that the mathematical reasoning capabilities of large language models are becoming increasingly impressive.
Organizers
Veronica Calvo Cortes
Max Planck Institute for Mathematics in the Sciences
E-Mail
Christian Stump
Ruhr-Universität Bochum
E-Mail
Bernd Sturmfels
Max Planck Institute for Mathematics in the Sciences
E-Mail
Publication
-
arxiv.org
Benchmarks in Leipzig - published on arXiv
Further Information
-
math.sciencebench.ai
Science Bench Platform - designed by Christian Stump
-
See more
Benchmarks in Leipzig - Conference website
Editorial Contact
Staff
Jana Gregor
/
Events
05.07.26
Algomanet Summer School 2026 Algomanet Summer School 2026
The Algomanet Summer School 2026 brought together early-career researchers from across Europe in Leipzig. A diverse program of lectures, exercises, and discussion sessions provided in-depth insights into recent developments in extremal combinatorics and fostered scientific exchange within the network.
Events
08.06.26
Benchmarks in Leipzig Benchmarks in Leipzig
How can AI be used in mathematical research? Recently, 35 scientists gathered at our institute for a workshop exploring how the scientific community can help shape and advance our understanding of the capabilities of large language models in research-level mathematics.
Events
13.03.26
Felix Klein – Insights from the Outside Felix Klein – Insights from the Outside
To celebrate International Day of Mathematics, we warmly invite you to the film premiere: "Felix Klein – Insights from the Outside". Join us on Friday, March 13, 2026, at 6 p.m. at Cinestar Leipzig/Petersbogen to honor the life and work of Felix Klein. Admission free!
Events
02.12.25
Dies Academicus at Leipzig University Dies Academicus at Leipzig University
On the occasion of the 616th Dies Academicus, the Faculty of Mathematics and Computer Science invites you to a festive colloquium on December 2, 2025.
Events
27.11.25
GTML 2025: Connecting Geometry, Topology, and Machine Learning GTML 2025: Connecting Geometry, Topology, and Machine Learning
The GTML 2025 workshop brought together a wide community of researchers for a full week of exchange at the intersection of geometry, topology, and machine learning. With overwhelming interest, the event highlighted the growing momentum of this rapidly evolving research field.
In Conversation
15.10.25
Chow Lectures 2025 – In Conversation with Nima Arkani-Hamed Chow Lectures 2025 – In Conversation with Nima Arkani-Hamed
In the past week the Chow Lectures 2025 took place at the MPI MiS. We had the honor of
welcoming and interviewing this year’s speaker, the theoretical physicist Nima Arkani-
Hamed from the Institute for Advanced Study in Princeton, New Jersey, USA.
Miscellaneous
04.09.25
CIMPA Summer School in Türkiye CIMPA Summer School in Türkiye
This summer, Şefika Kuzgun and co-organizers successfully organized a CIMPA School on Probability and Analysis in Türkiye – promoting a branch of mathematics that has so far received little attention in Türkiye and neighboring countries.
20.06.25
Art & Science Open Air 2026 Art & Science Open Air 2026
On September 5, from 12:00 PM to 10:00 PM, art and research come together at the enchanting open-air venue Heiter bis Wolkig. Spend a day where scientific curiosity meets artistic creativity and music creates the soundtrack.
Events
17.04.25
Ladyzhenskaya Lecture: April 23, 2025 at the University of Leipzig Ladyzhenskaya Lecture: April 23, 2025 at the University of Leipzig
We warmly invite you to the 15th Ladyzhenskaya Lecture. On April 23, Adriana Garroni from the Università di Roma 'La Sapienza' will discuss: "Sharp Interface Models for Grain Boundaries: Derivation and Approximation".
Events
12.03.25
Leipzig Talks on Mathematics: March 25, 2025 Leipzig Talks on Mathematics: March 25, 2025
Research and innovation are crucial for Europe’s future. We invite you to a discussion with the French mathematician and former President of the European Research Council, Prof. Jean-Pierre Bourguignon. Together, we will explore key topics in science policy, the role of research institutions, and the impact of political developments on research policy.
Events
12.11.24
Invitation to Cantor Day on November 27 in Halle (Saale) Invitation to Cantor Day on November 27 in Halle (Saale)
On November 27, our director Felix Otto will be awarded the Cantor Medal by the German Mathematical Society DMV. We cordially invite you to join us for the ceremony and presentation of the DMV's most prestigious scientific award.
Events
28.08.24
Music & Science Open Air Festival Music & Science Open Air Festival
On September 7th, from 12:00 PM to 10:00 PM, music and research come together in the enchanting open-air venue "Heiter Bis Wolkig." Experience a unique fusion of science, music, and art!
Miscellaneous
25.05.23
Inaugural Colloquium of the Center for Mathematical Physics Inaugural Colloquium of the Center for Mathematical Physics
Massimiliano Gubinelli from the University of Oxford gave the first colloquium talk of the recently founded Center for Mathematical Physics in Leipzig. With over 130 scientists in attendance, Gubinelli highlighted new directions and open problems in stochastic analysis. Find out more about the vision and the people behind this initiative of MiS and the University of Leipzig.
Events
10.05.23
Summer School on PDEs and Randomness Kicks Off Summer School on PDEs and Randomness Kicks Off
Our Summer School on PDEs and Randomness has officially started and will run for the next two weeks! This is the largest event of its kind yet at the institute. Young researchers will be introduced to cutting-edge topics at the interface of PDEs and probability theory.
Announcements
24.03.23
Abel Laureate Luis A. Caffarelli to Speak at “Shocking Developments” Conference Abel Laureate Luis A. Caffarelli to Speak at “Shocking Developments” Conference
Congratulations to Luis A. Caffarelli for being honored with the prestigious Abel Prize!
Events
16.12.22
Gauß Lecture in Leipzig: “Discrete or Continuous?” Gauß Lecture in Leipzig: “Discrete or Continuous?”
László Lovász, professor at Eötvös Loránd University and Alfréd Rényi Institute of Mathematics in Budapest, gave the distinguished Gauß lecture on the topic Discrete or Continuous?, the question of the continuous nature of our world from a mathematical perspective.
Events
28.10.22
Ladyzhenskaya lecture returns with a talk by Mimi Dai Ladyzhenskaya lecture returns with a talk by Mimi Dai
On October 12th Mimi Dai of the University of Illinois discussed Ladyzhenskaya’s favorite topic: the mathematical theory of incompressible fluids.
Events
06.07.22
Wilmer Leal meets Nobel laureates Wilmer Leal meets Nobel laureates
Wilmer Leal was nominated by the Max Planck Society to join this year’s Lindau Nobel Laureate Meeting – a great honor and a perfect opportunity for scientific exchange with both distinguished Nobel laureates as well as young scientists from all over the world.
Events
22.06.22
Impressions of “Mathematical Concepts in the Sciences and Humanities” Impressions of “Mathematical Concepts in the Sciences and Humanities”
A heartfelt thanks to all speakers, participants, organizers, and supporters who made our conference “Mathematical Concepts in the Sciences and Humanities” in honor of our director Jürgen Jost an exceptional experience.
Events
22.04.22
Birthday conference in honor of Jürgen Jost Birthday conference in honor of Jürgen Jost
We dedicate an entire conference week on Mathematical Concepts in the Sciences and Humanities to our founding director Jürgen Jost to celebrate his outstanding scientific achievements and 65th birthday.
Outreach
04.03.22
Oceans out of balance? Max Planck lecture with Ian Hatton Oceans out of balance? Max Planck lecture with Ian Hatton
We cordially invite you to the public lecture “Oceans out of balance? How industrialized fishing affects the secret mathematical laws of nature” by Ian Hatton on March, 23 at 6:00 pm.
Events
16.11.21
The first mathematical research-data workshop The first mathematical research-data workshop
We recently hosted the the first MaRDI workshop with 25 in-person and a total of 38 online participants. MaRDI is an acronym for the German Mathematical Research Data Initiative.
Events
09.06.21
ODYCCEUS Panel Discussion ODYCCEUS Panel Discussion
The ODYCCEUS research project will recapitulate years of research in its final conference next week. The conference will conclude with a public discussion panel on Social Media — Democratization or radicalization engine?
Events
12.03.21
International Day of Mathematics 2021 International Day of Mathematics 2021
Coming Sunday, March 14, is the International Day of Mathematics – a worldwide celebration of the essential role that mathematics and mathematics education plays in breakthroughs in science and technology, improving the quality of life, empowering women and girls and much more.
Women in Science
11.02.21
Let's Celebrate Women and Girls in Science Let's Celebrate Women and Girls in Science
Today on February 11 is the International Day of Women and Girls in Science – a perfect day to celebrate the achievements of all ladies working in science related fields. And it is a perfect day for us to announce our institutional membership in the European Women in Mathematics.
Women in Science
23.10.19
Through the Eyes of a Woman Through the Eyes of a Woman
The exhibition “Women of Mathematics throughout Europe” offers a glimpse into the world of mathematics through the eyes of female mathematicians.
Miscellaneous
26.06.19
Winners of This Year’s HHL-MPI-Leibniz Mathematics Olympiad Announced Winners of This Year’s HHL-MPI-Leibniz Mathematics Olympiad Announced
At the 4th Leibniz Mathematics Olympiad, 25 students competed in teams to solve a variety of problems from the field of number theory and functional equations within a four-hour period.
Events
26.06.19
Man Machine Morality Man Machine Morality
The Science Cinema on artificial intelligence and robotics with Prof. Nihat Ay and experts from HTWK Leipzig attracted around 160 guests.
Events
21.05.19
The Exhibition Ship “MS Wissenschaft” Travels Through Germany The Exhibition Ship “MS Wissenschaft” Travels Through Germany
Since May 16th the exhibition ship “MS Wissenschaft” travels through Germany and Austria. On board are two interactive exhibits focusing on embodied AI made by our research group on “Information Theory of Cognitive Systems” led by Prof. Nihat Ay.
Events
30.10.18
Discussing Quantum Theory and Gravity in the Memory of Zeidler Discussing Quantum Theory and Gravity in the Memory of Zeidler
During the first week of October, the Max Planck Institute for Mathematics in the Sciences hosted a conference on “Progress and visions in quantum theory in view of Gravity”, dedicated to the memory of the institute’s founding director Eberhard Zeidler.
Events
03.07.18
Learning to Code From the Masters: The Macaulay2 Workshop at MPI MiS Learning to Code From the Masters: The Macaulay2 Workshop at MPI MiS
Last month, our institute hosted a dedicated Macaulay2 workshop organized by former MPI MiS postdoc Eliana Duarte Gelvez, together with Heather Harrington and Thomas Kahle.
Press Releases
19.06.18
Detecting Crises with the Aid of Social Networks – International Conference Connects Scientists in Leipzig Detecting Crises with the Aid of Social Networks – International Conference Connects…
Communication mechanisms in social networks are at the centre of the international conference currently taking place at the Max Planck Institute for Mathematics in the Sciences.
Press Releases
29.09.17
Conference in Memory of the Great Leipzig Mathematician Eberhard Zeidler Conference in Memory of the Great Leipzig Mathematician Eberhard Zeidler
On October 6 at 10 a.m., a conference will be held in honor of the mathematician and founding director of the Max Planck Institute for Mathematics in the Sciences, Prof. Dr. Dr. h.c. Eberhard Zeidler.
/