Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization

June 5, 2025

I’m happy to share that our paper Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization has been published in the Philosophical Transactions of the Royal Society A.

Online Talk at the BIRS Workshop on Interacting Particle Systems in Hangzhou

June 30, 2026

I gave an online talk titled “Mean-field Models for Self-attention Dynamics in Transformers” at the BIRS workshop Interacting Particle Systems: Theoretical Innovations and Practical Applications in Hangzhou, China. My talk was based on the following paper:

Talk at the Joint Seminar of TUM, LMU and KU Ingolstadt

June 25, 2026

I gave a talk at the joint seminar of TUM, LMU and KU Ingolstadt, hosted at KU Ingolstadt. My talk was based on the following paper:

Workshop on the Mathematics of Transformers at University of Würzburg

June 17, 2026

I gave a talk at the Workshop on the Mathematics of Transformers, hosted at Julius Maximilians University of Würzburg. You can find more details on the event here and my talk was based on the following paper:

Talk at the 11th International Conference on Curves and Surfaces in Saint-Malo

June 10, 2026

I gave a talk at the 11th International Conference on Curves and Surfaces in Saint-Malo, France. My talk was based on the following paper:

Tim Roith

You May Also Enjoy

Online Talk at the BIRS Workshop on Interacting Particle Systems in Hangzhou

Talk at the Joint Seminar of TUM, LMU and KU Ingolstadt

Workshop on the Mathematics of Transformers at University of Würzburg

Talk at the 11th International Conference on Curves and Surfaces in Saint-Malo