Workshop on the Mathematics of Transformers at the University of Oxford

Together with José A. Carrillo, Daniel Kelly and Konstantin Riedl I organized the Workshop on the Mathematics of Transformers at the Mathematical Institute of the University of Oxford. Around 40 researchers came together to discuss the mathematical foundations of transformers and self-attention, with six invited talks covering anisotropic interactions, deep linear transformers, attention dynamics, mean-field theory, operator learning and the training of transformers with AdamW.

This was the second edition of the workshop series, following the first one at DESY in Hamburg. The event was supported by G-Research and the ERC Advanced Grant “Nonlocal PDEs for Complex Particle Dynamics: Phase Transitions, Patterns and Synchronization”.