• Skip to primary navigation
  • Skip to content
  • Skip to footer
Tim Roith
  • CV
  • Papers and Talks
    Tim Roith

    Tim Roith

    Substitute Professor at TUM

    • Munich, Germany
    • Google Scholar
    • ResearchGate
    • GitHub
    • tim{dot}roith{at}tum{dot}de

    Online Talk at the BIRS Workshop on Interacting Particle Systems in Hangzhou

    June 30, 2026

    I gave an online talk titled “Mean-field Models for Self-attention Dynamics in Transformers” at the BIRS workshop Interacting Particle Systems: Theoretical Innovations and Practical Applications in Hangzhou, China. My talk was based on the following paper:

    Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization

    Updated: June 30, 2026

    You May Also Enjoy

    STSM Grant for a Research Visit at MaLGa in Genova

    September 17, 2026

    I received a Short Term Scientific Mission (STSM) grant from the COST Action CA24136 - InterCoML, which funded a research visit at the Machine Learning Genoa Center (MaLGa) in Genova from 31.08. to 11.09. My hosts were Silvia Villa and Cesare Molinari, whom...

    Talk at Gradient Flows Face-to-Face 6 meets Transformers in Ulm

    September 17, 2026

    I gave a talk titled “Mean-field models for self-attention dynamics in transformers” at the workshop Gradient Flows Face-to-Face 6 meets Transformers at Ulm University. My talk was based on the following papers:

    Consensus-based optimization for linearly separable functions

    September 1, 2026

    Together with Christian Fiedler we posted a new preprint on Consensus-based optimization for linearly separable functions. We propose a reparametrization strategy that provably finds coordinate transformations in which the objective becomes separable, which...

    Workshop on the Mathematics of Transformers at the University of Oxford

    August 21, 2026

    Together with José A. Carrillo, Daniel Kelly and Konstantin Riedl I organized the Workshop on the Mathematics of Transformers at the Mathematical Institute of the University of Oxford. Around 40 researchers came together to discuss the mathematical foundati...

    • ResearchGate
    • GitHub
    • Feed
    © 2026 Tim Roith. Powered by Jekyll & Minimal Mistakes.