• Skip to primary navigation
  • Skip to content
  • Skip to footer
Tim Roith Tim Roith
  • CV
  • Papers and Talks
    Tim Roith

    Tim Roith

    Postdoc at Helmholtz Imaging, DESY

    • Hamburg, Germany
    • ResearchGate
    • GitHub
    • tim{dot}roith{at}desy{dot}de

    Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization

    January 6, 2025

    Together with Martin Burger, Samira Kabri, Yury Korolev and Lukas Weigand we posted a new preprint called Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization.

    Updated: January 6, 2025

    You May Also Enjoy

    Introduction to Regularization and Learning Methods for Inverse Problems

    August 27, 2025

    Together with Danielle Bednarski we uploaded our lecture notes Introduction to Regularization and Learning Methods for Inverse Problems to arXiv. The notes are based on a course we taught at the University of Hamburg in the winter term 2024/2025.

    Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies

    June 30, 2025

    Together with Leon Bungert and Philipp Wacker we uploaded a paper to arXiv, which shows how CBO can be used to create closed-box adversarial attacks. Beyond that we establish an interesting connection between CBO and evolution strategies. The paper can be f...

    Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization

    June 5, 2025

    I’m happy to share that our paper Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization has been published in the Philosophical Transactions of the Royal Society A.

    Dr.-Klaus-Körper Prize

    April 7, 2025

    I am very happy to share that I was awarded the Dr.-Klaus-Körper Prize for my PhD thesis today. The prize is awarded by the GAMM at the annual meeting in Poznań.

    • ResearchGate
    • GitHub
    • Feed
    © 2025 Tim Roith. Powered by Jekyll & Minimal Mistakes.