Talk at Gradient Flows Face-to-Face 6 meets Transformers in Ulm

I gave a talk titled “Mean-field models for self-attention dynamics in transformers” at the workshop Gradient Flows Face-to-Face 6 meets Transformers at Ulm University. My talk was based on the following papers:

Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization

Quantifying concentration phenomena of mean-field transformers in the low-temperature regime