About us

We are a group of researchers investigating machine learning, language, and the human mind. We are based at Saarland University and Saarland Informatics Campus, Germany.

Our research studies the following topics:

  • Understanding machine learning models: We have investigated the expressive power and learning biases of transformer models (ICLR 2025, ACL 2024, TACL 2020) and state space models (NeurIPS 2024 ). We also develop methods for mechanistic interpretability (NeurIPS 2024, TACL 2019).

  • Computational Cognition and Neuroscience: In recent work, we have augmented GPT-2 with memory limitations to examine what makes recursion difficult for humans (PNAS 2022a), modeled the evolution of grammar (PNAS 2020, PNAS 2022b), and have developed a unifying theory of biases in human perception (Nature Neuroscience 2024).

News

01/2025 Our work on provable guarantees for length generalization in transformers has been accepted at ICLR 2025.

09/2024 Three papers accepted at NeurIPS 2024, on mechanistic interpretability, state-space models, and separations between architectures. Our lab organized the ELLIS pre-NeurIPS poster session at Saarbrücken, with 17 NeurIPS posters from across campus.

08/2024 Our work on Why are Sensitive Functions Hard for Transformers? received a Best Paper Award at ACL 2024.

07/2024 Our work on InversionView for reading out information from neural activations received the Second Prize at ICML 2024 Mechanistic Interpretability Workshop.

02/2024 Our work on the mathematics underlying perceptual biases has appeared in Nature Neuroscience.

12/2022 MIT News has an article about our PNAS paper on recursion

Meet the Team

Principal Investigator

Avatar

Michael Hahn

Assistant Professor

Researchers

Avatar

Sasha Bakalova

Research Assistant

Avatar

Xinting Huang

PhD Student

Avatar

Kate McCurdy

Postdoctoral Researcher

Avatar

Mark Rofin

Research Assistant

Avatar

Yash Sarrof

Research Assistant

Avatar

Xin Tong

Research Assistant

Avatar

Yana Veitsman

Research Assistant

Avatar

Entang Wang

Research Assistant

Teaching

Every semester, we organize a range of graduate-level seminars where we read current research papers. We also teach some undergraduate classes. See teaching page.

Joining the Lab

If you’re interested in joining, please do not hesitate to contact us at mhahn@lst.uni-saarland.de