Lucas Weber

Lucas Weber

PhD-candidate in Computational Linguistics

About me

I am a PhD researcher working on interpretability and benchmarking of language models.

Previously, I was a PhD student in the COLT-research group at University of Pompeu Fabra supervised by Dr. Elia Bruni and Dr. Dieuwke Hupkes. Before my PhD-studies, I obtained a MSc. in Brain and Cognitive Sciences from the University of Amsterdam with my thesis work conducted at MRC-CBU in Cambridge. My BSc. in Psychology comes from the University of Vienna.

Recent News

  • May 16th, 2024 - Our paper Interpretability of Language Models via Task Spaces got accepted at ACL 2024! Pre-print will follow soon.
  • May 3rd, 2024 - I successfully defended my PhD-thesis Interpreting the Learning Dynamics of Language Models. Thanks to the wonderful Dr. Raffaella Bernardi, Dr. Denis Paperno and Dr. Barbara Plank for serving on my defense committee!
  • May 2nd, 2024 - Our paper tinyBenchmarks: evaluating LLMs with fewer examples got accepted at ICML 2024! The data for efficient benchmarking of LLMs is available on 🤗 (data).
  • February 15th, 2024 - Our preprint for tinyBenchmarks: evaluating LLMs with fewer examples is out. The data for efficient benchmarking of LLMs is available on 🤗 (see paper | data). Happy Benchmarking!
  • January 11th, 2024 - The ICL consistency data is now also available via huggingface’s dataset hub (see dataset)
  • December 7th, 2023 - ‘Mind the instructions’ received an hounorable mention (top 4 papers) at CONLL 2023.
  • Octobre 10th, 2023 - Our contribution to Genbench ‘The ICL consistency test’ was accepted for the first edition of the Genbench Workshop 👀
  • Octobre 6th, 2023 - Our submission ‘Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning’ was accepted at CONLL 2023 🎉
  • June 30th - July 3rd, 2023 - Another round of REST-CL REST-CL 2023: Together, COLT-UPF and DMG-UvA), we organised another memorable event in which we discussed research 🔬 with a diverse group of PhD-students from all over Europe 🇪🇺, the UK 🇬🇧 and the US 🇺🇸.
  • April 11th - 14th, 2022 - We (COLT-UPF and DMG-UvA) are organizing REST-CL 2022 for discussing research 🔬 with follow PhD-students from all over Europe 🇪🇺.
  • March 15th, 2022 - I am invited to give a talk (‘Teaching with Language Commentaries’) in the CoML-group at ENS-Paris.
  • July 30th, 2021 - I am presenting a poster (‘Meeting Formal Linguistics and Optimisation’) at the ELLIS-NLP2021 workshop. Hope to see you there! 👋
  • April 19th, 2021 - I am around at EACL 2021. Ping me in RocketChat @lucas.weber if you want to get in contact or join the live-session / oral presentation on our paper on the 21st of April (Wednesday) at 10 CEST 👋
  • January 11st, 2021 - Our submission ‘Language Modelling as a Multi-Task Problem’ was accepted at EACL 2021 🎉
  • July 21st, 2020 - I am attending LxMLS 2020