Publications

Representation Surgery: Theory and Practice of Affine Steering
Shashwat Singh*, Shauli Ravfogel*, Jonathan Herzig, Roee Aharoni, Ryan Cotterell, Ponnurangam Kumaraguru
PDF
Natural Language Counterfactuals through Representation Surgery
Matan Avitan, Ryan Cotterell, Yoav Goldberg, Shauli Ravfogel
PDF
The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Models
Aviv Slobodkin, Omer Goldman, Avi Caciularu, Ido Dagan, Shauli Ravfogel
PDF
Retrieving Texts based on Abstract Descriptions
Shauli Ravfogel, Valentina Pyatkin, Amir DN Cohen, Avshalom Manevich, Yoav Goldberg
PDF Slides
Linear Guardedness and its Implications
Shauli Ravfogel, Yoav Goldberg, Ryan Cotterell
PDF Code
Conformal Nucleus Sampling
Shauli Ravfogel, Yoav Goldberg, Jacob Goldberger
PDF Code
DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Models
Royi Rassin*, Shauli Ravfogel*, Yoav Goldberg
PDF Code
Analyzing Gender Representation in Multilingual Models
Hila Gonen, Shauli Ravfogel, Yoav Goldberg
PDF
Adversarial Concept Erasure in Kernel Space
Shauli Ravfogel, Francisco Vargas, Yoav Goldberg, Ryan Cotterell
PDF Code Poster
Linear Adversarial Concept Erasure
Shauli Ravfogel, Michael Twiton, Yoav Goldberg, Ryan Cotterell
PDF Code Poster Slides
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
Elad Ben-Zaken, Shauli Ravfogel, Yoav Goldberg
PDF Code
Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction
Shauli Ravfogel*, Grusha Prasad*, Tal Linzen, Yoav Goldberg
PDF Code Slides DOI
Measuring and Improving Consistency in Pretrained Language Models
Yanai Elazar, Nora Kassner, Shauli Ravfogel, Abhilasha Ravichander, Eduard Hovy, Hinrich Schütze, Yoav Goldberg
PDF DOI
Contrastive Explanations for Model Interpretability
Alon Jacovi, Swabha Swayamdipta, Shauli Ravfogel, Yanai Elazar, Yejin Choi, Yoav Goldberg
PDF DOI
Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
Yanai Elazar, Shauli Ravfogel, Alon Jacovi, Yoav Goldberg
PDF Code
It’s not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT
Hila Gonen, Shauli Ravfogel, Yanai Elazar, Yoav Goldberg
PDF DOI
Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection
Shauli Ravfogel, Yanai Elazar, Hila Gonen, Michael Twiton, Yoav Goldberg
PDF Code Slides Video DOI
Studying the Inductive Biases of RNNs with Synthetic Variations of Natural Languages
Shauli Ravfogel, Yoav Goldberg, Tal Linzen
PDF Code Slides DOI
Ab Antiquo: Neural Proto-language Reconstruction
Carlo Meloni*, Shauli Ravfogel*, Yoav Goldberg
PDF Slides DOI
Can LSTM Learn to Capture Agreement? The Case of Basque
Shauli Ravfogel, Francis M. Tyers, Yoav Goldberg
PDF DOI
Unsupervised Distillation of Syntactic Information from Contextualized Word Representations
Shauli Ravfogel*, Yanai Elazar*, Jacob Goldberger, Yoav Goldberg
PDF DOI