Computing Answers to Complex Questions in Broad Domains

Diverse Demonstrations Improve In-context Compositional Generalization

Author(s): Itay Levy, Ben Bogin, Jonathan Berant
Published in: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023, Page(s) 1401-1422
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.acl-long.78

MAKING RETRIEVAL-AUGMENTED LANGUAGEMODELS ROBUST TO IRRELEVANT CONTEXT

Author(s): Ori Yoran Tomer Wolfson Ori Ram Jonathan Berant
Published in: Issue Published as a conference paper at ICLR 2024, 2024
Publisher: The Twelfth International Conference on Learning Representations ICLR 2024

Unobserved Local Structures Make Compositional Generalization Hard

Author(s): Ben Bogin, Shivanshu Gupta, Jonathan Berant
Published in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2026, Page(s) 2731-2747
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.175

"""COVR: A test-bed for Visually Grounded Compositional Generalization with real images"""

Author(s): Ben Bogin, Shivanshu Gupta, Matt Gardner, Jonathan Berant
Published in: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021, Page(s) 9824–9846
Publisher: Association for Computational Linguistics

MultimodalQA: Complex Question Answering over Text, Tables and Images

Author(s): Alon Talmor, Ori Yoran, Amnon Catav, Dan Lahav, Yizhong Wang, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi, Jonathan Berant
Published in: Proceedings of the 2021 International Conference on Learning Representations, 2021
Publisher: ICLR 2021

A Simple and Effective Model for Answering Multi-span Questions

Author(s): Elad Segal, Avia Efrat, Mor Shoham, Amir Globerson, Jonathan Berant
Published in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, Page(s) 3074-3080
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2020.emnlp-main.248

What’s in Your Head? Emergent Behaviour in Multi-Task Transformer Models

Author(s): Mor Geva, Uri Katz, Aviv Ben-Arie, Jonathan Berant
Published in: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Publisher: Association for Computational Linguistics

Achieving Model Robustness Through Discrete Adversarial Training

Author(s): Maor Ivgi and Jonathan Berant
Published in: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Publisher: ACL 2021

Learning To Retrieve Prompts for In-Context Learning

Author(s): Ohad Rubin, Jonathan Herzig, Jonathan Berant
Published in: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022, Page(s) 2655-2671
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.naacl-main.191

Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors

Author(s): Ido Amos, Jonathan Berant, Ankit Gupta
Published in: ICLR 2024 oral, 2024
Publisher: Published as a conference paper at ICLR 2024

Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments

Author(s): Maor Ivgi, Yair Carmon, Jonathan Berant
Published in: Findings of the Association for Computational Linguistics: EMNLP 2022, 2026, Page(s) 7354-7371
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-emnlp.544

Inferring Implicit Relations in Complex Questions with Language Models

Author(s): Uri Katz, Mor Geva, Jonathan Berant
Published in: Findings of the Association for Computational Linguistics: EMNLP 2022, 2026, Page(s) 2548-2566
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-emnlp.188

Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization

Author(s): Inbar Oren, Jonathan Herzig, Jonathan Berant
Published in: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Publisher: Association for Computational Linguistics

Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills

Author(s): Ori Yoran, Alon Talmor, Jonathan Berant
Published in: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022, Page(s) 6016-6031
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.acl-long.416

Training Vision-Language Models with Less Bimodal Supervision

Author(s): Elad Segal, Ben Bogin, Jonathan Berant
Published in: 2022
Publisher: AKBC 2022
DOI: 10.48550/arxiv.2211.00262

Injecting Numerical Reasoning Skills into Language Models

Author(s): Mor Geva, Ankit Gupta, Jonathan Berant
Published in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, Page(s) 946-958
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2020.acl-main.89

SCROLLS: Standardized CompaRison Over Long Language Sequences

Author(s): Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, Omer Levy
Published in: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2026, Page(s) 12007-12021
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.823

Scene Graph tO Image Generation with Contextualized Object Layout Refinement

Author(s): Maor Ivgi, Yaniv Benny, Avichai Ben-David, Jonathan Berant, Lior Wolf
Published in: 2021 IEEE International Conference on Image Processing (ICIP), 2021, Page(s) 2428-2432, ISBN 978-1-6654-4115-5
Publisher: IEEE
DOI: 10.1109/icip42928.2021.9506651

Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge

Author(s): Talmor, Alon; Tafjord, Oyvind; Clark, Peter; Goldberg, Yoav; Berant, Jonathan
Published in: Advances in Neural Information Processing Systems 33 pre-proceedings (NeurIPS 2020), Issue 4, 2020
Publisher: NeurIPS 2020

CommonsenseQA 2.0: Exposing the Limits of AI through Gamification

Author(s): Alon Talmor, Ori Yoran, Ronan Le Bras, Chandra Bhagavatula, Yoav Goldberg, Yejin Choi, Jonathan Berant
Published in: Proceedings of the Thirty-fifth Conference on Neural Information Processing Systems (Datasets and Benchmarks Track), 2021
Publisher: NeurIPS 2021

Improving Compositional Generalization in Semantic Parsing

Author(s): Inbar Oren, Jonathan Herzig, Nitish Gupta, Matt Gardner, Jonathan Berant
Published in: Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, Page(s) 2482-2495
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2020.findings-emnlp.225

SmBoP: Semi-autoregressive Bottom-up Semantic Parsing

Author(s): Ohad Rubin, Jonathan Berant
Published in: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021, Page(s) 311-324
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.naacl-main.29

In-Context Learning with Long-Context Models: An In-Depth Exploration

Author(s): Amanda Bertsch, Maor Ivgi, Emily Xiao, Uri Alon, Jonathan Berant, Matthew R. Gormley, Graham Neubig
Published in: Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2025, Page(s) 12119-12149
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2025.naacl-long.605

Evaluating the Evaluation of Diversity in Natural Language Generation

Author(s): Guy Tevet, Jonathan Berant
Published in: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021, Page(s) 326-346
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.eacl-main.25

ASSISTANTBENCH: Can Web Agents SolveRealistic and Time-Consuming Tasks?

Author(s): Ori Yoran Samuel Joseph Amouyal Chaitanya Malaviya Ben Bogin Ofir Press Jonathan Berant
Published in: 2024
Publisher: arXiv:2407.15711v2 [cs.CL] 21 Oct 2024

Evaluating Models’ Local Decision Boundaries via Contrast Sets

Author(s): Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
Published in: Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, Page(s) 1307-1323
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2020.findings-emnlp.117

Span-based Semantic Parsing for Compositional Generalization

Author(s): Jonathan Herzig, Jonathan Berant
Published in: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021, Page(s) 908-921
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2021.acl-long.74

Differentiable Scene Graphs

Author(s): Moshiko Raboh, Roei Herzig, Jonathan Berant, Gal Chechik, Amir Globerson
Published in: 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, Page(s) 1477-1486, ISBN 978-1-7281-6553-0
Publisher: IEEE
DOI: 10.1109/wacv45572.2020.9093297

Obtaining Faithful Interpretations from Compositional Neural Networks

Author(s): Sanjay Subramanian, Ben Bogin, Nitish Gupta, Tomer Wolfson, Sameer Singh, Jonathan Berant, Matt Gardner
Published in: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, Page(s) 5594-5608
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2020.acl-main.495

Weakly Supervised Text-to-SQL Parsing through Question Decomposition

Author(s): Tomer Wolfson, Daniel Deutch, Jonathan Berant
Published in: Findings of the Association for Computational Linguistics: NAACL 2022, 2022, Page(s) 2528-2542
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-naacl.193

Answering Questions by Meta-Reasoning over Multiple Chains of Thought

Author(s): Ori Yoran, Tomer Wolfson, Ben Bogin, Uri Katz, Daniel Deutch, Jonathan Berant
Published in: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Page(s) 5942-5966
Publisher: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.364

Question Decomposition with Dependency Graphs

Author(s): Matan Hasson, Jonathan Berant
Published in: AKBC 2021, 2021
Publisher: non-archival

Efficient Long-Text Understanding with Short-Text Models

Author(s): Maor Ivgi, Uri Shaham, Jonathan Berant
Published in: arXiv:2208.00748v3 [cs.CL] 27 Dec 2022, 2022
Publisher: Accepted for publication in Transactions of the Association for Computational Linguistics (TACL), 2023.
DOI: 10.48550/arxiv.2208.00748

Simplifying and Understanding State Space Modelswith Diagonal Linear RNNs

Author(s): Ankit Gupta, Harsh Mehta, Jonathan Berant
Published in: 2022
Publisher: OTHER
DOI: 10.48550/arxiv.2212.00768

Retrieval-Pretrained Transformer: Long-range Language Modeling with Self-retrieval

Author(s): Ohad Rubin, Jonathan Berant
Published in: Transactions of the Association for Computational Linguistics, Issue 12, 2024, Page(s) 1197-1213, ISSN 2307-387X
Publisher: MIT Press
DOI: 10.1162/tacl_a_00693

oLMpics-On What Language Model Pre-training Captures

Author(s): Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant
Published in: Transactions of the Association for Computational Linguistics, Issue 8, 2020, Page(s) 743-758, ISSN 2307-387X
Publisher: The MIT Press
DOI: 10.1162/tacl_a_00342

Break It Down: A Question Understanding Benchmark

Author(s): Tomer Wolfson; Mor Geva; Ankit Gupta; Matt Gardner; Yoav Goldberg; Daniel Deutch; Jonathan Berant
Published in: Transactions of the Association for Computational Linguistics, Vol 8, Pp 183-198 (2020), Issue 2, 2020, ISSN 2307-387X
Publisher: MIT Press Journals
DOI: 10.1162/tacl_a_00309

Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question Decomposition

Author(s): Mor Geva, Tomer Wolfson, Jonathan Berant
Published in: Transactions of the Association for Computational Linguistics, 2021, 2021, ISSN 2307-387X
Publisher: MIT Press

Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies

Author(s): Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, Jonathan Berant
Published in: Transactions of the Association for Computational Linguistics, Issue 9, 2021, Page(s) 346-361, ISSN 2307-387X
Publisher: MIT Press
DOI: 10.1162/tacl_a_00370

Latent compositional representations improve systematic generalization in grounded question answering.

Author(s): Ben Bogin, Sanjay Subramanian, Matt Gardner, Jonathan Berant
Published in: Transactions of the Association for Computational Linguistics (TACL) - volume 9, 2021, ISSN 2307-387X
Publisher: MIT Press

Publications

Download Download the content of the page