Computing Answers to Complex Questions in Broad Domains

Informations projet

DELPHI

N° de convention de subvention: 802800

DOI

10.3030/802800

Projet clôturé

Date de signature de la CE 14 Novembre 2018

Date de début 1 Avril 2019

Date de fin 31 Mars 2026

Financé au titre de

• EXCELLENT SCIENCE - European Research Council (ERC)

Coût total

€ 1 499 375,00

Contribution de l’UE

€ 1 499 375,00

Coordonné par

TEL AVIV UNIVERSITY
Israel

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Publications

Conference proceedings (31)

Diverse Demonstrations Improve In-context Compositional Generalization

Auteurs: Itay Levy, Ben Bogin, Jonathan Berant
Publié dans: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023, Page(s) 1401-1422
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2023.acl-long.78

MAKING RETRIEVAL-AUGMENTED LANGUAGEMODELS ROBUST TO IRRELEVANT CONTEXT

Auteurs: Ori Yoran Tomer Wolfson Ori Ram Jonathan Berant
Publié dans: Numéro Published as a conference paper at ICLR 2024, 2024
Éditeur: The Twelfth International Conference on Learning Representations ICLR 2024

Unobserved Local Structures Make Compositional Generalization Hard

Auteurs: Ben Bogin, Shivanshu Gupta, Jonathan Berant
Publié dans: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2026, Page(s) 2731-2747
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.175

"""COVR: A test-bed for Visually Grounded Compositional Generalization with real images"""

Auteurs: Ben Bogin, Shivanshu Gupta, Matt Gardner, Jonathan Berant
Publié dans: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021, Page(s) 9824–9846
Éditeur: Association for Computational Linguistics

MultimodalQA: Complex Question Answering over Text, Tables and Images

Auteurs: Alon Talmor, Ori Yoran, Amnon Catav, Dan Lahav, Yizhong Wang, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi, Jonathan Berant
Publié dans: Proceedings of the 2021 International Conference on Learning Representations, 2021
Éditeur: ICLR 2021

A Simple and Effective Model for Answering Multi-span Questions

Auteurs: Elad Segal, Avia Efrat, Mor Shoham, Amir Globerson, Jonathan Berant
Publié dans: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, Page(s) 3074-3080
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2020.emnlp-main.248

What’s in Your Head? Emergent Behaviour in Multi-Task Transformer Models

Auteurs: Mor Geva, Uri Katz, Aviv Ben-Arie, Jonathan Berant
Publié dans: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Éditeur: Association for Computational Linguistics

Achieving Model Robustness Through Discrete Adversarial Training

Auteurs: Maor Ivgi and Jonathan Berant
Publié dans: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Éditeur: ACL 2021

Learning To Retrieve Prompts for In-Context Learning

Auteurs: Ohad Rubin, Jonathan Herzig, Jonathan Berant
Publié dans: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022, Page(s) 2655-2671
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.naacl-main.191

Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors

Auteurs: Ido Amos, Jonathan Berant, Ankit Gupta
Publié dans: ICLR 2024 oral, 2024
Éditeur: Published as a conference paper at ICLR 2024

Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments

Auteurs: Maor Ivgi, Yair Carmon, Jonathan Berant
Publié dans: Findings of the Association for Computational Linguistics: EMNLP 2022, 2026, Page(s) 7354-7371
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-emnlp.544

Inferring Implicit Relations in Complex Questions with Language Models

Auteurs: Uri Katz, Mor Geva, Jonathan Berant
Publié dans: Findings of the Association for Computational Linguistics: EMNLP 2022, 2026, Page(s) 2548-2566
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-emnlp.188

Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization

Auteurs: Inbar Oren, Jonathan Herzig, Jonathan Berant
Publié dans: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Éditeur: Association for Computational Linguistics

Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills

Auteurs: Ori Yoran, Alon Talmor, Jonathan Berant
Publié dans: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022, Page(s) 6016-6031
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.acl-long.416

Training Vision-Language Models with Less Bimodal Supervision

Auteurs: Elad Segal, Ben Bogin, Jonathan Berant
Publié dans: 2022
Éditeur: AKBC 2022
DOI: 10.48550/arxiv.2211.00262

Injecting Numerical Reasoning Skills into Language Models

Auteurs: Mor Geva, Ankit Gupta, Jonathan Berant
Publié dans: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, Page(s) 946-958
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2020.acl-main.89

SCROLLS: Standardized CompaRison Over Long Language Sequences

Auteurs: Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat, Ori Yoran, Adi Haviv, Ankit Gupta, Wenhan Xiong, Mor Geva, Jonathan Berant, Omer Levy
Publié dans: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2026, Page(s) 12007-12021
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.emnlp-main.823

Scene Graph tO Image Generation with Contextualized Object Layout Refinement

Auteurs: Maor Ivgi, Yaniv Benny, Avichai Ben-David, Jonathan Berant, Lior Wolf
Publié dans: 2021 IEEE International Conference on Image Processing (ICIP), 2021, Page(s) 2428-2432, ISBN 978-1-6654-4115-5
Éditeur: IEEE
DOI: 10.1109/icip42928.2021.9506651

Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge

Auteurs: Talmor, Alon; Tafjord, Oyvind; Clark, Peter; Goldberg, Yoav; Berant, Jonathan
Publié dans: Advances in Neural Information Processing Systems 33 pre-proceedings (NeurIPS 2020), Numéro 4, 2020
Éditeur: NeurIPS 2020

CommonsenseQA 2.0: Exposing the Limits of AI through Gamification

Auteurs: Alon Talmor, Ori Yoran, Ronan Le Bras, Chandra Bhagavatula, Yoav Goldberg, Yejin Choi, Jonathan Berant
Publié dans: Proceedings of the Thirty-fifth Conference on Neural Information Processing Systems (Datasets and Benchmarks Track), 2021
Éditeur: NeurIPS 2021

Improving Compositional Generalization in Semantic Parsing

Auteurs: Inbar Oren, Jonathan Herzig, Nitish Gupta, Matt Gardner, Jonathan Berant
Publié dans: Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, Page(s) 2482-2495
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2020.findings-emnlp.225

SmBoP: Semi-autoregressive Bottom-up Semantic Parsing

Auteurs: Ohad Rubin, Jonathan Berant
Publié dans: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021, Page(s) 311-324
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2021.naacl-main.29

In-Context Learning with Long-Context Models: An In-Depth Exploration

Auteurs: Amanda Bertsch, Maor Ivgi, Emily Xiao, Uri Alon, Jonathan Berant, Matthew R. Gormley, Graham Neubig
Publié dans: Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2025, Page(s) 12119-12149
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2025.naacl-long.605

Evaluating the Evaluation of Diversity in Natural Language Generation

Auteurs: Guy Tevet, Jonathan Berant
Publié dans: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021, Page(s) 326-346
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2021.eacl-main.25

ASSISTANTBENCH: Can Web Agents SolveRealistic and Time-Consuming Tasks?

Auteurs: Ori Yoran Samuel Joseph Amouyal Chaitanya Malaviya Ben Bogin Ofir Press Jonathan Berant
Publié dans: 2024
Éditeur: arXiv:2407.15711v2 [cs.CL] 21 Oct 2024

Evaluating Models’ Local Decision Boundaries via Contrast Sets

Auteurs: Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
Publié dans: Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, Page(s) 1307-1323
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2020.findings-emnlp.117

Span-based Semantic Parsing for Compositional Generalization

Auteurs: Jonathan Herzig, Jonathan Berant
Publié dans: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021, Page(s) 908-921
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2021.acl-long.74

Differentiable Scene Graphs

Auteurs: Moshiko Raboh, Roei Herzig, Jonathan Berant, Gal Chechik, Amir Globerson
Publié dans: 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, Page(s) 1477-1486, ISBN 978-1-7281-6553-0
Éditeur: IEEE
DOI: 10.1109/wacv45572.2020.9093297

Obtaining Faithful Interpretations from Compositional Neural Networks

Auteurs: Sanjay Subramanian, Ben Bogin, Nitish Gupta, Tomer Wolfson, Sameer Singh, Jonathan Berant, Matt Gardner
Publié dans: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020, Page(s) 5594-5608
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2020.acl-main.495

Weakly Supervised Text-to-SQL Parsing through Question Decomposition

Auteurs: Tomer Wolfson, Daniel Deutch, Jonathan Berant
Publié dans: Findings of the Association for Computational Linguistics: NAACL 2022, 2022, Page(s) 2528-2542
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2022.findings-naacl.193

Answering Questions by Meta-Reasoning over Multiple Chains of Thought

Auteurs: Ori Yoran, Tomer Wolfson, Ben Bogin, Uri Katz, Daniel Deutch, Jonathan Berant
Publié dans: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023, Page(s) 5942-5966
Éditeur: Association for Computational Linguistics
DOI: 10.18653/v1/2023.emnlp-main.364

Other (3)

Question Decomposition with Dependency Graphs

Auteurs: Matan Hasson, Jonathan Berant
Publié dans: AKBC 2021, 2021
Éditeur: non-archival

Efficient Long-Text Understanding with Short-Text Models

Auteurs: Maor Ivgi, Uri Shaham, Jonathan Berant
Publié dans: arXiv:2208.00748v3 [cs.CL] 27 Dec 2022, 2022
Éditeur: Accepted for publication in Transactions of the Association for Computational Linguistics (TACL), 2023.
DOI: 10.48550/arxiv.2208.00748

Simplifying and Understanding State Space Modelswith Diagonal Linear RNNs

Auteurs: Ankit Gupta, Harsh Mehta, Jonathan Berant
Publié dans: 2022
Éditeur: OTHER
DOI: 10.48550/arxiv.2212.00768

Peer reviewed articles (6)

Retrieval-Pretrained Transformer: Long-range Language Modeling with Self-retrieval

Auteurs: Ohad Rubin, Jonathan Berant
Publié dans: Transactions of the Association for Computational Linguistics, Numéro 12, 2024, Page(s) 1197-1213, ISSN 2307-387X
Éditeur: MIT Press
DOI: 10.1162/tacl_a_00693

oLMpics-On What Language Model Pre-training Captures

Auteurs: Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant
Publié dans: Transactions of the Association for Computational Linguistics, Numéro 8, 2020, Page(s) 743-758, ISSN 2307-387X
Éditeur: The MIT Press
DOI: 10.1162/tacl_a_00342

Break It Down: A Question Understanding Benchmark

Auteurs: Tomer Wolfson; Mor Geva; Ankit Gupta; Matt Gardner; Yoav Goldberg; Daniel Deutch; Jonathan Berant
Publié dans: Transactions of the Association for Computational Linguistics, Vol 8, Pp 183-198 (2020), Numéro 2, 2020, ISSN 2307-387X
Éditeur: MIT Press Journals
DOI: 10.1162/tacl_a_00309

Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question Decomposition

Auteurs: Mor Geva, Tomer Wolfson, Jonathan Berant
Publié dans: Transactions of the Association for Computational Linguistics, 2021, 2021, ISSN 2307-387X
Éditeur: MIT Press

Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies

Auteurs: Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, Jonathan Berant
Publié dans: Transactions of the Association for Computational Linguistics, Numéro 9, 2021, Page(s) 346-361, ISSN 2307-387X
Éditeur: MIT Press
DOI: 10.1162/tacl_a_00370

Latent compositional representations improve systematic generalization in grounded question answering.

Auteurs: Ben Bogin, Sanjay Subramanian, Matt Gardner, Jonathan Berant
Publié dans: Transactions of the Association for Computational Linguistics (TACL) - volume 9, 2021, ISSN 2307-387X
Éditeur: MIT Press