Innovative Methods for Psychology: Reproducible, Open, Valid, and Efficient

Project Information

IMPROVE

Grant agreement ID: 726361

DOI 10.3030/726361

Project closed

EC signature date 29 May 2017

Start date 1 June 2017

End date 30 November 2022

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost € 1 999 747,50

EU contribution € 1 999 747,50

Coordinated by

TILBURG UNIVERSITY- UNIVERSITEIT VAN TILBURG
Netherlands

Deliverables

Open Research Data Pilot (1)

Data Management Plan

Data Management Plan following the participation in the Open Research Data Pilot

Publications

Peer reviewed articles (33)

Consensus-based guidance for conducting and reporting multi-analyst studies

Author(s): Aczel Balazs, Olmo van den Akker, Jelte Wicherts
Published in: eLife, 2021, ISSN 2050-084X
Publisher: eLife Sciences Publications
DOI: 10.7554/elife.72185

Citation Patterns Following a Strongly Contradictory Replication Result: Four Case Studies From Psychology

Author(s): Tom E. Hardwicke, Dénes Szucs, Robert T. Thibault, Sophia Crüwell, Olmo R. van den Akker, Michèle B. Nuijten, John P. A. Ioannidis
Published in: Advances in Methods and Practices in Psychological Science, 2021, ISSN 2515-2459
Publisher: Sage
DOI: 10.1177/25152459211040837

Modeling the impact of time limits on the gender gap in mathematics

Author(s): Andrea H. Stoevenbelt; Jelte M. Wicherts; Paulette C. Flore; Lorraine A. T. Phillips; Jakob Pietschnig; Bruno Verschuere; Martin Voracek; Inga Schwabe
Published in: Educational and Psychological Measurement, Issue 1, 2022, ISSN 0013-1644
Publisher: SAGE Publications
DOI: 10.1177/00131644221111076

Towards wide-scale adoption of open science practices: The role of open science communities

Author(s): Kristijan Armeni; Loek Brinkman; Rickard Carlsson; Anita Eerland; Rianne Fijten; Robin Fondberg; Vera E. Heininga; Vera E. Heininga; Stephan Heunis; Wei Qi Koh; Maurits Masselink; Niall Moran; Andrew Ó Baoill; Alexandra Sarafoglou; Antonio Schettino; Hardy Schwamm; Zsuzsika Sjoerds; Marta Teperek; Olmo van den Akker; Anna van 't Veer; Raul Zurita-Milla
Published in: Science and Public Policy, Issue 03023427, 2021, ISSN 0302-3427
Publisher: Beech Tree Publishing
DOI: 10.31222/osf.io/7gct9

A meta-analysis on goal contagion

Author(s): Hilmar Brohmer; Lisa V. Eckerstorfer; Robbie C. M. van Aert; Katja Corcoran
Published in: International Review of Social Psychology, Issue 23978570, 2022, ISSN 2397-8570
Publisher: Ubiquity Press
DOI: 10.5334/irsp.428

How do psychology researchers interpret the results of multiple replication studies?

Author(s): Olmo R. van den Akker, Jelte M. Wicherts, Linda Dominguez Alvarez, Marjan Bakker, Marcel A. L. M. van Assen
Published in: Psychonomic Bulletin & Review, 2023, ISSN 1531-5320
Publisher: Springer
DOI: 10.3758/s13423-022-02235-5

A survey among academic researchers in the Netherlands

Author(s): Gowri Gopalakrishna; Gerben ter Riet; Gerko Vink; Ineke Stoop; Jelte M. Wicherts; Lex M. Bouter
Published in: PLoS ONE, Issue 19326203, 2022, ISSN 1932-6203
Publisher: Public Library of Science
DOI: 10.31222/osf.io/vk9yt

Recommendations in pre-registrations and internal review board proposals promote formal power analyses but do not increase sample size

Author(s): Marjan Bakker, Coosje L. S. Veldkamp, Olmo R. van den Akker, Marcel A. L. M. van Assen, Elise Crompvoets, How Hwee Ong, Jelte M. Wicherts
Published in: PLOS ONE, Issue 15/7, 2020, Page(s) e0236079, ISSN 1932-6203
Publisher: Public Library of Science
DOI: 10.1371/journal.pone.0236079

The role of meta- analysis and preregistration in assessing the evidence for cleansing e!ects

Author(s): Robert M. Ross, Robbie C. M. van Aert, Olmo R. van den Akker, Michiel van Elk
Published in: Behavioral and Brain Sciences, 2021, ISSN 0140-525X
Publisher: Cambridge University Press
DOI: 10.1017/s0140525x20000606

Meta-Analyzing the Multiverse: A Peek Under the Hood of Selective Reporting

Author(s): Anton Olsson Collentine, Robbie C.M. van Aert, Marjan Bakker, Jelte M. Wicherts
Published in: Psychological Methods, 2023, ISSN 1082-989X
Publisher: American Psychological Association
DOI: 10.1037/met0000559

Ensuring the quality and specificity of preregistrations

Author(s): Marjan Bakker, Coosje L. S. Veldkamp, Marcel A. L. M. van Assen, Elise A. V. Crompvoets, How Hwee Ong, Brian A. Nosek, Courtney K. Soderberg, David Mellor, Jelte M. Wicherts
Published in: PLOS Biology, Issue 18/12, 2020, Page(s) e3000937, ISSN 1545-7885
Publisher: PLOS
DOI: 10.1371/journal.pbio.3000937

Analyzing Data of a Multilab Replication Project With Individual Participant Data Meta-Analysis

Author(s): Robbie C. M. van Aert
Published in: Zeitschrift für Psychologie, 2022, ISSN 2190-8370
Publisher: Hogrefe
DOI: 10.1027/2151-2604/a000483

Heterogeneity in direct replications in psychology and its association with effect size.

Author(s): Anton Olsson-Collentine, Jelte M. Wicherts, Marcel A. L. M. van Assen
Published in: Psychological Bulletin, 2020, ISSN 0033-2909
Publisher: American Psychological Association
DOI: 10.1037/bul0000294

Sex differences in trust and trustworthiness: A meta-analysis of the trust game and the gift-exchange game

Author(s): Olmo R. van den Akker, Marcel A.L.M. van Assen, Mark van Vugt, Jelte M. Wicherts
Published in: Journal of Economic Psychology, 2020, ISSN 0167-4870
Publisher: North-Holland Publ Co
DOI: 10.1016/j.joep.2020.102329

Bayesian hypothesis testing and estimation under the marginalized random-effects meta-analysis model

Author(s): Robbie C.M. van Aert, Joris Mulder
Published in: Psychonomic Bulletin and Review, 2022, ISSN 1069-9384
Publisher: Psychonomic Society Inc.
DOI: 10.3758/s13423-021-01918-9

Times are changing, bias isn’t: A meta-meta-analysis on publication bias detection practices, prevalence rates, and predictors in industrial/organizational psychology.

Author(s): Siegel, M. Eder, J. S. N. Wicherts, J. M. Pietschnig, J
Published in: Journal of Applied Psychology, 2021, ISSN 0021-9010
Publisher: American Psychological Association
DOI: 10.1037/apl0000991

Effect Sizes, Power, and Biases in Intelligence Research: A Meta-Meta-Analysis

Author(s): Nuijten, Michèle B.; Assen, Marcel A. L. M. van; Augusteijn, Hilde E. M.; Crompvoets, Elise A. V.; Wicherts, Jelte M.
Published in: Journal of Intelligence, 2020, ISSN 2079-3200
Publisher: MDPI
DOI: 10.3390/jintelligence8040036

Study specific prediction intervals for random-effects meta-analysis: A tutorial

Author(s): Robbie C. M. van Aert, Christopher H. Schmid, David Svensson, Dan Jackson
Published in: Research Synthesis Methods, 2020, ISSN 1759-2887
Publisher: Wiley
DOI: 10.1002/jrsm.1490

Preregistration of secondary data analysis: A template and tutorial

Author(s): Olmo van den Akker, Sara Weston, Lorne Campbell, Bill Chopik, Rodica Damian, Pamela Davis-Kean, Andrew Hall, Jessica Kosie, Elliott Kruse, Jerome Olsen, Stuart Ritchie, KD Valentine, Anna van 't Veer, Marjan Bakker
Published in: Meta-psychology, 2021, ISSN 2003-2714
Publisher: Linnaeus University
DOI: 10.15626/mp.2020.2625

The Weak Spots in Contemporary Science (and How to Fix Them)

Author(s): Jelte Wicherts
Published in: Animals, Issue 7/12, 2017, Page(s) 90, ISSN 2076-2615
Publisher: MDPI
DOI: 10.3390/ani7120090

Distinguishing Specific from General Effects in Cognition Research

Author(s): Esther Maassen, Jelte M. Wicherts
Published in: Journal of Applied Research in Memory and Cognition, Issue 8/3, 2019, Page(s) 288-292, ISSN 2211-3681
Publisher: Elsevier BV
DOI: 10.1016/j.jarmac.2019.06.007

Modeling Interactions Between Latent Variables in Research on Type D Personality: A Monte Carlo Simulation and Clinical Study of Depression and Anxiety

Author(s): Paul Lodder, Johan Denollet, Wilco H. M. Emons, Giesje Nefs, Frans Pouwer, Jane Speight, Jelte M. Wicherts
Published in: Multivariate Behavioral Research, Issue 54/5, 2019, Page(s) 637-665, ISSN 0027-3171
Publisher: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/00273171.2018.1562863

Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis

Author(s): Robbie C. M. van Aert, Jelte M. Wicherts, Marcel A. L. M. van Assen
Published in: PLOS ONE, Issue 14/4, 2019, Page(s) e0215052, ISSN 1932-6203
Publisher: Public Library of Science
DOI: 10.1371/journal.pone.0215052

A comprehensive meta-analysis of money priming.

Author(s): Paul Lodder, How Hwee Ong, Raoul P. P. P. Grasman, Jelte M. Wicherts
Published in: Journal of Experimental Psychology: General, Issue 148/4, 2019, Page(s) 688-712, ISSN 0096-3445
Publisher: American Psychological Association
DOI: 10.1037/xge0000570

Verify original results through reanalysis before replicating

Author(s): Michèle B. Nuijten, Marjan Bakker, Esther Maassen, Jelte M. Wicherts
Published in: Behavioral and Brain Sciences, Issue 41, 2018, ISSN 0140-525X
Publisher: Cambridge University Press
DOI: 10.1017/s0140525x18000791

Reproducibility of individual effect sizes in meta-analyses in psychology

Author(s): Esther Maassen, Marcel A. L. M. van Assen, Michèle B. Nuijten, Anton Olsson-Collentine, Jelte M. Wicherts
Published in: PLOS ONE, Issue 15/5, 2020, Page(s) e0233107, ISSN 1932-6203
Publisher: Public Library of Science
DOI: 10.1371/journal.pone.0233107

Analyzing the moderating effects of premeasured performance

Author(s): Andrea Helena Stoevenbelt; Paulette Carien Flore; Inga Schwabe; Jelte M. Wicherts
Published in: Intelligence, Issue 01602896, 2022, ISSN 0160-2896
Publisher: Elsevier BV
DOI: 10.1016/j.intell.2022.101655

A community-sourced glossary of open scholarship terms

Author(s): Parsons, Sam; Azevedo, Flávio; Elsherif, Mahmoud M; Guay, Samuel; Shahim, Owen N; Govaart, Gisela H; Norris, Emma; O’Mahony, Aoife; Parker, Adam J; Todorovic, Ana; Pennington, Charlotte R; Garcia-Pelegrin, Elias; Lazić, Aleksandra; Robertson, Olly; Middleton, Sara L; Valentini, Beatrice; McCuaig, Joanne; Baker, Bradley J; Collins, Elizabeth; Fillon, Adrien A; Lonsdorf, Tina B; Lim, Michele C;
Published in: Nature Human Behaviour, 2022, ISSN 2397-3374
Publisher: Nature Publishing Group
DOI: 10.1038/s41562-021-01269-4

Prevalence of responsible research practices among academics in The Netherlands

Author(s): Gowri Gopalakrishna; Jelte M. Wicherts; Gerko Vink; Ineke Stoop; Olmo R. van den Akker; Gerben ter Riet; Lex M. Bouter
Published in: F1000 Research, Issue 20461402, 2022, ISSN 2046-1402
Publisher: F1000 Research Ltd.
DOI: 10.12688/f1000research.110664.1

A new justification of the Hartung‐Knapp method for random‐effects meta‐analysis based on weighted least squares regression

Author(s): Robbie C. M. Aert, Dan Jackson
Published in: Research Synthesis Methods, Issue 10/4, 2019, Page(s) 515-527, ISSN 1759-2879
Publisher: John Wiley & Sons Ltd.
DOI: 10.1002/jrsm.1356

The meta-plot: A graphical tool for interpreting the results of a meta-analysis

Author(s): Marcel A.L.M. van Assen, Olmo R. van den Akker, Hilde Augusteijn, Marjan Bakker, Michèle B. Nuijten, Anton Olsson-Collentine, Andrea H. Stoevenbelt, Jelte M. Wicherts, Robbie C. M. van Aert
Published in: Zeitschrift für Psychologie, 2023, ISSN 2151-2604
Publisher: Hogrefe
DOI: 10.1027/2151-2604/a000513

Latent logistic interaction modeling: A simulation and empirical illustration of Type D personality

Author(s): Paul Lodder, Wilco H.M. Emons, Johan Denollet, Jelte M. Wicherts
Published in: Structural Equation Modeling: A Multidisciplinary Journal, 2020, Page(s) 1-23, ISSN 1070-5511
Publisher: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/10705511.2020.1838905

How to protect privacy in open data

Author(s): Jelte M. Wicherts, Richard A. Klein, Sofie H. F. Swaans, Esther Maassen, Andrea H. Stoevenbelt, Victor H. B. T. G. Peeters, Myrthe de Jonge, Franziska Rüffer
Published in: Nature Human Behaviour, 2022, ISSN 2397-3374
Publisher: Nature Publishing Group
DOI: 10.1038/s41562-022-01481-w

Other (7)

Correcting for outcome reporting bias in a meta-analysis: A meta-regression approach

Author(s): Robbie C. M. van Aert, Jelte M. Wicherts
Published in: MetaArXiv, 2022
Publisher: The Berkeley Initiative for Transparency in the Social Sciences (BITSS)
DOI: 10.31222/osf.io/bn8vd

Privacy Protection in the Era of Open Science

Author(s): Jelte M. Wicherts, Richard A. Klein, Sofie H. F. Swaans, Esther Maassen, Andrea H. Stoevenbelt, C.H.J. Hartgerink, Victor H.B.T.G Peeters, Myrthe de Jonge, Franziska Rüffer
Published in: PsyArXiv, 2022
Publisher: Center for Open Science
DOI: 10.31234/osf.io/ybzu9

The Dire Disregard of Measurement Invariance Testing in Psychological Science

Author(s): Epifanio Damiano D'Urso, Esther Maassen, Marcel A.L.M. van Assen, Michèle B. Nuijten, Kim De Roover, Jelte M. Wicherts
Published in: PsyArXiv, 2022
Publisher: Center for Open Science
DOI: 10.31234/osf.io/n3f5u

The effectiveness of implementing statcheck in the peer review process to avoid statistical reporting errors

Author(s): Michèle B. Nuijten, Jelte M. Wicherts
Published in: PsyArXiv, 2023
Publisher: Center for Open Science
DOI: 10.31234/osf.io/bxau9

Science Abstract Model Simulation Framework

Author(s): Amir M. Abdol, Jelte M. Wicherts
Published in: PsyArXiv, 2021
Publisher: Center for Open Science
DOI: 10.31234/osf.io/zy29t

Selective Hypothesis Reporting in Psychology: Comparing Preregistrations and Corresponding Publications

Author(s): Olmo R. van den Akker, Marcel A.L.M. van Assen, Manon Enting, Myrthe de Jonge, How Hwee Ong, Franziska Rüffer, Martijn Schoenmakers, Andrea H. Stoevenbelt, Jelte M. Wicherts, Marjan Bakker
Published in: MetaArXiv, 2022
Publisher: The Berkeley Initiative for Transparency in the Social Sciences (BITSS)
DOI: 10.31222/osf.io/nf6mq

Quality assessment of scientific manuscripts in peer review and education

Author(s): Hilde E.M. Augusteijn, Jelte M. Wicherts, Klaas Sijtsma, Marcel A.L.M. van Assen
Published in: OSF Preprint, 2023
Publisher: OSF
DOI: 10.31219/osf.io/7dc6a