1. Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
- Author
-
Ebersole, Charles R, Mathur, Maya B, Baranski, Erica, Bart-Plange, Diane-Jo, Buttrick, Nicholas R, Chartier, Christopher R, Corker, Katherine S, Corley, Martin, Hartshorne, Joshua K, IJzerman, Hans, Lazarević, Ljiljana B, Rabagliati, Hugh, Ropovik, Ivan, Aczel, Balazs, Aeschbach, Lena F, Andrighetto, Luca, Arnal, Jack D, Arrow, Holly, Babincak, Peter, Bakos, Bence E, Baník, Gabriel, Baskin, Ernest, Belopavlović, Radomir, Bernstein, Michael H, Białek, Michał, Bloxsom, Nicholas G, Bodroža, Bojana, Bonfiglio, Diane BV, Boucher, Leanne, Brühlmann, Florian, Brumbaugh, Claudia C, Casini, Erica, Chen, Yiling, Chiorri, Carlo, Chopik, William J, Christ, Oliver, Ciunci, Antonia M, Claypool, Heather M, Coary, Sean, Čolić, Marija V, Collins, W Matthew, Curran, Paul G, Day, Chris R, Dering, Benjamin, Dreber, Anna, Edlund, John E, Falcão, Filipe, Fedor, Anna, Feinberg, Lily, Ferguson, Ian R, Ford, Máire, Frank, Michael C, Fryberger, Emily, Garinther, Alexander, Gawryluk, Katarzyna, Ashbaugh, Kayla, Giacomantonio, Mauro, Giessner, Steffen R, Grahe, Jon E, Guadagno, Rosanna E, Hałasa, Ewa, Hancock, Peter JB, Hilliard, Rias A, Hüffmeier, Joachim, Hughes, Sean, Idzikowska, Katarzyna, Inzlicht, Michael, Jern, Alan, Jiménez-Leal, William, Johannesson, Magnus, Joy-Gaba, Jennifer A, Kauff, Mathias, Kellier, Danielle J, Kessinger, Grecia, Kidwell, Mallory C, Kimbrough, Amanda M, King, Josiah PJ, Kolb, Vanessa S, Kołodziej, Sabina, Kovacs, Marton, Krasuska, Karolina, Kraus, Sue, Krueger, Lacy E, Kuchno, Katarzyna, Lage, Caio Ambrosio, Langford, Eleanor V, Levitan, Carmel A, de Lima, Tiago Jessé Souza, Lin, Hause, Lins, Samuel, Loy, Jia E, Manfredi, Dylan, Markiewicz, Łukasz, Menon, Madhavi, Mercier, Brett, Metzger, Mitchell, Meyet, Venus, Millen, Ailsa E, Miller, Jeremy K, and Montealegre, Andres
- Subjects
Psychology ,Cognitive and Computational Psychology ,Applied and Developmental Psychology ,Behavioral and Social Science ,replication ,reproducibility ,metascience ,peer review ,Registered Reports ,open data ,preregistered ,Applied and developmental psychology ,Cognitive and computational psychology - Abstract
Replication studies in psychological science sometimes fail to reproduce prior findings. If these studies use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to replicate may be a failure of the protocol rather than a challenge to the original finding. Formal pre-data-collection peer review by experts may address shortcomings and increase replicability rates. We selected 10 replication studies from the Reproducibility Project: Psychology (RP:P; Open Science Collaboration, 2015) for which the original authors had expressed concerns about the replication designs before data collection; only one of these studies had yielded a statistically significant effect (p
- Published
- 2020