Search

Your search keyword '"Zrubka, Mark"' showing total 39 results
Start Over Author "Zrubka, Mark"
39 results on '"Zrubka, Mark"'

2. Interpreting nonsignificant findings in psychological research

Author

Palfi, Bence, Szollosi, Aba, Szaszi, Barnabas, Kovacs, Marton, Zrubka, Mark, Szecsi, Peter, Aczel, Balazs, and Wagenmakers, Eric-Jan

Abstract

In this study, we examined the current practice and alternative methods for interpreting nonsignificant findings inpsychological research. The traditional null-hypothesis testing presents a challenge for researchers to interpret nonsignificantfindings. We reviewed the abstracts of all empirical articles published in three high-esteem psychological journals in 2015and selected those which referred to a nonsignificant result (N=134).We found that the majority of the statements interpretedthe results only within the sample, yet in 23% the authors inferred from the results to the absence of an effect. Bayes factoranalyses on these statistics indicated that the support of these results for the null-hypothesis is strong only in 4%, moderate in70% and anecdotal in 26%. The results revealed that Bayes factor analysis can help researchers in interpreting nonsignificantresults and also highlight that psychological studies with traditional sample sizes are unlikely to present strong evidence for thenull-hypothesis.

Published
2017

3. Registered Replication Report : Dijksterhuis and van Knippenberg (1998)

Author

O’Donnell, Michael, Nelson, Leif D., Ackermann, Evi, Aczel, Balazs, Akhtar, Athfah, Aldrovandi, Silvio, Alshaif, Nasseem, Andringa, Ronald, Aveyard, Mark, Babincak, Peter, Balatekin, Nursena, Baldwin, Scott A., Banik, Gabriel, Baskin, Ernest, Bell, Raoul, Białobrzeska, Olga, Birt, Angie R., Boot, Walter R., Braithwaite, Scott R., Briggs, Jessie C., Buchner, Axel, Budd, Desiree, Budzik, Kathryn, Bullens, Lottie, Bulley, Richard L., Cannon, Peter R., Cantarero, Katarzyna, Cesario, Joseph, Chambers, Stephanie, Chartier, Christopher R., Chekroun, Peggy, Chong, Clara, Cleeremans, Axel, Coary, Sean P., Coulthard, Jacob, Cramwinckel, Florien M., Denson, Thomas F., Díaz-Lago, Marcos, DiDonato, Theresa E., Drummond, Aaron, Eberlen, Julia, Ebersbach, Titus, Edlund, John E., Finnigan, Katherine M., Fisher, Justin, Frankowska, Natalia, García-Sánchez, Efraín, Golom, Frank D., Graves, Andrew J., Greenberg, Kevin, Hanioti, Mando, Hansen, Heather A., Harder, Jenna A., Harrell, Erin R., Hartanto, Andree, Inzlicht, Michael, Johnson, David J., Karpinski, Andrew, Keller, Victor N., Klein, Olivier, Koppel, Lina, Krahmer, Emiel, Lantian, Anthony, Larson, Michael J., Légal, Jean-Baptiste, Lucas, Richard E., Lynott, Dermot, Magaldino, Corey M., Massar, Karlijn, McBee, Matthew T., McLatchie, Neil, Melia, Nadhilla, Mensink, Michael C., Mieth, Laura, Moore-Berg, Samantha, Neeser, Geraldine, Newell, Ben R., Noordewier, Marret K., Özdogru, Asil Ali, Pantazi, Myrto, Parzuchowski, Michał, Peters, Kim, Philipp, Michael C., Pollmann, Monique M. H., Rentzelas, Panagiotis, Rodríguez-Bailón, Rosa, Röer, Jan Philipp, Ropovik, Ivan, Roque, Nelson A., Rueda, Carolina, Rutjens, Bastiaan T., Sackett, Katey, Salamon, Janos, Sánchez-Rodríguez, Ángel, Saunders, Blair, Schaafsma, Juliette, Schulte-Mecklenbeck, Michael, Shanks, David R., Sherman, Martin F., Steele, Kenneth M., Steffens, Niklas K., Sun, Jessie, Susa, Kyle J., Szaszi, Barnabas, Szollosi, Aba, Tamayo, Ricardo M., Tinghög, Gustav, Tong, Yuk-yue, Tweten, Carol, Vadillo, Miguel A., Valcarcel, Deisy, Van der Linden, Nicolas, van Elk, Michiel, van Harreveld, Frenk, Västfjäll, Daniel, Vazire, Simine, Verduyn, Philippe, Williams, Matt N., Willis, Guillermo B., Wood, Sarah E., Yang, Chunliang, Zerhouni, Oulmann, Zheng, Robert, and Zrubka, Mark

Published
2018

4. Correction to: ‘Raising the value of research studies in psychological science by increasing the credibility of research reports: The Transparent Psi Project’ (2023) by Kekecs et al.

Author

Kekecs, Zoltan, primary, Palfi, Bence, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Zrubka, Mark, additional, Kovacs, Marton, additional, Bakos, Bence E., additional, Cousineau, Denis, additional, Tressoldi, Patrizio, additional, Schmidt, Kathleen, additional, Grassi, Massimo, additional, Evans, Thomas Rhys, additional, Yamada, Yuki, additional, Miller, Jeremy K., additional, Liu, Huanxu, additional, Yonemitsu, Fumiya, additional, Dubrov, Dmitrii, additional, Röer, Jan Philipp, additional, Becker, Marvin, additional, Schnepper, Roxane, additional, Ariga, Atsunori, additional, Arriaga, Patrícia, additional, Oliveira, Raquel, additional, Põldver, Nele, additional, Kreegipuu, Kairi, additional, Hall, Braeden, additional, Wiechert, Sera, additional, Verschuere, Bruno, additional, Girán, Kyra, additional, and Aczel, Balazs, additional

Published
2023
Full Text
View/download PDF

5. Supplement from Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project

Author

Kekecs, Zoltan, Palfi, Bence, Szaszi, Barnabas, Szecsi, Peter, Zrubka, Mark, Kovacs, Marton, Bakos, Bence E., Cousineau, Denis, Tressoldi, Patrizio, Schmidt, Kathleen, Grassi, Massimo, Evans, Thomas Rhys, Yamada, Yuki, Miller, Jeremy K., Liu, Huanxu, Yonemitsu, Fumiya, Dubrov, Dmitrii, Röer, Jan Philipp, Becker, Marvin, Schnepper, Roxane, Ariga, Atsunori, Arriaga, Patrícia, Oliveira, Raquel, Põldver, Nele, Kreegipuu, Kairi, Hall, Braeden, Wiechert, Sera, Verschuere, Bruno, Girán, Kyra, and Aczel, Balazs

Abstract

This document contains supplementary information for the manuscript

Published
2023
Full Text
View/download PDF

6. Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project

Author

Kekecs, Zoltan, primary, Palfi, Bence, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Zrubka, Mark, additional, Kovacs, Marton, additional, Bakos, Bence E., additional, Cousineau, Denis, additional, Tressoldi, Patrizio, additional, Schmidt, Kathleen, additional, Grassi, Massimo, additional, Evans, Thomas Rhys, additional, Yamada, Yuki, additional, Miller, Jeremy K., additional, Liu, Huanxu, additional, Yonemitsu, Fumiya, additional, Dubrov, Dmitrii, additional, Röer, Jan Philipp, additional, Becker, Marvin, additional, Schnepper, Roxane, additional, Ariga, Atsunori, additional, Arriaga, Patrícia, additional, Oliveira, Raquel, additional, Põldver, Nele, additional, Kreegipuu, Kairi, additional, Hall, Braeden, additional, Wiechert, Sera, additional, Verschuere, Bruno, additional, Girán, Kyra, additional, and Aczel, Balazs, additional

Published
2023
Full Text
View/download PDF

8. Preprint

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Published
2022
Full Text
View/download PDF

9. Consensus Design

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Published
2022
Full Text
View/download PDF

10. TPP Materials

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Abstract

Transparent Psi Project Stage 1 RR preregistration

Published
2022
Full Text
View/download PDF

11. Data collection software code

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Abstract

Code and specification of the data collection software

Published
2022
Full Text
View/download PDF

12. Data handling and DPIA

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Subjects
ComputingMethodologies_DOCUMENTANDTEXTPROCESSING, ComputingMilieux_LEGALASPECTSOFCOMPUTING
Abstract

Documents related to data protection

Published
2022
Full Text
View/download PDF

15. RR Stage 1 Manuscript

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Abstract

Registered Report manuscript at Stage 1 in principle acceptance

Published
2022
Full Text
View/download PDF

16. Pilot study materials

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Published
2022
Full Text
View/download PDF

17. Data

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Abstract

Data of the main study

Published
2022
Full Text
View/download PDF

19. Laboratory logs

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Published
2022
Full Text
View/download PDF

20. Analysis code

Author

Kekecs, Zoltan, Aczel, Balazs, Palfi, Bence, Szaszi, Barnabas, Zrubka, Mark, Szecsi, Peter, Kovacs, Marton, and Bakos, Bence

Abstract

Code for statistical analysis

Published
2022
Full Text
View/download PDF

21. ML5: Replications of Risen & Gilovich (2008)

Author

Mathur, Maya, Lins, Samuel, vanpaemel, wolf, Bernstein, Michael, Banaie, S., Moore, Don, Bart-Plange, Diane-Jo, Lage, Caio, tuerlinckx, francis, steegen, sara, Falcão, Filipe, Manfredi, Dylan, Silva, Rúben, Ramos, Tiago, Szaszi, Barnabas, Zrubka, Mark, Wiggins, Bradford, Tullett, Alexa, and Salamon, Janos

Published
2022
Full Text
View/download PDF

23. Many Labs 5: Registered Multisite Replication of the Tempting-Fate Effects in Risen and Gilovich (2008)

Author

Mathur, Maya B., primary, Bart-Plange, Diane-Jo, additional, Aczel, Balazs, additional, Bernstein, Michael H., additional, Ciunci, Antonia M., additional, Ebersole, Charles R., additional, Falcão, Filipe, additional, Ashbaugh, Kayla, additional, Hilliard, Rias A., additional, Jern, Alan, additional, Kellier, Danielle J., additional, Kessinger, Grecia, additional, Kolb, Vanessa S., additional, Kovacs, Marton, additional, Lage, Caio Ambrosio, additional, Langford, Eleanor V., additional, Lins, Samuel, additional, Manfredi, Dylan, additional, Meyet, Venus, additional, Moore, Don A., additional, Nave, Gideon, additional, Nunnally, Christian, additional, Palinkas, Anna, additional, Parks, Kimberly P., additional, Pessers, Sebastiaan, additional, Ramos, Tiago, additional, Rudy, Kaylis Hase, additional, Salamon, Janos, additional, Shubella, Rachel L., additional, Silva, Rúben, additional, Steegen, Sara, additional, Stein, L. A. R., additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Tuerlinckx, Francis, additional, Vanpaemel, Wolf, additional, Vlachou, Maria, additional, Wiggins, Bradford J., additional, Zealley, David, additional, Zrubka, Mark, additional, and Frank, Michael C., additional

Published
2020
Full Text
View/download PDF

24. Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Author

Ebersole, Charles R., primary, Mathur, Maya B., additional, Baranski, Erica, additional, Bart-Plange, Diane-Jo, additional, Buttrick, Nicholas R., additional, Chartier, Christopher R., additional, Corker, Katherine S., additional, Corley, Martin, additional, Hartshorne, Joshua K., additional, IJzerman, Hans, additional, Lazarević, Ljiljana B., additional, Rabagliati, Hugh, additional, Ropovik, Ivan, additional, Aczel, Balazs, additional, Aeschbach, Lena F., additional, Andrighetto, Luca, additional, Arnal, Jack D., additional, Arrow, Holly, additional, Babincak, Peter, additional, Bakos, Bence E., additional, Baník, Gabriel, additional, Baskin, Ernest, additional, Belopavlović, Radomir, additional, Bernstein, Michael H., additional, Białek, Michał, additional, Bloxsom, Nicholas G., additional, Bodroža, Bojana, additional, Bonfiglio, Diane B. V., additional, Boucher, Leanne, additional, Brühlmann, Florian, additional, Brumbaugh, Claudia C., additional, Casini, Erica, additional, Chen, Yiling, additional, Chiorri, Carlo, additional, Chopik, William J., additional, Christ, Oliver, additional, Ciunci, Antonia M., additional, Claypool, Heather M., additional, Coary, Sean, additional, Čolić, Marija V., additional, Collins, W. Matthew, additional, Curran, Paul G., additional, Day, Chris R., additional, Dering, Benjamin, additional, Dreber, Anna, additional, Edlund, John E., additional, Falcão, Filipe, additional, Fedor, Anna, additional, Feinberg, Lily, additional, Ferguson, Ian R., additional, Ford, Máire, additional, Frank, Michael C., additional, Fryberger, Emily, additional, Garinther, Alexander, additional, Gawryluk, Katarzyna, additional, Ashbaugh, Kayla, additional, Giacomantonio, Mauro, additional, Giessner, Steffen R., additional, Grahe, Jon E., additional, Guadagno, Rosanna E., additional, Hałasa, Ewa, additional, Hancock, Peter J. B., additional, Hilliard, Rias A., additional, Hüffmeier, Joachim, additional, Hughes, Sean, additional, Idzikowska, Katarzyna, additional, Inzlicht, Michael, additional, Jern, Alan, additional, Jiménez-Leal, William, additional, Johannesson, Magnus, additional, Joy-Gaba, Jennifer A., additional, Kauff, Mathias, additional, Kellier, Danielle J., additional, Kessinger, Grecia, additional, Kidwell, Mallory C., additional, Kimbrough, Amanda M., additional, King, Josiah P. J., additional, Kolb, Vanessa S., additional, Kołodziej, Sabina, additional, Kovacs, Marton, additional, Krasuska, Karolina, additional, Kraus, Sue, additional, Krueger, Lacy E., additional, Kuchno, Katarzyna, additional, Lage, Caio Ambrosio, additional, Langford, Eleanor V., additional, Levitan, Carmel A., additional, de Lima, Tiago Jessé Souza, additional, Lin, Hause, additional, Lins, Samuel, additional, Loy, Jia E., additional, Manfredi, Dylan, additional, Markiewicz, Łukasz, additional, Menon, Madhavi, additional, Mercier, Brett, additional, Metzger, Mitchell, additional, Meyet, Venus, additional, Millen, Ailsa E., additional, Miller, Jeremy K., additional, Montealegre, Andres, additional, Moore, Don A., additional, Muda, Rafał, additional, Nave, Gideon, additional, Nichols, Austin Lee, additional, Novak, Sarah A., additional, Nunnally, Christian, additional, Orlić, Ana, additional, Palinkas, Anna, additional, Panno, Angelo, additional, Parks, Kimberly P., additional, Pedović, Ivana, additional, Pękala, Emilian, additional, Penner, Matthew R., additional, Pessers, Sebastiaan, additional, Petrović, Boban, additional, Pfeiffer, Thomas, additional, Pieńkosz, Damian, additional, Preti, Emanuele, additional, Purić, Danka, additional, Ramos, Tiago, additional, Ravid, Jonathan, additional, Razza, Timothy S., additional, Rentzsch, Katrin, additional, Richetin, Juliette, additional, Rife, Sean C., additional, Rosa, Anna Dalla, additional, Rudy, Kaylis Hase, additional, Salamon, Janos, additional, Saunders, Blair, additional, Sawicki, Przemysław, additional, Schmidt, Kathleen, additional, Schuepfer, Kurt, additional, Schultze, Thomas, additional, Schulz-Hardt, Stefan, additional, Schütz, Astrid, additional, Shabazian, Ani N., additional, Shubella, Rachel L., additional, Siegel, Adam, additional, Silva, Rúben, additional, Sioma, Barbara, additional, Skorb, Lauren, additional, de Souza, Luana Elayne Cunha, additional, Steegen, Sara, additional, Stein, L. A. R., additional, Sternglanz, R. Weylin, additional, Stojilović, Darko, additional, Storage, Daniel, additional, Sullivan, Gavin Brent, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Szöke, Orsolya, additional, Szuts, Attila, additional, Thomae, Manuela, additional, Tidwell, Natasha D., additional, Tocco, Carly, additional, Torka, Ann-Kathrin, additional, Tuerlinckx, Francis, additional, Vanpaemel, Wolf, additional, Vaughn, Leigh Ann, additional, Vianello, Michelangelo, additional, Viganola, Domenico, additional, Vlachou, Maria, additional, Walker, Ryan J., additional, Weissgerber, Sophia C., additional, Wichman, Aaron L., additional, Wiggins, Bradford J., additional, Wolf, Daniel, additional, Wood, Michael J., additional, Zealley, David, additional, Žeželj, Iris, additional, Zrubka, Mark, additional, and Nosek, Brian A., additional

Published
2020
Full Text
View/download PDF

25. ML5_Overview_Open_Practices_Disclosure_Rev – Supplemental material for Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability

Author

Ebersole, Charles R., Mathur, Maya B., Baranski, Erica, Diane-Jo Bart-Plange, Buttrick, Nicholas R., Chartier, Christopher R., Corker, Katherine S., Corley, Martin, Hartshorne, Joshua K., IJzerman, Hans, Lazarević, Ljiljana B., Rabagliati, Hugh, Ropovik, Ivan, Balazs Aczel, Aeschbach, Lena F., Andrighetto, Luca, Arnal, Jack D., Arrow, Holly, Babincak, Peter, Bakos, Bence E., Baník, Gabriel, Baskin, Ernest, Belopavlović, Radomir, Bernstein, Michael H., Michał Białek, Bloxsom, Nicholas G., Bodroža, Bojana, Bonfiglio, Diane B. V., Boucher, Leanne, Brühlmann, Florian, Brumbaugh, Claudia C., Casini, Erica, Yiling Chen, Chiorri, Carlo, Chopik, William J., Christ, Oliver, Ciunci, Antonia M., Claypool, Heather M., Coary, Sean, Čolić, Marija V., W. Matthew Collins, Curran, Paul G., Day, Chris R., Dering, Benjamin, Dreber, Anna, Edlund, John E., Falcão, Filipe, Fedor, Anna, Feinberg, Lily, Ferguson, Ian R., Ford, Máire, Frank, Michael C., Fryberger, Emily, Garinther, Alexander, Gawryluk, Katarzyna, Ashbaugh, Kayla, Giacomantonio, Mauro, Giessner, Steffen R., Grahe, Jon E., Guadagno, Rosanna E., Hałasa, Ewa, Hancock, Peter J. B., Rias A. Hilliard, Hüffmeier, Joachim, Hughes, Sean, Idzikowska, Katarzyna, Inzlicht, Michael, Jern, Alan, Jiménez-Leal, William, Johannesson, Magnus, Joy-Gaba, Jennifer A., Kauff, Mathias, Kellier, Danielle J., Grecia Kessinger, Kidwell, Mallory C., Kimbrough, Amanda M., King, Josiah P. J., Kolb, Vanessa S., Kołodziej, Sabina, Marton Kovacs, Krasuska, Karolina, Kraus, Sue, Krueger, Lacy E., Kuchno, Katarzyna, Lage, Caio Ambrosio, Langford, Eleanor V., Levitan, Carmel A., Lima, Tiago Jessé Souza De, Hause Lin, Lins, Samuel, Loy, Jia E., Manfredi, Dylan, Łukasz Markiewicz, Menon, Madhavi, Mercier, Brett, Metzger, Mitchell, Meyet, Venus, Millen, Ailsa E., Miller, Jeremy K., Montealegre, Andres, Moore, Don A., Rafał Muda, Nave, Gideon, Nichols, Austin Lee, Novak, Sarah A., Nunnally, Christian, Orlić, Ana, Palinkas, Anna, Panno, Angelo, Parks, Kimberly P., Pedović, Ivana, Pękala, Emilian, Penner, Matthew R., Pessers, Sebastiaan, Petrović, Boban, Pfeiffer, Thomas, Pieńkosz, Damian, Preti, Emanuele, Purić, Danka, Ramos, Tiago, Ravid, Jonathan, Razza, Timothy S., Rentzsch, Katrin, Richetin, Juliette, Rife, Sean C., Rosa, Anna Dalla, Kaylis Hase Rudy, Janos Salamon, Saunders, Blair, Przemysław Sawicki, Schmidt, Kathleen, Schuepfer, Kurt, Schultze, Thomas, Schulz-Hardt, Stefan, Schütz, Astrid, Shabazian, Ani N., Shubella, Rachel L., Siegel, Adam, Rúben Silva, Sioma, Barbara, Skorb, Lauren, Souza, Luana Elayne Cunha De, Steegen, Sara, L. A. R. Stein, R. Weylin Sternglanz, Stojilović, Darko, Storage, Daniel, Sullivan, Gavin Brent, Szaszi, Barnabas, Szecsi, Peter, Szöke, Orsolya, Szuts, Attila, Thomae, Manuela, Tidwell, Natasha D., Tocco, Carly, Ann-Kathrin Torka, Tuerlinckx, Francis, Vanpaemel, Wolf, Vaughn, Leigh Ann, Vianello, Michelangelo, Viganola, Domenico, Vlachou, Maria, Walker, Ryan J., Weissgerber, Sophia C., Wichman, Aaron L., Wiggins, Bradford J., Wolf, Daniel, Wood, Michael J., Zealley, David, Žeželj, Iris, Zrubka, Mark, and Nosek, Brian A.

Subjects
FOS: Psychology, FOS: Clinical medicine, 170199 Psychology not elsewhere classified, 110319 Psychiatry (incl. Psychotherapy)
Abstract

Supplemental material, ML5_Overview_Open_Practices_Disclosure_Rev for Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability by Charles R. Ebersole, Maya B. Mathur, Erica Baranski, Diane-Jo Bart-Plange, Nicholas R. Buttrick, Christopher R. Chartier, Katherine S. Corker, Martin Corley, Joshua K. Hartshorne, Hans IJzerman, Ljiljana B. Lazarević, Hugh Rabagliati, Ivan Ropovik, Balazs Aczel, Lena F. Aeschbach, Luca Andrighetto, Jack D. Arnal, Holly Arrow, Peter Babincak, Bence E. Bakos, Gabriel Baník, Ernest Baskin, Radomir Belopavlović, Michael H. Bernstein, Michał Białek, Nicholas G. Bloxsom, Bojana Bodroža, Diane B. V. Bonfiglio, Leanne Boucher, Florian Brühlmann, Claudia C. Brumbaugh, Erica Casini, Yiling Chen, Carlo Chiorri, William J. Chopik, Oliver Christ, Antonia M. Ciunci, Heather M. Claypool, Sean Coary, Marija V. Čolić, W. Matthew Collins, Paul G. Curran, Chris R. Day, Benjamin Dering, Anna Dreber, John E. Edlund, Filipe Falcão, Anna Fedor, Lily Feinberg, Ian R. Ferguson, Máire Ford, Michael C. Frank, Emily Fryberger, Alexander Garinther, Katarzyna Gawryluk, Kayla Ashbaugh, Mauro Giacomantonio, Steffen R. Giessner, Jon E. Grahe, Rosanna E. Guadagno, Ewa Hałasa, Peter J. B. Hancock, Rias A. Hilliard, Joachim Hüffmeier, Sean Hughes, Katarzyna Idzikowska, Michael Inzlicht, Alan Jern, William Jiménez-Leal, Magnus Johannesson, Jennifer A. Joy-Gaba, Mathias Kauff, Danielle J. Kellier, Grecia Kessinger, Mallory C. Kidwell, Amanda M. Kimbrough, Josiah P. J. King, Vanessa S. Kolb, Sabina Kołodziej, Marton Kovacs, Karolina Krasuska, Sue Kraus, Lacy E. Krueger, Katarzyna Kuchno, Caio Ambrosio Lage, Eleanor V. Langford, Carmel A. Levitan, Tiago Jessé Souza de Lima, Hause Lin, Samuel Lins, Jia E. Loy, Dylan Manfredi, Łukasz Markiewicz, Madhavi Menon, Brett Mercier, Mitchell Metzger, Venus Meyet, Ailsa E. Millen, Jeremy K. Miller, Andres Montealegre, Don A. Moore, Rafał Muda, Gideon Nave, Austin Lee Nichols, Sarah A. Novak, Christian Nunnally, Ana Orlić, Anna Palinkas, Angelo Panno, Kimberly P. Parks, Ivana Pedović, Emilian Pękala, Matthew R. Penner, Sebastiaan Pessers, Boban Petrović, Thomas Pfeiffer, Damian Pieńkosz, Emanuele Preti, Danka Purić, Tiago Ramos, Jonathan Ravid, Timothy S. Razza, Katrin Rentzsch, Juliette Richetin, Sean C. Rife, Anna Dalla Rosa, Kaylis Hase Rudy, Janos Salamon, Blair Saunders, Przemysław Sawicki, Kathleen Schmidt, Kurt Schuepfer, Thomas Schultze, Stefan Schulz-Hardt, Astrid Schütz, Ani N. Shabazian, Rachel L. Shubella, Adam Siegel, Rúben Silva, Barbara Sioma, Lauren Skorb, Luana Elayne Cunha de Souza, Sara Steegen, L. A. R. Stein, R. Weylin Sternglanz, Darko Stojilović, Daniel Storage, Gavin Brent Sullivan, Barnabas Szaszi, Peter Szecsi, Orsolya Szöke, Attila Szuts, Manuela Thomae, Natasha D. Tidwell, Carly Tocco, Ann-Kathrin Torka, Francis Tuerlinckx, Wolf Vanpaemel, Leigh Ann Vaughn, Michelangelo Vianello, Domenico Viganola, Maria Vlachou, Ryan J. Walker, Sophia C. Weissgerber, Aaron L. Wichman, Bradford J. Wiggins, Daniel Wolf, Michael J. Wood, David Zealley, Iris Žeželj, Mark Zrubka and Brian A. Nosek in Advances in Methods and Practices in Psychological Science

Published
2020
Full Text
View/download PDF

26. MathurSupplementalMaterial ��� Supplemental material for Many Labs 5: Registered Multisite Replication of the Tempting-Fate Effects in Risen and Gilovich (2008)

Author

Mathur, Maya B., Jern, Alan, Kellier, Danielle J., Grecia Kessinger, Kolb, Vanessa S., Marton Kovacs, Lage, Caio Ambrosio, Langford, Eleanor V., Lins, Samuel, Manfredi, Dylan, Meyet, Venus, Diane-Jo Bart-Plange, Moore, Don A., Nave, Gideon, Nunnally, Christian, Palinkas, Anna, Parks, Kimberly P., Pessers, Sebastiaan, Ramos, Tiago, Kaylis Hase Rudy, Janos Salamon, Shubella, Rachel L., Balazs Aczel, R��ben Silva, Steegen, Sara, L. A. R. Stein, Szaszi, Barnabas, Szecsi, Peter, Tuerlinckx, Francis, Vanpaemel, Wolf, Vlachou, Maria, Wiggins, Bradford J., Zealley, David, Bernstein, Michael H., Zrubka, Mark, Frank, Michael C., Ciunci, Antonia M., Ebersole, Charles R., Falc��o, Filipe, Ashbaugh, Kayla, and Rias A. Hilliard

Subjects
FOS: Psychology, FOS: Clinical medicine, 170199 Psychology not elsewhere classified, 110319 Psychiatry (incl. Psychotherapy)
Abstract

Supplemental material, MathurSupplementalMaterial for Many Labs 5: Registered Multisite Replication of the Tempting-Fate Effects in Risen and Gilovich (2008) by Maya B. Mathur, Diane-Jo Bart-Plange, Balazs Aczel, Michael H. Bernstein, Antonia M. Ciunci, Charles R. Ebersole, Filipe Falc��o, Kayla Ashbaugh, Rias A. Hilliard, Alan Jern, Danielle J. Kellier, Grecia Kessinger, Vanessa S. Kolb, Marton Kovacs, Caio Ambrosio Lage, Eleanor V. Langford, Samuel Lins, Dylan Manfredi, Venus Meyet, Don A. Moore, Gideon Nave, Christian Nunnally, Anna Palinkas, Kimberly P. Parks, Sebastiaan Pessers, Tiago Ramos, Kaylis Hase Rudy, Janos Salamon, Rachel L. Shubella, R��ben Silva, Sara Steegen, L. A. R. Stein, Barnabas Szaszi, Peter Szecsi, Francis Tuerlinckx, Wolf Vanpaemel, Maria Vlachou, Bradford J. Wiggins, David Zealley, Mark Zrubka and Michael C. Frank in Advances in Methods and Practices in Psychological Science

Published
2020
Full Text
View/download PDF

27. Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability (results-blind manuscript)

Author

Pessers, Sebastiaan, Petrovic , Boban, Nichols , Austin, Metzger, Mitchell, Manfredi , Dylan, Mercier , Brett, Montealegre , Andres, Kuchno, Katarzyna, Millen , Ailsa, Levitan , Carmel, Nave , Gideon, Lage, Caio, Pedović, Ivana, Krueger , Lacy, Krasuska, Karolina, Kraus, Sue, Kovacs , Marton, Inzlicht , Michael, Hałasa, Ewa, Idzikowska, Katarzyna, Kołodziej, Sabina, Kimbrough, Amanda, Kauff , Mathias, Hancock , Peter, Jern, Alan, Kellier, Danielle, Leal, Wlliam, Hüffmeier, Joachim, Hughes , Sean, King , Josiah, Kidwell , Mallory, Johannesson , Magnus, Joy-Gaba , Jennifer, PęKala, Emilian, Penner, Matthew, Moore , Don, Menon, Madhavi, Langford, Eleanor, Panno, Angelo, Lima , Tiago, Lins , Samuel, Parks, Kimberly, Miller, Jeremy, Novak, Sarah, Markiewicz, Lukasz, Loy , J, Orlic, Ana, Lin , Hause, Guadagno, Rosanna, Grahe , Jon, Giessner , Steffen, Giacomantonio , Mauro, Gawryluk, Katarzyna, Garinther, Alexander, Fryberger, Emily, Frank , Michael, Ford, Máire, Ferguson, Ian, Feinberg, Lily, Fedor , Anna, Falcão, Filipe, Edlund , John, Dreber , Anna, Dering , Benjamin, Day, Chris, Curran , Paul, Collins, W., Čolić , Marija, Coary, Sean, Claypool, Heather, Christ , Oliver, Chopik , William, Chiorri, Carlo, Chen, Yiling, Casini, Erica, Brumbaugh , Claudia, Brühlmann, Florian, Boucher, Leanne, Bonfiglio, Diane, Bodroža, Bojana, Bialek , Michal, Bloxsom , Nicholas, Bernstein, Michael, Belopavlović, Radomir, Baskin, Ernest, Baník , Gabriel, Bakos, Bence, Babincak , Peter, Arrow, Holly, Arnal , Jack, Andrighetto, Luca, Aeschbach, Lena, Ropovik , Ivan, Lazarevic , Ljiljana, Aczel , Balazs, Ijzerman , Hans, Hartshorne , Joshua, Corker , Katherine, Corley , Martin, Buttrick , Nick, Baranski , Erica, Bart-Plange, Diane-Jo, Mathur , Maya, Chartier , Christopher, Rabagliati , Hugh, Campbell , Lorne, Ebersole , Charles, Salamon, Janos, Rife , Sean, Stojilović , Darko, Szecsi , Peter, Schulz-Hardt , Stefan, Weissgerber , Sophia, Tocco, Carly, Wichman , Aaron, Zrubka , Mark, Sullivan, Gavin, Schuepfer, Kurt, Rosa , Anna, Schultze , Thomas, Storage , Daniel, Schütz , Astrid, Stein, Lar, Schmidt , Kathleen, Razza, Timothy, Wolf, Daniel, Vaughn , Leigh, Saunders , Blair, Richetin , Juliette, Jimenez-Leal , William, Silva, Rúben, Sioma, Barbara, Viganola, Domenico, Vlachou, Maria, Szaszi , Barnabas, Rentzsch, Katrin, Vianello , Michelangelo, Szoke, Orsolya, Nosek , Brian, Ravid, Jon, Torka, Ann-Kathrin, Walker, Ryan, Skorb , Lauren, Sternglanz, R., Szuts , Attila, Tidwell, Natasha, Thomae , Manuela, De Souza, Luana, Zealley, David, Tuerlinckx , Francis, Steegen, Sara, Shabazian, Ani, Zezelj , Iris, Preti , Emanuele, Purić , Danka, Ramos, Tiago, Pieńkosz , Damian, Pfeiffer, Thomas, Wood, Michael, Sawicki, Przemyslaw, Wiggins , Bradford, and Vanpaemel , Wolf

Subjects
PsyArXiv|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences, bepress|Social and Behavioral Sciences|Psychology|Personality and Social Contexts, PsyArXiv|Social and Behavioral Sciences|Social and Personality Psychology
Abstract

Replication efforts in psychological science sometimes fail to replicate prior findings. If replications use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to replicate may be a failure of the replication protocol rather than a challenge to the original finding. Formal pre-data collection peer review by experts may address shortcomings and increase replicability rates. We selected 10 replications from the Reproducibility Project: Psychology (RP:P; Open Science Collaboration, 2015) in which the original authors had expressed concerns about the replication designs before data collection and only one of which was “statistically significant” (p < .05). Commenters on RP:P suggested that lack of adherence to expert review and low-powered tests were the reasons that most of these failed to replicate (Gilbert et al., 2016). We revised the replication protocols and received formal peer review prior to conducting new replications. We administered the RP:P and Revised replication protocols in multiple laboratories (Median number of laboratories per original study = XX; Range XX to YY; Median total sample = XX; Range XX to YY) for high-powered tests of each original finding with both protocols. Overall, XX of 10 RP:P protocols and XX of 10 Revised protocols showed significant evidence in the same direction as the original finding (p < .05), compared to an expected XX. The median effect size was [larger/smaller/similar] for Revised protocols (ES = .XX) compared to RP:P protocols (ES = .XX), and [larger/smaller/similar] compared to the original studies (ES = .XX) and [larger/smaller/similar] compared to the original RP:P replications (ES = .XX). Overall, Revised protocols produced [much larger/somewhat larger/similar] effect sizes compared to RP:P protocols (ES = .XX). We also elicited peer beliefs about the replications through prediction markets and surveys of a group of researchers in psychology. The peer researchers predicted that the Revised protocols would [decrease/not affect/increase] the replication rate, [consistent with/not consistent with] the observed replication results. The results suggest that the lack of replicability of these findings observed in RP:P was [partly/completely/not] due to discrepancies in the RP:P protocols that could be resolved with expert peer review.

Published
2019

28. Registered replication report: Dijksterhuis and van Knippenberg (1998)

Author

O'Donnell, Michael, Nelson, Leif D, Ackermann, Evi, Aczel, Balazs, Akhtar, Athfah, Aldrovandi, Silvio, Alshaif, Nasseem, Andringa, Ronald, Aveyard, Mark, Babincak, Peter, Balatekin, Nursena, Baldwin, Scott A, Banik, Gabriel, Baskin, Ernest, Bell, Raoul, Białobrzeska, Olga, Birt, Angie R, Boot, Walter R, Braithwaite, Scott R, Briggs, Jessie C, Buchner, Axel, Budd, Desiree, Budzik, Kathryn, Bullens, Lottie, Bulley, Richard L, Cannon, Peter R, Cantarero, Katarzyna, Cesario, Joseph, Chambers, Stephanie, Chartier, Christopher R., Chekroun, Peggy, Chong, Clara, Cleeremans, Axel, Coary, Sean P, Coulthard, Jacob, Cramwinckel, Florien M, Denson, Thomas F, Díaz-Lago, Marcos, DiDonato, Theresa E, Drummond, Aaron, Eberlen, Julia, Ebersbach, Titus, Edlund, John E, Finnigan, Katherine M, Fisher, Justin, Frankowska, Natalia, García-Sánchez, Efraín, Golom, Frank D, Graves, Andrew J, Greenberg, Kevin, Hanioti, Mando, Hansen, Heather A, Harder, Jenna A, Harrell, Erin R, Hartanto, Andree, Inzlicht, Michael, Johnson, David J., Karpinski, Andrew, Keller, Victor N, Klein, Olivier, Koppel, Lina, Krahmer, Emiel, Lantian, Anthony, Larson, Michael J, Légal, Jean-Baptiste, Lucas, Richard E, Lynott, Dermot, Magaldino, Corey M, Massar, Karlijn, McBee, Matthew T, McLatchie, Neil, Melia, Nadhilla, Mensink, Michael C, Mieth, Laura, Moore-Berg, Samantha, Neeser, Geraldine, Newell, Ben R, Noordewier, Marret K, Özdogğru, Asil Ali, Pantazi, Myrto, Parzuchowski, Michał, Peters, Kim, Philipp, Michael C, Pollmann, Monique M H, Rentzelas, Panagiotis, Rodríguez-Bailón, Rosa, Röer, Jan Philipp, Ropovik, Ivan, Roque, Nelson A, Rueda, Carolina, Rutjens, Bastiaan T, Sackett, Katey, Salamon, Janos, Sánchez-Rodríguez, Ángel, Saunders, Blair, Schaafsma, Juliette, Schulte-Mecklenbeck, Michael, Shanks, David R, Sherman, Martin F, Steele, Kenneth M, Steffens, Niklas K., Sun, Jessie, Susa, Kyle J, Szaszi, Barnabas, Szollosi, Aba, Tamayo, Ricardo M, Tinghög, Gustav, Tong, Yuk-Yue, Tweten, Carol, Vadillo, Miguel A, Valcarcel, Deisy, Van der Linden, Nicolas, van Elk, Michiel, van Harreveld, Frenk, Västfjäll, Daniel, Vazire, Simine, Verduyn, Philippe, Williams, Matt N, Willis, Guillermo B, Wood, Sarah E, Yang, Chunliang, Zerhouni, Oulmann, Zheng, Robert, Zrubka, Mark, Leerstoel Finkenauer, Youth in Changing Cultural Contexts, Section Applied Social Psychology, RS: FPN WSP II, Leerstoel Finkenauer, Youth in Changing Cultural Contexts, and Language, Communication and Cognition

Subjects
Psychologie sociale expérimentale, Male, replication, CATEGORY ACCESSIBILITY, Psychologie sociale, 05 social sciences, 050109 social psychology, intelligence, 050105 experimental psychology, Test (assessment), ACTIVATION, 5. Gender equality, Social Perception, Replication (statistics), Humans, 0501 psychology and cognitive sciences, Female, Psychology, priming, PRIMES, General Psychology, BEHAVIOR, Prejudice, Clinical psychology
Abstract

Dijksterhuis and van Knippenberg (1998) reported that participants primed with an intelligentcategory (“professor”) subsequently performed 13.1% better on a trivia test than participantsprimed with an unintelligent category (“soccer hooligans”). Two unpublished replications of thisstudy by the original authors, designed to verify the appropriate testing procedures, observed asmaller difference between conditions (2-3%) as well as a gender difference: men showed theeffect (9.3% and 7.6%) but women did not (0.3% and -0.3%). The procedure used in thosereplications served as the basis for this multi-lab Registered Replication Report (RRR). A total of40 laboratories collected data for this project, with 23 laboratories meeting all inclusion criteria.Here we report the meta-analytic result of those 23 direct replications (total N = 4,493) of theupdated version of the original study, examining the difference between priming with professorand hooligan on a 30-item general knowledge trivia task (a supplementary analysis reportsresults with all 40 labs, N = 6,454). We observed no overall difference in trivia performancebetween participants primed with professor and those primed with hooligan (0.14%) and nomoderation by gender., 0, info:eu-repo/semantics/published

Published
2018

29. Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability

Author

Ebersole, Charles R., primary, Mathur, Maya B, additional, Baranski, Erica, additional, Bart-Plange, Diane-Jo, additional, Buttrick, Nick, additional, Chartier, Christopher R., additional, Corker, Katherine S., additional, Corley, Martin, additional, Hartshorne, Joshua K., additional, IJzerman, Hans, additional, Lazarevic, Ljiljana B., additional, Rabagliati, Hugh, additional, Ropovik, Ivan, additional, Aczel, Balazs, additional, Aeschbach, Lena Fanya, additional, Andrighetto, Luca, additional, Arnal, Jack Dennis, additional, Arrow, Holly, additional, Babincak, Peter, additional, Bakos, Bence Endre, additional, Baník, Gabriel, additional, Baskin, Ernest, additional, Belopavlović, Radomir, additional, Bernstein, Michael, additional, Bialek, Michal, additional, Bloxsom, Nicholas, additional, Bodroža, Bojana, additional, Bonfiglio, Diane B. V., additional, Boucher, Leanne, additional, Brühlmann, Florian, additional, Brumbaugh, Claudia Chloe, additional, Casini, Erica, additional, Chen, Yiling, additional, Chiorri, Carlo, additional, Chopik, William J., additional, Christ, Oliver, additional, Claypool, Heather M., additional, coary, Sean, additional, Čolić, Marija V., additional, Collins, W. Matthew, additional, Curran, Paul G, additional, Day, Chris, additional, Dering, Benjamin, additional, Dreber, Anna, additional, Edlund, John, additional, Falcão, Filipe, additional, Fedor, Anna, additional, Feinberg, Lily, additional, Ferguson, Ian, additional, Ford, Máire, additional, Frank, Michael C., additional, Fryberger, Emily, additional, Garinther, Alexander, additional, Gawryluk, Katarzyna, additional, Giacomantonio, Mauro, additional, Giessner, Steffen Robert, additional, Grahe, Jon E., additional, Guadagno, Rosanna Elizabeth, additional, Hałasa, Ewa, additional, Hancock, Peter, additional, Hüffmeier, Joachim, additional, Hughes, Sean, additional, Idzikowska, Katarzyna, additional, Inzlicht, Michael, additional, Jern, Alan, additional, Jimenez-Leal, William, additional, Johannesson, Magnus, additional, Joy-Gaba, Jennifer Alana, additional, Kauff, Mathias, additional, Kellier, Danielle, additional, Kidwell, Mallory, additional, Kimbrough, Amanda, additional, King, Josiah, additional, Kołodziej, Sabina, additional, Kovacs, Marton, additional, Krasuska, Karolina, additional, Kraus, Sue, additional, Krueger, Lacy Elise, additional, Kuchno, Katarzyna, additional, Lage, Caio Ambrosio, additional, Langford, Eleanor V., additional, Levitan, Carmel, additional, Lima, Tiago Jessé Souza, additional, Lin, Hause, additional, Lins, Samuel, additional, Loy, J E, additional, Manfredi, Dylan, additional, Markiewicz, Lukasz, additional, Menon, Madhavi, additional, Mercier, Brett, additional, Metzger, Mitchell, additional, Millen, Ailsa E, additional, Miller, Jeremy K., additional, Montealegre, Andres, additional, Moore, Don A, additional, Nave, Gideon, additional, Nichols, Austin Lee, additional, Novak, Sarah Ann, additional, Orlic, Ana, additional, Panno, Angelo, additional, Parks, Kimberly P., additional, Pedović, Ivana, additional, Pękala, Emilian, additional, Penner, Matthew R., additional, Pessers, Sebastiaan, additional, Petrovic, Boban, additional, Pfeiffer, Thomas, additional, Pieńkosz, Damian, additional, Preti, Emanuele, additional, Purić, Danka, additional, Ramos, Tiago Silva, additional, Ravid, Jon, additional, Razza, Timothy, additional, Rentzsch, Katrin, additional, Richetin, Juliette, additional, Rife, Sean Chandler, additional, Dalla Rosa, Anna, additional, Salamon, Janos, additional, Saunders, Blair, additional, Sawicki, Przemyslaw, additional, Schmidt, Kathleen, additional, Schuepfer, Kurt, additional, Schultze, Thomas, additional, Schulz-Hardt, Stefan, additional, Schütz, Astrid, additional, Shabazian, Ani, additional, Silva, Rúben Filipe Lopes, additional, Sioma, Barbara, additional, Skorb, Lauren, additional, Souza, Luana Elayne Cunha, additional, steegen, sara, additional, Stein, LAR, additional, Sternglanz, R. Weylin, additional, Stojilović, Darko, additional, Storage, Daniel, additional, Sullivan, Gavin Brent, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Szoke, Orsolya, additional, Szuts, Attila, additional, Thomae, Manuela, additional, Tidwell, Natasha Davis, additional, tocco, Carly, additional, Torka, Ann-Kathrin, additional, tuerlinckx, francis, additional, vanpaemel, wolf, additional, Vaughn, Leigh Ann, additional, Vianello, Michelangelo, additional, Viganola, Domenico, additional, Vlachou, Maria, additional, Walker, Ryan J., additional, Weissgerber, Sophia Christin, additional, Wichman, Aaron Lee, additional, Wiggins, Bradford Jay, additional, Wolf, Daniel, additional, Wood, Michael James, additional, Zealley, David A., additional, Zezelj, Iris, additional, Zrubka, Mark, additional, and Nosek, Brian A., additional

Published
2019
Full Text
View/download PDF

30. Raising the value of research studies in psychological science by increasing the credibility of research reports: The Transparent Psi Project - Preprint

Author

Kekecs, Zoltan, primary, Palfi, Bence, additional, Szaszi, Barnabas, additional, Szecsi, Peter, additional, Zrubka, Mark, additional, Kovacs, Marton, additional, Bakos, Bence Endre, additional, Cousineau, Denis, additional, Tressoldi, Patrizio, additional, Schmidt, Kathleen, additional, Grassi, Massimo, additional, Evans, Thomas Rhys, additional, Yamada, Yuki, additional, Miller, Jeremy K., additional, Liu, Huanxu, additional, Yonemitsu, Fumiya, additional, Dubrov, Dmitrii, additional, Röer, Jan Philipp, additional, Becker, Marvin, additional, Schnepper, Roxane, additional, Ariga, Atsunori, additional, Arriaga, Patrícia, additional, Oliveira, Raquel, additional, Põldver, Nele, additional, Kreegipuu, Kairi, additional, Hall, Braeden Forrester, additional, Wiechert, Sera, additional, Verschuere, Bruno, additional, Giran, Kyra, additional, and Aczel, Balazs, additional

Published
2019
Full Text
View/download PDF

31. WagenmakersOpenPracticesDisclosure – Supplemental material for Quantifying Support for the Null Hypothesis in Psychology: An Empirical Investigation

Author

Balazs Aczel, Palfi, Bence, Aba Szollosi, Marton Kovacs, Szaszi, Barnabas, Szecsi, Peter, Zrubka, Mark, Gronau, Quentin F., Bergh, Don Van Den, and Eric-Jan Wagenmakers

Subjects
FOS: Psychology, FOS: Clinical medicine, 170199 Psychology not elsewhere classified, 110319 Psychiatry (incl. Psychotherapy)
Abstract

Supplemental material, WagenmakersOpenPracticesDisclosure for Quantifying Support for the Null Hypothesis in Psychology: An Empirical Investigation by Balazs Aczel, Bence Palfi, Aba Szollosi, Marton Kovacs, Barnabas Szaszi, Peter Szecsi, Mark Zrubka, Quentin F. Gronau, Don van den Bergh and Eric-Jan Wagenmakers in Advances in Methods and Practices in Psychological Science

Published
2018
Full Text
View/download PDF

32. SupplementaryMethodsandResults – Supplemental material for Quantifying Support for the Null Hypothesis in Psychology: An Empirical Investigation

Author

Balazs Aczel, Palfi, Bence, Aba Szollosi, Marton Kovacs, Szaszi, Barnabas, Szecsi, Peter, Zrubka, Mark, Gronau, Quentin F., Bergh, Don Van Den, and Eric-Jan Wagenmakers

Subjects
FOS: Psychology, FOS: Clinical medicine, 170199 Psychology not elsewhere classified, 110319 Psychiatry (incl. Psychotherapy)
Abstract

Supplemental material, SupplementaryMethodsandResults for Quantifying Support for the Null Hypothesis in Psychology: An Empirical Investigation by Balazs Aczel, Bence Palfi, Aba Szollosi, Marton Kovacs, Barnabas Szaszi, Peter Szecsi, Mark Zrubka, Quentin F. Gronau, Don van den Bergh and Eric-Jan Wagenmakers in Advances in Methods and Practices in Psychological Science

Published
2018
Full Text
View/download PDF

34. Registered Replication Report: Dijksterhuis and van Knippenberg (1998)

Author

Leerstoel Finkenauer, Youth in Changing Cultural Contexts, O'Donnell, Michael, Nelson, Leif D, Ackermann, Evi, Aczel, Balazs, Akhtar, Athfah, Aldrovandi, Silvio, Alshaif, Nasseem, Andringa, Ronald, Aveyard, Mark, Babincak, Peter, Balatekin, Nursena, Baldwin, Scott A, Banik, Gabriel, Baskin, Ernest, Bell, Raoul, Białobrzeska, Olga, Birt, Angie R, Boot, Walter R, Braithwaite, Scott R, Briggs, Jessie C, Buchner, Axel, Budd, Desiree, Budzik, Kathryn, Bullens, Lottie, Bulley, Richard L, Cannon, Peter R, Cantarero, Katarzyna, Cesario, Joseph, Chambers, Stephanie, Chartier, Christopher R., Chekroun, Peggy, Chong, Clara, Cleeremans, Axel, Coary, Sean P, Coulthard, Jacob, Cramwinckel, Florien M, Denson, Thomas F, Díaz-Lago, Marcos, DiDonato, Theresa E, Drummond, Aaron, Eberlen, Julia, Ebersbach, Titus, Edlund, John E, Finnigan, Katherine M, Fisher, Justin, Frankowska, Natalia, García-Sánchez, Efraín, Golom, Frank D, Graves, Andrew J, Greenberg, Kevin, Hanioti, Mando, Hansen, Heather A, Harder, Jenna A, Harrell, Erin R, Hartanto, Andree, Inzlicht, Michael, Johnson, David J., Karpinski, Andrew, Keller, Victor N, Klein, Olivier, Koppel, Lina, Krahmer, Emiel, Lantian, Anthony, Larson, Michael J, Légal, Jean-Baptiste, Lucas, Richard E, Lynott, Dermot, Magaldino, Corey M, Massar, Karlijn, McBee, Matthew T, McLatchie, Neil, Melia, Nadhilla, Mensink, Michael C, Mieth, Laura, Moore-Berg, Samantha, Neeser, Geraldine, Newell, Ben R, Noordewier, Marret K, Özdogğru, Asil Ali, Pantazi, Myrto, Parzuchowski, Michał, Peters, Kim, Philipp, Michael C, Pollmann, Monique M H, Rentzelas, Panagiotis, Rodríguez-Bailón, Rosa, Röer, Jan Philipp, Ropovik, Ivan, Roque, Nelson A, Rueda, Carolina, Rutjens, Bastiaan T, Sackett, Katey, Salamon, Janos, Sánchez-Rodríguez, Ángel, Saunders, Blair, Schaafsma, Juliette, Schulte-Mecklenbeck, Michael, Shanks, David R, Sherman, Martin F, Steele, Kenneth M, Steffens, Niklas K., Sun, Jessie, Susa, Kyle J, Szaszi, Barnabas, Szollosi, Aba, Tamayo, Ricardo M, Tinghög, Gustav, Tong, Yuk-Yue, Tweten, Carol, Vadillo, Miguel A, Valcarcel, Deisy, Van der Linden, Nicolas, van Elk, Michiel, van Harreveld, Frenk, Västfjäll, Daniel, Vazire, Simine, Verduyn, Philippe, Williams, Matt N, Willis, Guillermo B, Wood, Sarah E, Yang, Chunliang, Zerhouni, Oulmann, Zheng, Robert, Zrubka, Mark, Leerstoel Finkenauer, Youth in Changing Cultural Contexts, O'Donnell, Michael, Nelson, Leif D, Ackermann, Evi, Aczel, Balazs, Akhtar, Athfah, Aldrovandi, Silvio, Alshaif, Nasseem, Andringa, Ronald, Aveyard, Mark, Babincak, Peter, Balatekin, Nursena, Baldwin, Scott A, Banik, Gabriel, Baskin, Ernest, Bell, Raoul, Białobrzeska, Olga, Birt, Angie R, Boot, Walter R, Braithwaite, Scott R, Briggs, Jessie C, Buchner, Axel, Budd, Desiree, Budzik, Kathryn, Bullens, Lottie, Bulley, Richard L, Cannon, Peter R, Cantarero, Katarzyna, Cesario, Joseph, Chambers, Stephanie, Chartier, Christopher R., Chekroun, Peggy, Chong, Clara, Cleeremans, Axel, Coary, Sean P, Coulthard, Jacob, Cramwinckel, Florien M, Denson, Thomas F, Díaz-Lago, Marcos, DiDonato, Theresa E, Drummond, Aaron, Eberlen, Julia, Ebersbach, Titus, Edlund, John E, Finnigan, Katherine M, Fisher, Justin, Frankowska, Natalia, García-Sánchez, Efraín, Golom, Frank D, Graves, Andrew J, Greenberg, Kevin, Hanioti, Mando, Hansen, Heather A, Harder, Jenna A, Harrell, Erin R, Hartanto, Andree, Inzlicht, Michael, Johnson, David J., Karpinski, Andrew, Keller, Victor N, Klein, Olivier, Koppel, Lina, Krahmer, Emiel, Lantian, Anthony, Larson, Michael J, Légal, Jean-Baptiste, Lucas, Richard E, Lynott, Dermot, Magaldino, Corey M, Massar, Karlijn, McBee, Matthew T, McLatchie, Neil, Melia, Nadhilla, Mensink, Michael C, Mieth, Laura, Moore-Berg, Samantha, Neeser, Geraldine, Newell, Ben R, Noordewier, Marret K, Özdogğru, Asil Ali, Pantazi, Myrto, Parzuchowski, Michał, Peters, Kim, Philipp, Michael C, Pollmann, Monique M H, Rentzelas, Panagiotis, Rodríguez-Bailón, Rosa, Röer, Jan Philipp, Ropovik, Ivan, Roque, Nelson A, Rueda, Carolina, Rutjens, Bastiaan T, Sackett, Katey, Salamon, Janos, Sánchez-Rodríguez, Ángel, Saunders, Blair, Schaafsma, Juliette, Schulte-Mecklenbeck, Michael, Shanks, David R, Sherman, Martin F, Steele, Kenneth M, Steffens, Niklas K., Sun, Jessie, Susa, Kyle J, Szaszi, Barnabas, Szollosi, Aba, Tamayo, Ricardo M, Tinghög, Gustav, Tong, Yuk-Yue, Tweten, Carol, Vadillo, Miguel A, Valcarcel, Deisy, Van der Linden, Nicolas, van Elk, Michiel, van Harreveld, Frenk, Västfjäll, Daniel, Vazire, Simine, Verduyn, Philippe, Williams, Matt N, Willis, Guillermo B, Wood, Sarah E, Yang, Chunliang, Zerhouni, Oulmann, Zheng, Robert, and Zrubka, Mark

Published
2018

35. Registered Replication Report: Dijksterhuis and van Knippenberg (1998)

Author

ODonnell, Michael, Nelson, Leif D., Ackermann, Evi, Aczel, Balazs, Akhtar, Athfah, Aldrovandi, Silvio, Alshaif, Nasseem, Andringa, Ronald, Aveyard, Mark, Babincak, Peter, Balatekin, Nursena, Baldwin, Scott A., Banik, Gabriel, Baskin, Ernest, Bell, Raoul, Bialobrzeska, Olga, Birt, Angie R., Boot, Walter R., Braithwaite, Scott R., Briggs, Jessie C., Buchner, Axel, Budd, Desiree, Budzik, Kathryn, Bullens, Lottie, Bulley, Richard L., Cannon, Peter R., Cantarero, Katarzyna, Cesario, Joseph, Chambers, Stephanie, Chartier, Christopher R., Chekroun, Peggy, Chong, Clara, Cleeremans, Axel, Coary, Sean P., Coulthard, Jacob, Cramwinckel, Florien M., Denson, Thomas F., Diaz-Lago, Marcos, DiDonato, Theresa E., Drummond, Aaron, Eberlen, Julia, Ebersbach, Titus, Edlund, John E., Finnigan, Katherine M., Fisher, Justin, Frankowska, Natalia, Garcia-Sanchez, Efrain, Golom, Frank D., Graves, Andrew J., Greenberg, Kevin, Hanioti, Mando, Hansen, Heather A., Harder, Jenna A., Harrell, Erin R., Hartanto, Andree, Inzlicht, Michael, Johnson, David J., Karpinski, Andrew, Keller, Victor N., Klein, Olivier, Koppel, Lina, Krahmer, Emiel, Lantian, Anthony, Larson, Michael J., Legal, Jean-Baptiste, Lucas, Richard E., Lynott, Dermot, Magaldino, Corey M., Massar, Karlijn, McBee, Matthew T., McLatchie, Neil, Melia, Nadhilla, Mensink, Michael C., Mieth, Laura, Moore-Berg, Samantha, Neeser, Geraldine, Newell, Ben R., Noordewier, Marret K., Ozdogru, Asil Ali, Pantazi, Myrto, Parzuchowski, Michal, Peters, Kim, Philipp, Michael C., Pollmann, Monique M. H., Rentzelas, Panagiotis, Rodriguez-Bailon, Rosa, Roeer, Jan Philipp, Ropovik, Ivan, Roque, Nelson A., Rueda, Carolina, Rutjens, Bastiaan T., Sackett, Katey, Salamon, Janos, Sanchez-Rodriguez, Angel, Saunders, Blair, Schaafsma, Juliette, Schulte-Mecklenbeck, Michael, Shanks, David R., Sherman, Martin F., Steele, Kenneth M., Steffens, Niklas K., Sun, Jessie, Susa, Kyle J., Szaszi, Barnabas, Szollosi, Aba, Tamayo, Ricardo M., Tinghög, Gustav, Tong, Yuk-yue, Tweten, Carol, Vadillo, Miguel A., Valcarcel, Deisy, Van der Linden, Nicolas, van Elk, Michiel, van Harreveld, Frenk, Västfjäll, Daniel, Vazire, Simine, Verduyn, Philippe, Williams, Matt N., Willis, Guillermo B., Wood, Sarah E., Yang, Chunliang, Zerhouni, Oulmann, Zheng, Robert, Zrubka, Mark, ODonnell, Michael, Nelson, Leif D., Ackermann, Evi, Aczel, Balazs, Akhtar, Athfah, Aldrovandi, Silvio, Alshaif, Nasseem, Andringa, Ronald, Aveyard, Mark, Babincak, Peter, Balatekin, Nursena, Baldwin, Scott A., Banik, Gabriel, Baskin, Ernest, Bell, Raoul, Bialobrzeska, Olga, Birt, Angie R., Boot, Walter R., Braithwaite, Scott R., Briggs, Jessie C., Buchner, Axel, Budd, Desiree, Budzik, Kathryn, Bullens, Lottie, Bulley, Richard L., Cannon, Peter R., Cantarero, Katarzyna, Cesario, Joseph, Chambers, Stephanie, Chartier, Christopher R., Chekroun, Peggy, Chong, Clara, Cleeremans, Axel, Coary, Sean P., Coulthard, Jacob, Cramwinckel, Florien M., Denson, Thomas F., Diaz-Lago, Marcos, DiDonato, Theresa E., Drummond, Aaron, Eberlen, Julia, Ebersbach, Titus, Edlund, John E., Finnigan, Katherine M., Fisher, Justin, Frankowska, Natalia, Garcia-Sanchez, Efrain, Golom, Frank D., Graves, Andrew J., Greenberg, Kevin, Hanioti, Mando, Hansen, Heather A., Harder, Jenna A., Harrell, Erin R., Hartanto, Andree, Inzlicht, Michael, Johnson, David J., Karpinski, Andrew, Keller, Victor N., Klein, Olivier, Koppel, Lina, Krahmer, Emiel, Lantian, Anthony, Larson, Michael J., Legal, Jean-Baptiste, Lucas, Richard E., Lynott, Dermot, Magaldino, Corey M., Massar, Karlijn, McBee, Matthew T., McLatchie, Neil, Melia, Nadhilla, Mensink, Michael C., Mieth, Laura, Moore-Berg, Samantha, Neeser, Geraldine, Newell, Ben R., Noordewier, Marret K., Ozdogru, Asil Ali, Pantazi, Myrto, Parzuchowski, Michal, Peters, Kim, Philipp, Michael C., Pollmann, Monique M. H., Rentzelas, Panagiotis, Rodriguez-Bailon, Rosa, Roeer, Jan Philipp, Ropovik, Ivan, Roque, Nelson A., Rueda, Carolina, Rutjens, Bastiaan T., Sackett, Katey, Salamon, Janos, Sanchez-Rodriguez, Angel, Saunders, Blair, Schaafsma, Juliette, Schulte-Mecklenbeck, Michael, Shanks, David R., Sherman, Martin F., Steele, Kenneth M., Steffens, Niklas K., Sun, Jessie, Susa, Kyle J., Szaszi, Barnabas, Szollosi, Aba, Tamayo, Ricardo M., Tinghög, Gustav, Tong, Yuk-yue, Tweten, Carol, Vadillo, Miguel A., Valcarcel, Deisy, Van der Linden, Nicolas, van Elk, Michiel, van Harreveld, Frenk, Västfjäll, Daniel, Vazire, Simine, Verduyn, Philippe, Williams, Matt N., Willis, Guillermo B., Wood, Sarah E., Yang, Chunliang, Zerhouni, Oulmann, Zheng, Robert, and Zrubka, Mark

Abstract

Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence (professor) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence (soccer hooligans). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the professor category and those primed with the hooligan category (0.14%) and no moderation by gender., Funding Agencies|Association for Psychological Science; Arnold Foundation

Published
2018
Full Text
View/download PDF

36. Quantifying Support for the Null Hypothesis in Psychology: An Empirical Investigation

Author

Aczel, Balazs, Palfi, Bence, Szollosi, Aba, Kovacs, Marton, Szaszi, Barnabas, Szecsi, Peter, Zrubka, Mark, Gronau, Quentin, van den Bergh, Don, Wagenmakers, Eric-Jan, and Psychologische Methodenleer (Psychologie, FMG)

Subjects
bepress|Social and Behavioral Sciences|Psychology, 05 social sciences, PsyArXiv|Social and Behavioral Sciences|Cultural Psychology, Social and Behavioral Sciences, 050105 experimental psychology, FOS: Psychology, PsyArXiv|Social and Behavioral Sciences, 03 medical and health sciences, Open data, 0302 clinical medicine, PsyArXiv|Social and Behavioral Sciences|Psychology, other, bepress|Social and Behavioral Sciences, Psychology, 0501 psychology and cognitive sciences, Null hypothesis, 030217 neurology & neurosurgery, General Psychology, Cognitive psychology
Abstract

In the traditional statistical framework, nonsignificant results leave researchers in a state of suspended disbelief. In this study, we examined, empirically, the treatment and evidential impact of nonsignificant results. Our specific goals were twofold: to explore how psychologists interpret and communicate nonsignificant results and to assess how much these results constitute evidence in favor of the null hypothesis. First, we examined all nonsignificant findings mentioned in the abstracts of the 2015 volumes of Psychonomic Bulletin & Review, Journal of Experimental Psychology: General, and Psychological Science ( N = 137). In 72% of these cases, nonsignificant results were misinterpreted, in that the authors inferred that the effect was absent. Second, a Bayes factor reanalysis revealed that fewer than 5% of the nonsignificant findings provided strong evidence (i.e., BF01 > 10) in favor of the null hypothesis over the alternative hypothesis. We recommend that researchers expand their statistical tool kit in order to correctly interpret nonsignificant results and to be able to evaluate the evidence for and against the null hypothesis.

Published
2017
Full Text
View/download PDF

38. Registered Replication Report: Dijksterhuis and van Knippenberg (1998)

Author

O’Donnell, Michael, Nelson, Leif D., Ackermann, Evi, Aczel, Balazs, Akhtar, Athfah, Aldrovandi, Silvio, Alshaif, Nasseem, Andringa, Ronald, Aveyard, Mark, Babincak, Peter, Balatekin, Nursena, Baldwin, Scott A., Banik, Gabriel, Baskin, Ernest, Bell, Raoul, Białobrzeska, Olga, Birt, Angie R., Boot, Walter R., Braithwaite, Scott R., Briggs, Jessie C., Buchner, Axel, Budd, Desiree, Budzik, Kathryn, Bullens, Lottie, Bulley, Richard L., Cannon, Peter R., Cantarero, Katarzyna, Cesario, Joseph, Chambers, Stephanie, Chartier, Christopher R., Chekroun, Peggy, Chong, Clara, Cleeremans, Axel, Coary, Sean P., Coulthard, Jacob, Cramwinckel, Florien M., Denson, Thomas F., Díaz-Lago, Marcos, DiDonato, Theresa E., Drummond, Aaron, Eberlen, Julia, Ebersbach, Titus, Edlund, John E., Finnigan, Katherine M., Fisher, Justin, Frankowska, Natalia, García-Sánchez, Efraín, Golom, Frank D., Graves, Andrew J., Greenberg, Kevin, Hanioti, Mando, Hansen, Heather A., Harder, Jenna A., Harrell, Erin R., Hartanto, Andree, Inzlicht, Michael, Johnson, David J., Karpinski, Andrew, Keller, Victor N., Klein, Olivier, Koppel, Lina, Krahmer, Emiel, Lantian, Anthony, Larson, Michael J., Légal, Jean-Baptiste, Lucas, Richard E., Lynott, Dermot, Magaldino, Corey M., Massar, Karlijn, McBee, Matthew T., McLatchie, Neil, Melia, Nadhilla, Mensink, Michael C., Mieth, Laura, Moore-Berg, Samantha, Neeser, Geraldine, Newell, Ben R., Noordewier, Marret K., Ali Özdoğru, Asil, Pantazi, Myrto, Parzuchowski, Michał, Peters, Kim, Philipp, Michael C., Pollmann, Monique M. H., Rentzelas, Panagiotis, Rodríguez-Bailón, Rosa, Philipp Röer, Jan, Ropovik, Ivan, Roque, Nelson A., Rueda, Carolina, Rutjens, Bastiaan T., Sackett, Katey, Salamon, Janos, Sánchez-Rodríguez, Ángel, Saunders, Blair, Schaafsma, Juliette, Schulte-Mecklenbeck, Michael, Shanks, David R., Sherman, Martin F., Steele, Kenneth M., Steffens, Niklas K., Sun, Jessie, Susa, Kyle J., Szaszi, Barnabas, Szollosi, Aba, Tamayo, Ricardo M., Tinghög, Gustav, Tong, Yuk-yue, Tweten, Carol, Vadillo, Miguel A., Valcarcel, Deisy, Van der Linden, Nicolas, van Elk, Michiel, van Harreveld, Frenk, Västfjäll, Daniel, Vazire, Simine, Verduyn, Philippe, Williams, Matt N., Willis, Guillermo B., Wood, Sarah E., Yang, Chunliang, Zerhouni, Oulmann, Zheng, Robert, and Zrubka, Mark

Subjects
5. Gender equality, 650 Management & public relations

39. Registered Replication Report: Dijksterhuis and van Knippenberg (1998).

Author

O'Donnell M, Nelson LD, Ackermann E, Aczel B, Akhtar A, Aldrovandi S, Alshaif N, Andringa R, Aveyard M, Babincak P, Balatekin N, Baldwin SA, Banik G, Baskin E, Bell R, Białobrzeska O, Birt AR, Boot WR, Braithwaite SR, Briggs JC, Buchner A, Budd D, Budzik K, Bullens L, Bulley RL, Cannon PR, Cantarero K, Cesario J, Chambers S, Chartier CR, Chekroun P, Chong C, Cleeremans A, Coary SP, Coulthard J, Cramwinckel FM, Denson TF, Díaz-Lago M, DiDonato TE, Drummond A, Eberlen J, Ebersbach T, Edlund JE, Finnigan KM, Fisher J, Frankowska N, García-Sánchez E, Golom FD, Graves AJ, Greenberg K, Hanioti M, Hansen HA, Harder JA, Harrell ER, Hartanto A, Inzlicht M, Johnson DJ, Karpinski A, Keller VN, Klein O, Koppel L, Krahmer E, Lantian A, Larson MJ, Légal JB, Lucas RE, Lynott D, Magaldino CM, Massar K, McBee MT, McLatchie N, Melia N, Mensink MC, Mieth L, Moore-Berg S, Neeser G, Newell BR, Noordewier MK, Ali Özdoğru A, Pantazi M, Parzuchowski M, Peters K, Philipp MC, Pollmann MMH, Rentzelas P, Rodríguez-Bailón R, Philipp Röer J, Ropovik I, Roque NA, Rueda C, Rutjens BT, Sackett K, Salamon J, Sánchez-Rodríguez Á, Saunders B, Schaafsma J, Schulte-Mecklenbeck M, Shanks DR, Sherman MF, Steele KM, Steffens NK, Sun J, Susa KJ, Szaszi B, Szollosi A, Tamayo RM, Tinghög G, Tong YY, Tweten C, Vadillo MA, Valcarcel D, Van der Linden N, van Elk M, van Harreveld F, Västfjäll D, Vazire S, Verduyn P, Williams MN, Willis GB, Wood SE, Yang C, Zerhouni O, Zheng R, and Zrubka M

Subjects
Female, Humans, Male, Intelligence, Prejudice, Social Perception
Abstract

Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence ("professor") subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence ("soccer hooligans"). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the "professor" category and those primed with the "hooligan" category (0.14%) and no moderation by gender.

Published
2018
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results