Search

Your search keyword '"Schmiedeberg, Claudia"' showing total 144 results
Start Over Author "Schmiedeberg, Claudia"
144 results on '"Schmiedeberg, Claudia"'

1. Effects of Partner Presence during the Interview on Survey Responses: The Example of Questions Concerning the Division of Household Labor

Author

Schröder, Jette and Schmiedeberg, Claudia

Abstract

Despite the fact that third parties are present during a substantial amount of face-to-face interviews, bystander influence on respondents' response behavior is not yet fully understood. We use nine waves of the German Family Panel "pairfam" and apply fixed effects panel regression models to analyze effects of third-party presence on items regarding the sharing of household tasks between partners. We find that both male and female respondents report doing a smaller share of household tasks when their partner is present during the interview as compared to when their partner is not present. Similarly, if the respondent's partner is present, both partners' reports correspond more, so that they are less prone to resulting in unrealistically high sums. These results indicate that for items concerning household labor, partner presence does not compromise data quality but may in fact improve it.

Published
2023
Full Text
View/download PDF

3. Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty

Author

Breznau, Nate, Rinke, Eike Mark, Wuttke, Alexander, Nguyen, Hung H. V., Adem, Muna, Adriaans, Jule, Alvarez-Benjumea, Amalia, Andersen, Henrik K., Auer, Daniel, Azevedo, Flavio, Bahnsen, Oke, Balzer, Dave, Bauer, Gerrit, Bauer, Paul C., Baumann, Markus, Baute, Sharon, Benoit, Verena, Bernauer, Julian, Berning, Carl, Berthold, Anna, Bethke, Felix S., Biegert, Thomas, Blinzler, Katharina, Blumenberg, Johannes N., Bobzien, Licia, Bohman, Andrea, Bol, Thijs, Bostic, Amie, Brzozowska, Zuzanna, Burgdorf, Katharina, Burger, Kaspar, Busch, Kathrin B., Carlos-Castillo, Juan, Chan, Nathan, Christmann, Pablo, Connelly, Roxanne, Czymara, Christian S., Damian, Elena, Ecker, Alejandro, Edelmann, Achim, Eger, Maureen A., Ellerbrock, Simon, Forke, Anna, Forster, Andrea, Gaasendam, Chris, Gavras, Konstantin, Gayle, Vernon, Gessler, Theresa, Gnambs, Timo, Godefroidt, Amélie, Grömping, Max, Groß, Martin, Gruber, Stefan, Gummer, Tobias, Hadjar, Andreas, Heisig, Jan Paul, Hellmeier, Sebastian, Heyne, Stefanie, Hirsch, Magdalena, Hjerm, Mikael, Hochman, Oshrat, Hövermann, Andreas, Hunger, Sophia, Hunkler, Christian, Huth, Nora, Ignácz, Zsófia S., Jacobs, Laura, Jacobsen, Jannes, Jaeger, Bastian, Jungkunz, Sebastian, Jungmann, Nils, Kauff, Mathias, Kleinert, Manuel, Klinger, Julia, Kolb, Jan-Philipp, Kołczyńska, Marta, Kuk, John, Kunißen, Katharina, Sinatra, Dafina Kurti, Langenkamp, Alexander, Lersch, Philipp M., Löbel, Lea-Maria, Lutscher, Philipp, Mader, Matthias, Madia, Joan E., Malancu, Natalia, Maldonado, Luis, Marahrens, Helge, Martin, Nicole, Martinez, Paul, Mayerl, Jochen, Mayorga, Oscar J., McManus, Patricia, McWagner, Kyle, Meeusen, Cecil, Meierrieks, Daniel, Mellon, Jonathan, Merhout, Friedolin, Merk, Samuel, Meyer, Daniel, Micheli, Leticia, Mijs, Jonathan, Moya, Cristóbal, Neunhoeffer, Marcel, Nüst, Daniel, Nygård, Olav, Ochsenfeld, Fabian, Otte, Gunnar, Pechenkina, Anna O., Prosser, Christopher, Raes, Louis, Ralston, Kevin, Ramos, Miguel R., Roets, Arne, Rogers, Jonathan, Ropers, Guido, Samuel, Robin, Sand, Gregor, Schachter, Ariela, Schaeffer, Merlin, Schieferdecker, David, Schlueter, Elmar, Schmidt, Regine, Schmidt, Katja M., Schmidt-Catran, Alexander, Schmiedeberg, Claudia, Schneider, Jürgen, Schoonvelde, Martijn, Schulte-Cloos, Julia, Schumann, Sandy, Schunck, Reinhard, Schupp, Jürgen, Seuring, Julian, Silber, Henning, Sleegers, Willem, Sonntag, Nico, Staudt, Alexander, Steiber, Nadia, Steiner, Nils, Sternberg, Sebastian, Stiers, Dieter, Stojmenovska, Dragana, Storz, Nora, Striessnig, Erich, Stroppe, Anne-Kathrin, Teltemann, Janna, Tibajev, Andrey, Tung, Brian, Vagni, Giacomo, Van Assche, Jasper, van der Linden, Meta, van der Noll, Jolanda, Van Hootegem, Arno, Vogtenhuber, Stefan, Voicu, Bogdan, Wagemans, Fieke, Wehl, Nadja, Werner, Hannah, Wiernik, Brenton M., Winter, Fabian, Wolf, Christof, Yamada, Yuki, Zhang, Nan, Ziller, Conrad, Zins, Stefan, and Żółtak, Tomasz

Published
2022

8. Did You Like the Interview? Interviewer Effects on Respondents' Interview Pleasantness Ratings.

Author

Schmiedeberg, Claudia and Schröder, Jette

Subjects
*INTERVIEWERS, *MULTILEVEL models, *EMPLOYEE motivation, *INTRINSIC motivation, *DEMOGRAPHIC characteristics, *RESPONDENTS, *ACQUISITION of data
Abstract

Although it has long been acknowledged that interviewers play a crucial role in the survey data collection process, there is little research concerning interviewer effects on how respondents perceive the interview. We investigate whether interviewer effects exist regarding how much respondents report having enjoyed the interview and whether these effects can be explained by interviewer characteristics. We use data from wave 9 of the German Family Panel pairfam, combined with data from an interviewer survey conducted prior to this wave. Applying multilevel models, we find large interviewer effects that can be explained only partly by interviewers' sociodemographic characteristics, attitudes, and behavior. Interviewers' gender, intrinsic work motivation, and their attitude toward respondents significantly affect how much respondents enjoy the interview. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

11. Economic hardship and intimate partner violence: An analysis of perpetrators in Germany

Author

Schumann, Nina, Bozoyan, Christiane, Schmiedeberg, Claudia, Schumann, Nina, Bozoyan, Christiane, and Schmiedeberg, Claudia

Abstract

Objective: Based on the family stress model, we examine whether respondents are more likely to perpetrate physical IPV when experiencing economic hardship and pressure. Background: Research has demonstrated an association of intimate partner violence (IPV) and economic factors. However, as the bulk of studies is limited to the female victim’s perspective, the picture remains incomplete; factors driving gender-specific effects and perpetration rates have thus far been overlooked. Method: Using data from a large sample of individuals from the German Family Panel pairfam, which covers the period between 2009 and 2019, we employ pooled logistic regression models (n=6,661 individuals with 21,321 observations). Given the rich data source, we are able to control for a number of possible confounding effects. To correct for sample selection, we use calibrated design weights. Results: Our analyses show that IPV perpetration is associated with poverty and economic pressure among women, but not men. When accounting for confounding factors such as the Big 5 personality traits and childhood experiences, these associations become insignificant. For men, unemployment is linked to IPV perpetration, but only when personality traits and childhood experiences are not accounted for. Conclusion: Results imply that the association between adverse economic conditions and IPV perpetration is mainly due to unobserved heterogeneity. Thus, physical IPV perpetration is not primarily caused by the distress of financial strain, but rather by underlying factors such as personality traits and adverse childhood experiences, which are associated with both socioeconomic status, economic pressure, and aggressive behavior in intimate relationships., Fragestellung: Auf Basis des Family-Stress-Modells untersuchen wir, ob Personen in einer Partnerschaft eher physische Gewalt ausüben, wenn sie in wirtschaftlich schwierigen Situationen leben. Hintergrund: Dass ein Zusammenhang zwischen Gewalt in der Partnerschaft und wirtschaftlichen Faktoren besteht, wurde in der Literatur häufig gezeigt. Da jedoch der Großteil der Studien auf die Perspektive der (meist weiblichen) Opfer beschränkt ist, bestehen weiterhin Wissenslücken, insbesondere zu möglichen geschlechtsspezifischen Einflussfaktoren auf die Täterschaft. Methode: Wir nutzen Daten des Beziehungs- und Familienpanels pairfam und untersuchen eine große Stichprobe aus den Jahren 2009 bis 2019 von in Deutschland lebenden Personen (n=6.661 Individuen mit insgesamt 21.321 Beobachtungen). Für die Analyse werden gepoolte multivariable logistische Regressionsmodelle unter Kontrolle einer Vielzahl potenziell konfundierender Variablen geschätzt. Selektion wird mit Hilfe von Kalibrierungs- und Designgewichten korrigiert. Ergebnisse: Unsere Analysen zeigen, dass die Ausübung physischer Gewalt in Partnerschaften mit Armut und ökonomischem Druck zusammenhängt. Dies gilt allerdings nur für Täterinnen, nicht aber für Täter. Sobald konfundierende Faktoren wie die Persönlichkeit (gemessen mit den Big 5) und Kindheitserfahrungen in den Modellen berücksichtigt werden, verlieren diese Zusammenhänge ihre statistische Signifikanz. Bei Männern finden wir eine Korrelation zwischen Arbeitslosigkeit und Partnerschaftsgewalt, doch auch dies nur wenn Persönlichkeit und Kindheitserfahrungen nicht im Modell kontrolliert werden. Schlussfolgerung: Unsere Ergebnisse legen nahe, dass der Zusammenhang zwischen wirtschaftlichen Schwierigkeiten und Täterschaft durch unbeobachtete Heterogenität begründet ist. Physische Gewalt in Partnerschaften wird damit nicht primär durch den Stress hervorgerufen, der durch wirtschaftliche Schwierigkeiten entsteht, sondern eher durch Faktoren wie Persönlichkeit oder ne

Published
2023

12. Norms about parental employment in Eastern and Western Germany: Results of a factorial survey experiment.

Author

Bozoyan, Christiane and Schmiedeberg, Claudia

Subjects
LABOR supply, SOCIAL norms, WORKING hours, FACTORIAL experiment designs, WESTERN countries, FATHERS
Abstract

Copyright of Journal of Family Research (JFR) is the property of University of Bamberg Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Published
2024
Full Text
View/download PDF

19. What is Infidelity? A Vignette Study on Norms and Attitudes toward Infidelity.

Author

Bozoyan, Christiane and Schmiedeberg, Claudia

Subjects
*INFIDELITY (Couples), *TEXT messages, *SEXUAL intercourse, *EMOTIONS, *HUMAN behavior
Abstract

Infidelity is more than extradyadic intercourse, but it is unclear where infidelity begins and how behaviors are related to each other. We investigated data from a factorial survey experiment implemented in the German Family Panel (pairfam). 9,104 respondents evaluated 26,633 vignettes on unfaithful behaviors including four dimensions: explicit behavior, emotional involvement, infidelity duration, and erotic online contact. Results suggest that item lists may not reveal the full picture of unfaithfulness. While intercourse is judged as unfaithful irrespective of the context, less explicit behaviors such as kisses or hugs were also regarded as infidelity. Nonphysical dimensions contributed to infidelity judgments more strongly when less explicit behaviors were evaluated. Even cases of no physical contact combined with erotic text messages and emotional involvement were evaluated as unfaithful. Women's judgments were stricter than men's, and younger respondents' evaluations were stricter than those from older respondents. No differences were found regarding the gender of the vignette character. [ABSTRACT FROM AUTHOR]

Published
2023
Full Text
View/download PDF

20. Firm or Faculty? Evidence on Characteristics of German-Speaking Accounting PhD Students and Their Career Preferences

Author

Grottke, Markus, Pelger, Christoph, and Schmiedeberg, Claudia

Abstract

In this paper we focus on the choice that accounting doctoral students from the German-speaking area make, between a future career either in academia or business practice. Based on the results of an online survey, we show that prospective scholars exhibit certain characteristics of passionate researchers more pronouncedly than do future practitioners. The latter group, however, shows more interest in considering practical concerns in their research for the PhD. Furthermore, we show that the impact of institutional incentives is more widespread among future academics. Some implications are drawn for the relationship between research and practice and the future of the accounting academy.

Published
2013
Full Text
View/download PDF

32. How Many Replicators Does It Take to Achieve Reliability? Investigating Researcher Variability in a Crowdsourced Replication

Author

Breznau, Nate, primary, Rinke, Eike Mark, additional, Wuttke, Alexander, additional, Nguyen, Hung Hoang Viet, additional, Adem, Muna, additional, Adriaans, Jule, additional, Akdeniz, Esra, additional, Alvarez-Benjumea, Amalia, additional, Andersen, Henrik Kenneth, additional, Auer, Daniel, additional, Azevedo, Flavio, additional, Bahnsen, Oke, additional, Bai, Ling, additional, Balzer, Dave, additional, Bauer, Gerrit, additional, Bauer, Paul, additional, Baumann, Markus, additional, Baute, Sharon, additional, Benoit, Verena, additional, Bernauer, Julian, additional, Berning, Carl, additional, Berthold, Anna, additional, Bethke, Felix S., additional, Biegert, Thomas, additional, Blinzler, Katharina, additional, Blumenberg, Johannes, additional, Bobzien, Licia, additional, Bohman, Andrea, additional, Bol, Thijs, additional, Bostic, Amie, additional, Brzozowska, Zuzanna, additional, Burgdorf, Katharina, additional, Burger, Kaspar, additional, Busch, Kathrin, additional, Castillo, Juan Carlos, additional, Chan, Nathan, additional, Christmann, Pablo, additional, Connelly, Roxanne, additional, Czymara, Christian S., additional, Damian, Elena, additional, de Rooij, Eline Adriane, additional, Ecker, Alejandro, additional, Edelmann, Achim, additional, Eder, Christina, additional, Eger, Maureen A., additional, Ellerbrock, Simon, additional, Forke, Anna, additional, Forster, Andrea Gabriele, additional, Freire, Danilo, additional, Gaasendam, Chris, additional, Gavras, Konstantin, additional, Gayle, Vernon, additional, Gessler, Theresa, additional, Gnambs, Timo, additional, Godefroidt, Amélie, additional, Grömping, Max, additional, Groß, Martin, additional, Gruber, Stefan, additional, Gummer, Tobias, additional, Hadjar, Andreas, additional, Halbherr, Verena, additional, Heisig, Jan Paul, additional, Hellmeier, Sebastian, additional, Heyne, Stefanie, additional, Hirsch, Magdalena, additional, Hjerm, Mikael, additional, Hochman, Oshrat, additional, Höffler, Jan H., additional, Hövermann, Andreas, additional, Hunger, Sophia, additional, Hunkler, Christian, additional, Huth, Nora, additional, Ignacz, Zsofia, additional, Israel, Sabine, additional, Jacobs, Laura, additional, Jacobsen, Jannes, additional, Jaeger, Bastian, additional, Jungkunz, Sebastian, additional, Jungmann, Nils, additional, Kanjana, Jennifer, additional, Kauff, Mathias, additional, Khan, Salman, additional, Khatua, Sayak, additional, Kleinert, Manuel, additional, Klinger, Julia, additional, Kolb, Jan-Philipp, additional, Kolczynska, Marta, additional, Kuk, John Seungmin, additional, Kunißen, Katharina, additional, Sinatra, Dafina Kurti, additional, Greinert, Alexander, additional, Lee, Robin C., additional, Lersch, Philipp M., additional, Liu, David, additional, Löbel, Lea-Maria, additional, Lutscher, Philipp, additional, Mader, Matthias, additional, Madia, Joan Eliel, additional, Malancu, Natalia, additional, Maldonado, Luis, additional, Marahrens, Helge, additional, Martin, Nicole, additional, Martinez, Paul, additional, Mayerl, Jochen, additional, MAYORGA, OSCAR Jose, additional, McDonnell, Robert Myles, additional, McManus, Patricia A., additional, Wagner, Kyle, additional, Meeusen, Cecil, additional, Meierrieks, Daniel, additional, Mellon, Jonathan, additional, Merhout, Friedolin, additional, Merk, Samuel, additional, Meyer, Daniel, additional, Micheli, Leticia, additional, Mijs, Jonathan J.B., additional, Moya, Cristóbal, additional, Neunhoeffer, Marcel, additional, Nüst, Daniel, additional, Nygård, Olav, additional, Ochsenfeld, Fabian, additional, Otte, Gunnar, additional, Pechenkina, Anna, additional, Pickup, Mark, additional, Prosser, Christopher, additional, Raes, Louis, additional, Ralston, Kevin, additional, Ramos, Miguel, additional, Reichert, Frank, additional, Roets, Arne, additional, Rogers, Jonathan, additional, Ropers, Guido, additional, Samuel, Robin, additional, Sand, Gergor, additional, Petrarca, Constanza Sanhueza, additional, Schachter, Ariela, additional, Schaeffer, Merlin, additional, Schieferdecker, David, additional, Schlueter, Elmar, additional, Schmidt, Katja, additional, Schmidt, Regine, additional, Schmidt-Catran, Alexander, additional, Schmiedeberg, Claudia, additional, Schneider, Jürgen, additional, Schoonvelde, Martijn, additional, Schulte-Cloos, Julia, additional, Schumann, Sandy, additional, Schunck, Reinhard, additional, Schupp, Juergen, additional, Seuring, Julian, additional, Silber, Henning, additional, Sleegers, Willem W. A., additional, Sonntag, Nico, additional, Staudt, Alexander, additional, Steiber, Nadia, additional, Steiner, Nils, additional, Sternberg, Sebastian, additional, Stiers, Dieter, additional, Stojmenovska, Dragana, additional, Storz, Nora, additional, Striessnig, Erich, additional, Stroppe, Anne-Kathrin, additional, Suchow, Jordan, additional, Teltemann, Janna, additional, Tibajev, Andrey, additional, Tung, Brian B., additional, Vagni, Giacomo, additional, Van Assche, Jasper, additional, van der Linden, Meta, additional, van der Noll, Jolanda, additional, Van Hootegem, Arno, additional, Vogtenhuber, Stefan, additional, Voicu, Bogdan, additional, Wagemans, Fieke, additional, Wehl, Nadja, additional, Werner, Hannah, additional, Wiernik, Brenton M., additional, Winter, Fabian, additional, Wolf, Christof, additional, Wu, Cary, additional, Yamada, Yuki, additional, Zakula, Björn, additional, Zhang, Nan, additional, Ziller, Conrad, additional, Zins, Stefan, additional, and Żółtak, Tomasz, additional

Published
2021
Full Text
View/download PDF

33. The impact of Covid-19 on fieldwork efforts and planning in pairfam and FReDA-GGS

Author

Gummer, Tobias, Schmiedeberg, Claudia, Bujard, Martin, Christmann, Pablo, Hank, Karsten, Kunz, Tanja, Lück, Detlev, and Neyer, Franz J.

Subjects
03 medical and health sciences, 0302 clinical medicine, 030212 general & internal medicine, 010501 environmental sciences, 01 natural sciences, 0105 earth and related environmental sciences
Abstract

The worldwide spread of the COVID-19 pandemic has disrupted the fieldwork of surveys. The data collection efforts via the face-to-face mode have been affected especially, including the ongoing surveys that were in the field during the COVID-19 outbreak and the planned surveys scheduled for fieldwork later in 2020. We provide an account of how COVID-19 has impacted two family studies in Germany: “The German Family Panel” (pairfam) and the “Generations and Gender Survey” (GGS) both of which will be part of the “Family Research and Demographic Analysis” (FReDA) infrastructure. Based on pairfam, we illustrate the effects of the pandemic on ongoing data collection and the measures taken to proceed with fieldwork, and we report on a special COVID-19 survey. Based on FReDA-GGS, we outline how COVID-19 has affected our planned survey schedules, what future challenges are expected when fieldwork becomes possible again, and how we have adapted our plans accordingly., Survey Research Methods, Vol 14 No 2 (2020): Survey Research Methods During the COVID-19 Crisis

Published
2020
Full Text
View/download PDF

34. Fieldwork Monitoring in Practice: Insights from 17 Large-scale Social Science Surveys in Germany

Author

Meitinger, Katharina, Stadtmüller, Sven, Silber, Henning, Auriga, Roman, Bergmann, Michael, Blohm, Michael, Blumenberg, Manuela, Christmann, Pablo, Felderer, Barbara, Frodermann, Corinna, Griese, Florian, Gummer, Tobias, Koch, Achim, Kottwitz, Anita, Krell, Kristina, Krieger, Ulrich, Liebau, Elisabeth, Martin, Silke, Müller-Kuller, Andre, Rammstedt, Beatrice, Schaurer, Ines, Scherpenzeel, Annette, Schmiedeberg, Claudia, Schmidt, Tobias, Schnaudt, Christian, Verhoeven, Sascha, Zabal, Anouk, Leerstoel Schoot, and Methodology and statistics for the behavioural and social sciences

Subjects
Monitoring, fieldwork measures, Umfrageforschung, Fragebogen, Federal Republic of Germany, key performance indicators, fieldwork monitoring, survey research, Messung, field research, Social sciences, sociology, anthropology, Feldforschung, Erhebungstechniken und Analysetechniken der Sozialwissenschaften, Sozialwissenschaften, Soziologie, questionnaire, indicator, indicator research, Indikator, standardization (meth.), Bundesrepublik Deutschland, Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods, Standardisierung, Indikatorenforschung, ddc:300, measurement
Abstract

This study provides a synopsis of the current fieldwork monitoring practices of large-scale surveys in Germany. Based on the results of a standardized questionnaire, the study summarizes fieldwork monitoring indicators used and fieldwork measures carried out by 17 large-scale social sciences surveys in Germany. Our descriptive results reveal that a common set of fieldwork indicators and measures exist on which the studied surveys rely. However, it also uncovers the need for additional design-specific indicators. Finally, it underlines the importance of a close cooperation between survey representatives and fieldwork agencies to optimize processes in fieldwork monitoring in the German survey context. The article concludes with implications for fieldwork practice.

Published
2020

35. Fieldwork Monitoring in Practice: Insights from 17 Large-scale Social Science Surveys in Germany

Author

Meitinger, K.M., Stadtmüller, Sven, Silber, Henning, Auriga, Roman, Bergmann, Michael, Blohm, Michael, Blumenberg, Manuela, Christmann, Pablo, Felderer, Barbara, Frodermann, Corinna, Griese, Florian, Gummer, Tobias, Hähnel, Sascha, Koch, Achim, Kottwitz, Anita, Krell, Kristina, Krieger, Ulrich, Liebau, Elisabeth, Martin, Silke, Müller-Kuller, Andre, Rammstedt, Beatrice, Schaurer, Ines, Scherpenzeel, Annette, Schmiedeberg, Claudia, Schmidt, Tobias, Schnaudt, Christian, Zabal, Anouk, Leerstoel Schoot, and Methodology and statistics for the behavioural and social sciences

Subjects
fieldwork measures, key performance indicators, fieldwork monitoring
Abstract

This study provides a synopsis of the current fieldwork monitoring practices of large-scale surveys in Germany. Based on the results of a standardized questionnaire, the study summarizes fieldwork monitoring indicators used and fieldwork measures carried out by 17 large-scale social sciences surveys in Germany. Our descriptive results reveal that a common set of fieldwork indicators and measures exist on which the studied surveys rely. However, it also uncovers the need for additional design-specific indicators. Finally, it underlines the importance of a close cooperation between survey representatives and fieldwork agencies to optimize processes in fieldwork monitoring in the German survey-context. The article concludes with implications for fieldwork practice.

Published
2020

36. How Many Replicators Does It Take to Achieve Reliability? Investigating Researcher Variability in a Crowdsourced Replication

Author

Breznau, Nate, Rinke, Eike Mark, Wuttke, Alexander, Nguyen, Hung H. V., Adem, Muna, Adriaans, Jule, Akdeniz, Esra, Alvarez-Benjumea, Amalia, Andersen, Henrik Kenneth, Auer, Daniel, Azevedo, Flavio, Bahnsen, Oke, Bai, Ling, Balzer, Dave, Bauer, Gerrit, Bauer, Paul C., Baumann, Markus, Baute, Sharon, Benoit, Verena, Bernauer, Julian, Berning, Carl, Berthold, Anna, Bethke, Felix, Biegert, Thomas, Blinzler, Katharina, Blumenberg, Johannes, Bobzien, Licia, Bohman, Andrea, Bol, Thijs, Bostic, Amie, Brzozowska, Zuzanna, Burgdorf, Katharina, Burger, Kaspar, Busch, Kathrin, Castillo, Juan Carlos, Chan, Nathan, Christmann, Pablo, Connelly, Roxanne, Czymara, Christian S., Damian, Elena, Rooij, Eline De, Ecker, Alejandro, Edelmann, Achim, Eder, Christina, Eger, Maureen A., Ellerbrock, Simon, Forke, Anna, Forster, Andrea, Freire, Danilo, Gaasendam, Chris, Gavras, Konstantin, Gayle, Vernon, Gessler, Theresa, Gnambs, Timo, Godefroidt, Amélie, Grömping, Max, Groß, Martin, Gruber, Stefan, Gummer, Tobias, Hadjar, Andreas, Halbherr, Verena, Heisig, Jan Paul, Hellmeier, Sebastian, Heyne, Stefanie, Hirsch, Magdalena, Hjerm, Mikael, Hochman, Oshrat, Höffler, Jan H., Hövermann, Andreas, Hunger, Sophia, Hunkler, Christian, Huth, Nora, Ignacz, Zsofia, Israel, Sabine, Jacobs, Laura, Jacobsen, Jannes, Jaeger, Bastian, Jungkunz, Sebastian, Jungmann, Nils, Kanjana, Jennifer, Kauff, Mathias, Khan, Salman, Khatua, Sayak, Kleinert, Manuel, Klinger, Julia, Kolb, Jan-Philipp, Kołczyńska, Marta, Kuk, John Seungmin, Kunißen, Katharina, Sinatra, Dafina Kurti, Greinert, Alexander, C. Lee, Robin, Lersch, Philipp M., Liu, David, Löbel, Lea-Maria, Lutscher, Philipp, Mader, Matthias, Madia, Joan, Malancu, Natalia, Maldonado, Luis, Marahrens, Helge, Martin, Nicole, Martinez, Paul, Mayerl, Jochen, Mayorga, Oscar Jose, McDonnell, Robert Myles, McManus, Patricia, Wagner, Kyle, Meeusen, Cecil, Meierrieks, Daniel, Mellon, Jonathan, Merhout, Friedolin, Merk, Samuel, Meyer, Daniel, Micheli, Leticia, Mijs, Jonathan J. B., Moya, Cristóbal, Neunhoeffer, Marcel, Nüst, Daniel, Nygård, Olav, Ochsenfeld, Fabian, Otte, Gunnar, Pechenkina, Anna, Pickup, Mark, Prosser, Christopher, Raes, Louis, Ralston, Kevin, Ramos, Miguel, Reichert, Frank, Roets, Arne, Rogers, Jonathan, Ropers, Guido, Samuel, Robin, Sand, Gregor, Petrarca, Constanza Sanhueza, Schachter, Ariela, Schaeffer, Merlin, Schieferdecker, David, Schlueter, Elmar, Schmidt, Katja, Schmidt, Regine, Schmidt-Catran, Alexander, Schmiedeberg, Claudia, Schneider, Jürgen, Schoonvelde, Martijn, Schulte-Cloos, Julia, Schumann, Sandy, Schunck, Reinhard, Schupp, Jürgen, Seuring, Julian, Silber, Henning, Sleegers, Willem, Sonntag, Nico, Staudt, Alexander, Steiber, Nadia, Steiner, Nils, Sternberg, Sebastian, Stojmenovska, Dragana, Storz, Nora, Striessnig, Erich, Stroppe, Anne-Kathrin, Suchow, Jordan W., Teltemann, Janna, Tibajev, Andrey, Tung, Brian B., Vagni, Giacomo, Assche, Jasper Van, Linden, Meta Van Der, Noll, Jolanda Van Der, Hootegem, Arno Van, Vogtenhuber, Stefan, Voicu, Bogdan, Wagemans, Fieke, Wehl, Nadja, Werner, Hannah, Wiernik, Brenton M., Winter, Fabian, Wolf, Christof, Wu, Cary, Yamada, Yuki, Zakula, Björn, Zhang, Nan, Ziller, Conrad, Zins, Stefan, Żółtak, Tomasz, Breznau, Nate, Rinke, Eike Mark, Wuttke, Alexander, Nguyen, Hung H. V., Adem, Muna, Adriaans, Jule, Akdeniz, Esra, Alvarez-Benjumea, Amalia, Andersen, Henrik Kenneth, Auer, Daniel, Azevedo, Flavio, Bahnsen, Oke, Bai, Ling, Balzer, Dave, Bauer, Gerrit, Bauer, Paul C., Baumann, Markus, Baute, Sharon, Benoit, Verena, Bernauer, Julian, Berning, Carl, Berthold, Anna, Bethke, Felix, Biegert, Thomas, Blinzler, Katharina, Blumenberg, Johannes, Bobzien, Licia, Bohman, Andrea, Bol, Thijs, Bostic, Amie, Brzozowska, Zuzanna, Burgdorf, Katharina, Burger, Kaspar, Busch, Kathrin, Castillo, Juan Carlos, Chan, Nathan, Christmann, Pablo, Connelly, Roxanne, Czymara, Christian S., Damian, Elena, Rooij, Eline De, Ecker, Alejandro, Edelmann, Achim, Eder, Christina, Eger, Maureen A., Ellerbrock, Simon, Forke, Anna, Forster, Andrea, Freire, Danilo, Gaasendam, Chris, Gavras, Konstantin, Gayle, Vernon, Gessler, Theresa, Gnambs, Timo, Godefroidt, Amélie, Grömping, Max, Groß, Martin, Gruber, Stefan, Gummer, Tobias, Hadjar, Andreas, Halbherr, Verena, Heisig, Jan Paul, Hellmeier, Sebastian, Heyne, Stefanie, Hirsch, Magdalena, Hjerm, Mikael, Hochman, Oshrat, Höffler, Jan H., Hövermann, Andreas, Hunger, Sophia, Hunkler, Christian, Huth, Nora, Ignacz, Zsofia, Israel, Sabine, Jacobs, Laura, Jacobsen, Jannes, Jaeger, Bastian, Jungkunz, Sebastian, Jungmann, Nils, Kanjana, Jennifer, Kauff, Mathias, Khan, Salman, Khatua, Sayak, Kleinert, Manuel, Klinger, Julia, Kolb, Jan-Philipp, Kołczyńska, Marta, Kuk, John Seungmin, Kunißen, Katharina, Sinatra, Dafina Kurti, Greinert, Alexander, C. Lee, Robin, Lersch, Philipp M., Liu, David, Löbel, Lea-Maria, Lutscher, Philipp, Mader, Matthias, Madia, Joan, Malancu, Natalia, Maldonado, Luis, Marahrens, Helge, Martin, Nicole, Martinez, Paul, Mayerl, Jochen, Mayorga, Oscar Jose, McDonnell, Robert Myles, McManus, Patricia, Wagner, Kyle, Meeusen, Cecil, Meierrieks, Daniel, Mellon, Jonathan, Merhout, Friedolin, Merk, Samuel, Meyer, Daniel, Micheli, Leticia, Mijs, Jonathan J. B., Moya, Cristóbal, Neunhoeffer, Marcel, Nüst, Daniel, Nygård, Olav, Ochsenfeld, Fabian, Otte, Gunnar, Pechenkina, Anna, Pickup, Mark, Prosser, Christopher, Raes, Louis, Ralston, Kevin, Ramos, Miguel, Reichert, Frank, Roets, Arne, Rogers, Jonathan, Ropers, Guido, Samuel, Robin, Sand, Gregor, Petrarca, Constanza Sanhueza, Schachter, Ariela, Schaeffer, Merlin, Schieferdecker, David, Schlueter, Elmar, Schmidt, Katja, Schmidt, Regine, Schmidt-Catran, Alexander, Schmiedeberg, Claudia, Schneider, Jürgen, Schoonvelde, Martijn, Schulte-Cloos, Julia, Schumann, Sandy, Schunck, Reinhard, Schupp, Jürgen, Seuring, Julian, Silber, Henning, Sleegers, Willem, Sonntag, Nico, Staudt, Alexander, Steiber, Nadia, Steiner, Nils, Sternberg, Sebastian, Stojmenovska, Dragana, Storz, Nora, Striessnig, Erich, Stroppe, Anne-Kathrin, Suchow, Jordan W., Teltemann, Janna, Tibajev, Andrey, Tung, Brian B., Vagni, Giacomo, Assche, Jasper Van, Linden, Meta Van Der, Noll, Jolanda Van Der, Hootegem, Arno Van, Vogtenhuber, Stefan, Voicu, Bogdan, Wagemans, Fieke, Wehl, Nadja, Werner, Hannah, Wiernik, Brenton M., Winter, Fabian, Wolf, Christof, Wu, Cary, Yamada, Yuki, Zakula, Björn, Zhang, Nan, Ziller, Conrad, Zins, Stefan, and Żółtak, Tomasz

Abstract

The paper reports findings from a crowdsourced replication. Eighty-four replicator teams attempted to verify results reported in an original study by running the same models with the same data. The replication involved an experimental condition. A “transparent” group received the original study and code, and an “opaque” group received the same underlying study but with only a methods section and description of the regression coefficients without size or significance, and no code. The transparent group mostly verified the original study (95.5%), while the opaque group had less success (89.4%). Qualitative investigation of the replicators’ workflows reveals many causes of non-verification. Two categories of these causes are hypothesized, routine and non-routine. After correcting non-routine errors in the research process to ensure that the results reflect a level of quality that should be present in ‘real-world’ research, the rate of verification was 96.1 in the transparent group and 92.4 in the opaque group. Two conclusions follow: (1) Although high, the verification rate suggests that it would take a minimum of three replicators per study to achieve replication reliability of at least 95 confidence assuming ecological validity in this controlled setting, and (2) like any type of scientific research, replication is prone to errors that derive from routine and undeliberate actions in the research process. The latter suggests that idiosyncratic researcher variability might provide a key to understanding part of the “reliability crisis” in social and behavioral science and is a reminder of the importance of transparent and well documented workflows.

Published
2021

37. Observing Many Researchers Using the Same Data and Hypothesis Reveals a Hidden Universe of Uncertainty

Author

Breznau, Nate, Rinke, Eike Mark, Wuttke, Alexander, Adem, Muna, Adriaans, Jule, Alvarez-Benjumea, Amalia, Andersen, Henrik Kenneth, Auer, Daniel, Azevedo, Flavio, Bahnsen, Oke, Balzer, Dave, Bauer, Gerrit, Bauer, Paul C., Baumann, Markus, Baute, Sharon, Benoit, Verena, Bernauer, Julian, Berning, Carl, Berthold, Anna, Bethke, Felix, Biegert, Thomas, Blinzler, Katharina, Blumenberg, Johannes, Bobzien, Licia, Bohman, Andrea, Bol, Thijs, Bostic, Amie, Brzozowska, Zuzanna, Burgdorf, Katharina, Burger, Kaspar, Busch, Kathrin, Castillo, Juan Carlos, Chan, Nathan, Christmann, Pablo, Connelly, Roxanne, Czymara, Christian S., Damian, Elena, Ecker, Alejandro, Edelmann, Achim, Eger, Maureen A., Ellerbrock, Simon, Forke, Anna, Forster, Andrea, Gaasendam, Chris, Gavras, Konstantin, Gayle, Vernon, Gessler, Theresa, Gnambs, Timo, Godefroidt, Amélie, Grömping, Max, Groß, Martin, Gruber, Stefan, Gummer, Tobias, Hadjar, Andreas, Heisig, Jan Paul, Hellmeier, Sebastian, Heyne, Stefanie, Hirsch, Magdalena, Hjerm, Mikael, Hochman, Oshrat, Hövermann, Andreas, Hunger, Sophia, Hunkler, Christian, Huth, Nora, Ignacz, Zsofia, Jacobs, Laura, Jacobsen, Jannes, Jaeger, Bastian, Jungkunz, Sebastian, Jungmann, Nils, Kauff, Mathias, Kleinert, Manuel, Klinger, Julia, Kolb, Jan-Philipp, Kołczyńska, Marta, Kuk, John Seungmin, Kunißen, Katharina, Sinatra, Dafina Kurti, Greinert, Alexander, Lersch, Philipp M., Löbel, Lea-Maria, Lutscher, Philipp, Mader, Matthias, Madia, Joan, Malancu, Natalia, Maldonado, Luis, Marahrens, Helge, Martin, Nicole, Martinez, Paul, Mayerl, Jochen, Mayorga, Oscar Jose, McManus, Patricia, Wagner, Kyle, Meeusen, Cecil, Meierrieks, Daniel, Mellon, Jonathan, Merhout, Friedolin, Merk, Samuel, Meyer, Daniel, Micheli, Leticia, Mijs, Jonathan J. B., Moya, Cristóbal, Neunhoeffer, Marcel, Nüst, Daniel, Nygård, Olav, Ochsenfeld, Fabian, Otte, Gunnar, Pechenkina, Anna, Prosser, Christopher, Raes, Louis, Ralston, Kevin, Ramos, Miguel, Roets, Arne, Rogers, Jonathan, Ropers, Guido, Samuel, Robin, Sand, Gregor, Schachter, Ariela, Schaeffer, Merlin, Schieferdecker, David, Schlueter, Elmar, Schmidt, Katja M., Schmidt, Regine, Schmidt-Catran, Alexander, Schmiedeberg, Claudia, Schneider, Jürgen, Schoonvelde, Martijn, Schulte-Cloos, Julia, Schumann, Sandy, Schunck, Reinhard, Schupp, Jürgen, Seuring, Julian, Silber, Henning, Sleegers, Willem, Sonntag, Nico, Staudt, Alexander, Steiber, Nadia, Steiner, Nils, Sternberg, Sebastian, Stiers, Dieter, Stojmenovska, Dragana, Storz, Nora, Striessnig, Erich, Stroppe, Anne-Kathrin, Teltemann, Janna, Tibajev, Andrey, Tung, Brian B., Vagni, Giacomo, Assche, Jasper Van, Linden, Meta Van Der, Noll, Jolanda Van Der, Hootegem, Arno Van, Vogtenhuber, Stefan, Voicu, Bogdan, Wagemans, Fieke, Wehl, Nadja, Werner, Hannah, Wiernik, Brenton M., Winter, Fabian, Wolf, Christof, Yamada, Yuki, Zhang, Nan, Ziller, Conrad, Zins, Stefan, Żółtak, Tomasz, Nguyen, Hung H. V., Breznau, Nate, Rinke, Eike Mark, Wuttke, Alexander, Adem, Muna, Adriaans, Jule, Alvarez-Benjumea, Amalia, Andersen, Henrik Kenneth, Auer, Daniel, Azevedo, Flavio, Bahnsen, Oke, Balzer, Dave, Bauer, Gerrit, Bauer, Paul C., Baumann, Markus, Baute, Sharon, Benoit, Verena, Bernauer, Julian, Berning, Carl, Berthold, Anna, Bethke, Felix, Biegert, Thomas, Blinzler, Katharina, Blumenberg, Johannes, Bobzien, Licia, Bohman, Andrea, Bol, Thijs, Bostic, Amie, Brzozowska, Zuzanna, Burgdorf, Katharina, Burger, Kaspar, Busch, Kathrin, Castillo, Juan Carlos, Chan, Nathan, Christmann, Pablo, Connelly, Roxanne, Czymara, Christian S., Damian, Elena, Ecker, Alejandro, Edelmann, Achim, Eger, Maureen A., Ellerbrock, Simon, Forke, Anna, Forster, Andrea, Gaasendam, Chris, Gavras, Konstantin, Gayle, Vernon, Gessler, Theresa, Gnambs, Timo, Godefroidt, Amélie, Grömping, Max, Groß, Martin, Gruber, Stefan, Gummer, Tobias, Hadjar, Andreas, Heisig, Jan Paul, Hellmeier, Sebastian, Heyne, Stefanie, Hirsch, Magdalena, Hjerm, Mikael, Hochman, Oshrat, Hövermann, Andreas, Hunger, Sophia, Hunkler, Christian, Huth, Nora, Ignacz, Zsofia, Jacobs, Laura, Jacobsen, Jannes, Jaeger, Bastian, Jungkunz, Sebastian, Jungmann, Nils, Kauff, Mathias, Kleinert, Manuel, Klinger, Julia, Kolb, Jan-Philipp, Kołczyńska, Marta, Kuk, John Seungmin, Kunißen, Katharina, Sinatra, Dafina Kurti, Greinert, Alexander, Lersch, Philipp M., Löbel, Lea-Maria, Lutscher, Philipp, Mader, Matthias, Madia, Joan, Malancu, Natalia, Maldonado, Luis, Marahrens, Helge, Martin, Nicole, Martinez, Paul, Mayerl, Jochen, Mayorga, Oscar Jose, McManus, Patricia, Wagner, Kyle, Meeusen, Cecil, Meierrieks, Daniel, Mellon, Jonathan, Merhout, Friedolin, Merk, Samuel, Meyer, Daniel, Micheli, Leticia, Mijs, Jonathan J. B., Moya, Cristóbal, Neunhoeffer, Marcel, Nüst, Daniel, Nygård, Olav, Ochsenfeld, Fabian, Otte, Gunnar, Pechenkina, Anna, Prosser, Christopher, Raes, Louis, Ralston, Kevin, Ramos, Miguel, Roets, Arne, Rogers, Jonathan, Ropers, Guido, Samuel, Robin, Sand, Gregor, Schachter, Ariela, Schaeffer, Merlin, Schieferdecker, David, Schlueter, Elmar, Schmidt, Katja M., Schmidt, Regine, Schmidt-Catran, Alexander, Schmiedeberg, Claudia, Schneider, Jürgen, Schoonvelde, Martijn, Schulte-Cloos, Julia, Schumann, Sandy, Schunck, Reinhard, Schupp, Jürgen, Seuring, Julian, Silber, Henning, Sleegers, Willem, Sonntag, Nico, Staudt, Alexander, Steiber, Nadia, Steiner, Nils, Sternberg, Sebastian, Stiers, Dieter, Stojmenovska, Dragana, Storz, Nora, Striessnig, Erich, Stroppe, Anne-Kathrin, Teltemann, Janna, Tibajev, Andrey, Tung, Brian B., Vagni, Giacomo, Assche, Jasper Van, Linden, Meta Van Der, Noll, Jolanda Van Der, Hootegem, Arno Van, Vogtenhuber, Stefan, Voicu, Bogdan, Wagemans, Fieke, Wehl, Nadja, Werner, Hannah, Wiernik, Brenton M., Winter, Fabian, Wolf, Christof, Yamada, Yuki, Zhang, Nan, Ziller, Conrad, Zins, Stefan, Żółtak, Tomasz, and Nguyen, Hung H. V.

Abstract

How does noise generated by researcher decisions undermine the credibility of science? We test this by observing all decisions made among 73 research teams as they independently conduct studies on the same hypothesis with identical starting data. We find excessive variation of outcomes. When combined, the 107 observed research decisions taken across teams explained at most 2.6 of the total variance in effect sizes and 10 of the deviance in subjective conclusions. Expertise, prior beliefs and attitudes of the researchers explain even less. Each model deployed to test the hypothesis was unique, which highlights a vast universe of research design variability that is normally hidden from view and suggests humility when presenting and interpreting scientific findings.

Published
2021

38. Observing Many Researchers Using the Same Data and Hypothesis Reveals a Hidden Universe of Uncertainty

Author

Breznau, Nate, primary, Rinke, Eike Mark, additional, Wuttke, Alexander, additional, Adem, Muna, additional, Adriaans, Jule, additional, Alvarez-Benjumea, Amalia, additional, Andersen, Henrik Kenneth, additional, Auer, Daniel, additional, Azevedo, Flavio, additional, Bahnsen, Oke, additional, Balzer, Dave, additional, Bauer, Gerrit, additional, Bauer, Paul, additional, Baumann, Markus, additional, Baute, Sharon, additional, Benoit, Verena, additional, Bernauer, Julian, additional, Berning, Carl, additional, Berthold, Anna, additional, Bethke, Felix S., additional, Biegert, Thomas, additional, Blinzler, Katharina, additional, Blumenberg, Johannes, additional, Bobzien, Licia, additional, Bohman, Andrea, additional, Bol, Thijs, additional, Bostic, Amie, additional, Brzozowska, Zuzanna, additional, Burgdorf, Katharina, additional, Burger, Kaspar, additional, Busch, Kathrin, additional, Castillo, Juan Carlos, additional, Chan, Nathan, additional, Christmann, Pablo, additional, Connelly, Roxanne, additional, Czymara, Christian S., additional, Damian, Elena, additional, Ecker, Alejandro, additional, Edelmann, Achim, additional, Eger, Maureen A., additional, Ellerbrock, Simon, additional, Forke, Anna, additional, Forster, Andrea Gabriele, additional, Gaasendam, Chris, additional, Gavras, Konstantin, additional, Gayle, Vernon, additional, Gessler, Theresa, additional, Gnambs, Timo, additional, Godefroidt, Amélie, additional, Grömping, Max, additional, Groß, Martin, additional, Gruber, Stefan, additional, Gummer, Tobias, additional, Hadjar, Andreas, additional, Heisig, Jan Paul, additional, Hellmeier, Sebastian, additional, Heyne, Stefanie, additional, Hirsch, Magdalena, additional, Hjerm, Mikael, additional, Hochman, Oshrat, additional, Hövermann, Andreas, additional, Hunger, Sophia, additional, Hunkler, Christian, additional, Huth-Stöckle, Nora, additional, Ignacz, Zsofia, additional, Jacobs, Laura, additional, Jacobsen, Jannes, additional, Jaeger, Bastian, additional, Jungkunz, Sebastian, additional, Jungmann, Nils, additional, Kauff, Mathias, additional, Kleinert, Manuel, additional, Klinger, Julia, additional, Kolb, Jan-Philipp, additional, Kołczyńska, Marta, additional, Kuk, John Seungmin, additional, Kunißen, Katharina, additional, Sinatra, Dafina Kurti, additional, Greinert, Alexander, additional, Lersch, Philipp M., additional, Löbel, Lea-Maria, additional, Lutscher, Philipp, additional, Mader, Matthias, additional, Madia, Joan Eliel, additional, Malancu, Natalia, additional, Maldonado, Luis, additional, Marahrens, Helge, additional, Martin, Nicole, additional, Martinez, Paul, additional, Mayerl, Jochen, additional, MAYORGA, OSCAR Jose, additional, McManus, Patricia A., additional, Wagner, Kyle, additional, Meeusen, Cecil, additional, Meierrieks, Daniel, additional, Mellon, Jonathan, additional, Merhout, Friedolin, additional, Merk, Samuel, additional, Meyer, Daniel, additional, Micheli, Leticia, additional, Mijs, Jonathan J.B., additional, Moya, Cristóbal, additional, Neunhoeffer, Marcel, additional, Nüst, Daniel, additional, Nygård, Olav, additional, Ochsenfeld, Fabian, additional, Otte, Gunnar, additional, Pechenkina, Anna, additional, Prosser, Christopher, additional, Raes, Louis, additional, Ralston, Kevin, additional, Ramos, Miguel, additional, Roets, Arne, additional, Rogers, Jonathan, additional, Ropers, Guido, additional, Samuel, Robin, additional, Sand, Gergor, additional, Schachter, Ariela, additional, Schaeffer, Merlin, additional, Schieferdecker, David, additional, Schlueter, Elmar, additional, Schmidt, Katja, additional, Schmidt, Regine, additional, Schmidt-Catran, Alexander, additional, Schmiedeberg, Claudia, additional, Schneider, Jürgen, additional, Schoonvelde, Martijn, additional, Schulte-Cloos, Julia, additional, Schumann, Sandy, additional, Schunck, Reinhard, additional, Schupp, Juergen, additional, Seuring, Julian, additional, Silber, Henning, additional, Sleegers, Willem W. A., additional, Sonntag, Nico, additional, Staudt, Alexander, additional, Steiber, Nadia, additional, Steiner, Nils, additional, Sternberg, Sebastian, additional, Stiers, Dieter, additional, Stojmenovska, Dragana, additional, Storz, Nora, additional, Striessnig, Erich, additional, Stroppe, Anne-Kathrin, additional, Teltemann, Janna, additional, Tibajev, Andrey, additional, Tung, Brian B., additional, Vagni, Giacomo, additional, Van Assche, Jasper, additional, van der Linden, Meta, additional, van der Noll, Jolanda, additional, Van Hootegem, Arno, additional, Vogtenhuber, Stefan, additional, Voicu, Bogdan, additional, Wagemans, Fieke, additional, Wehl, Nadja, additional, Werner, Hannah, additional, Wiernik, Brenton M., additional, Winter, Fabian, additional, Wolf, Christof, additional, Yamada, Yuki, additional, Zhang, Nan, additional, Ziller, Conrad, additional, Zins, Stefan, additional, Żółtak, Tomasz, additional, and Nguyen, Hung Hoang Viet, additional

Published
2021
Full Text
View/download PDF

43. Fieldwork Monitoring in Practice: Insights from 17 Large-scale Social Science Surveys in Germany

Author

Leerstoel Schoot, Methodology and statistics for the behavioural and social sciences, Meitinger, K.M., Stadtmüller, Sven, Silber, Henning, Auriga, Roman, Bergmann, Michael, Blohm, Michael, Blumenberg, Manuela, Christmann, Pablo, Felderer, Barbara, Frodermann, Corinna, Griese, Florian, Gummer, Tobias, Hähnel, Sascha, Koch, Achim, Kottwitz, Anita, Krell, Kristina, Krieger, Ulrich, Liebau, Elisabeth, Martin, Silke, Müller-Kuller, Andre, Rammstedt, Beatrice, Schaurer, Ines, Scherpenzeel, Annette, Schmiedeberg, Claudia, Schmidt, Tobias, Schnaudt, Christian, Zabal, Anouk, Leerstoel Schoot, Methodology and statistics for the behavioural and social sciences, Meitinger, K.M., Stadtmüller, Sven, Silber, Henning, Auriga, Roman, Bergmann, Michael, Blohm, Michael, Blumenberg, Manuela, Christmann, Pablo, Felderer, Barbara, Frodermann, Corinna, Griese, Florian, Gummer, Tobias, Hähnel, Sascha, Koch, Achim, Kottwitz, Anita, Krell, Kristina, Krieger, Ulrich, Liebau, Elisabeth, Martin, Silke, Müller-Kuller, Andre, Rammstedt, Beatrice, Schaurer, Ines, Scherpenzeel, Annette, Schmiedeberg, Claudia, Schmidt, Tobias, Schnaudt, Christian, and Zabal, Anouk

Published
2020

44. The Crowdsourced Replication Initiative: Investigating Immigration and Social Policy Preferences. Executive Report

Author

Breznau, Nate, Rinke, Eike Mark, Wuttke, Alexander, Adem, Muna, Adriaans, Jule, Alvarez-Benjumea, Amalia, Andersen, Henrik, Auer, Daniel, Azevedo, Flavio, Bahnsen, Oke, Balzer, Dave, Bauer, Gerrit, Bauer, Paul, Baumann, Markus, Baute, Sharon, Benoit, Verena, Berning, Carl, Bernauer, Julian, Berthold, Anna, Bethke, Felix, Biegert, Thomas, Blinzler, Katharina, Blumenberg, Johannes, Bol, Thijs, Bobzien, Licia, Bohman, Andrea, Bostic, Amie, Brzozowska, Zuzanna, Burgdorf, Katharina, Burger, Kaspar, Busch, Kathrin, Castillo, Juan Carlos, Chan, Nathan, Christmann, Pablo, Connelly, Roxanne, Czymara, Christian, Damian, Elena, Edelmann, Achim, Ecker, Alejandro, Eger, Maureen A., Ellerbrock, Simon, Forke, Anna, Forster, Andrea, Gavras, Konstantin, Gayle, Vernon, Gaasendam, Chris, Gessler, Theresa, Gnambs, Timo, Godefroidt, Amélie, Greinert, Alexander, Groß, Martin, Grömping, Max, Gruber, Stefan, Gummer, Tobias, Hadjar, Andreas, Heisig, Jan Paul, Hellmeier, Sebastian, Heyne, Stefanie, Hirsch, Magdalena, Hjerm, Mikael, Hochman, Oshrat, Hövermann, Andreas, Huth, Nora, Hunger, Sophia, Hunkler, Christian, Ignacz, Zsofia, Jacobs, Laura, Jacobsen, Jannes, Jaeger, Bastian, Jungkunz, Sebastian, Jungmann, Nils, Kauff, Mathias, Kleinert, Manuel, Klinger, Julia, Kolb, Jan-Philipp, Kolczynska, Marta, Kuk, John, Kunißen, Katharina, Kurti, Dafina, Lersch, Philipp M., Löbel, Lea-Maria, Lutscher, Philipp, Mader, Matthias, Madia, Joan Eliel, Malancu, Natalia Cornelia, Maldonado, Luis, Marahrens, Helge, Martin, Nicole, Martinez, Paul, Mayerl, Jochen, MAYORGA, Oscar Jose, McManus, Patricia, Meeusen, Cecil, Meierrieks, Daniel, Mellon, Jonathan, Merhout, Friedolin, Merk, Samuel, Meyer, Daniel, Micheli, Leticia, Mijs, Jonathan, Moya, Cristóbal, Neunhoeffer, Marcel, Nüst, Daniel, Nygård, Olav, Ochsenfeld, Fabian, Otte, Gunnar, Pechenkina, Anna, Prosser, Christopher, Raes, Louis, Ralston, Kevin, Ramos, Miguel, Roets, Arne, Rogers, Jonathan, Ropers, Guido, Samuel, Robin, Sand, Gergor, Schachter, Ariela, Schaeffer, Merlin, Schieferdecker, David, Schlueter, Elmar, Schmidt, Katja, Schmidt, Regine, Schmidt-Catran, Alexander, Schmiedeberg, Claudia, Schneider, Jürgen, Schoonvelde, Martijn, Schulte-Cloos, Julia, Schumann, Sandy, Schunck, Reinhard, Schupp, Juergen, Seuring, Julian, Silber, Henning, Sleegers, Willem, Sonntag, Nico, Staudt, Alexander, Steiber, Nadia, Steiner, Nils, Sternberg, Sebastian, Stiers, Dieter, Striessnig, Erich, Stojmenovska, Dragana, Storz, Nora, Stroppe, Anne-Kathrin, Teltemann, Janna, Tibajev, Andrey, Tung, Brian B., Vagni, Giacomo, Van Assche, Jasper, van der Linden, Meta, van der Noll, Jolanda, Van Hootegem, Arno, Vogtenhuber, Stefan, Voicu, Bogdan, Wagemans, Fieke Maria Antoinet, Wagner, Kyle, Wehl, Nadja, Werner, Hannah, Wiernik, Brenton M., Winter, Fabian, Wolf, Christof, Zakula, Björn, Ziller, Conrad, Zins, Stefan, Zhang, Nan, and Żółtak, Tomasz

Subjects
Sociologie & sciences sociales [H10] [Sciences sociales & comportementales, psychologie], Open Science, Sociology & social sciences [H10] [Social & behavioral sciences, psychology], Data Science, Replication, Crowdsourcing, Immigration, Social Policy
Abstract

In an era of mass migration, social scientists, populist parties and social movements raise concerns over the future of immigration-destination societies. What impacts does this have on policy and social solidarity? Comparative cross-national research, relying mostly on secondary data, has findings in different directions. There is a threat of selective model reporting and lack of replicability. The heterogeneity of countries obscures attempts to clearly define data-generating models. P-hacking and HARKing lurk among standard research practices in this area.This project employs crowdsourcing to address these issues. It draws on replication, deliberation, meta-analysis and harnessing the power of many minds at once. The Crowdsourced Replication Initiative carries two main goals, (a) to better investigate the linkage between immigration and social policy preferences across countries, and (b) to develop crowdsourcing as a social science method. The Executive Report provides short reviews of the area of social policy preferences and immigration, and the methods and impetus behind crowdsourcing plus a description of the entire project. Three main areas of findings will appear in three papers, that are registered as PAPs or in process.

Published
2019

45. Do Economic Hardship and Pressure Really Influence Parenting?

Author

Schmiedeberg, Claudia and Bozoyan, Christiane

Subjects
PARENTING, POVERTY, HARDSHIP, PSYCHOLOGICAL stress, FINANCIAL stress, HOUSEHOLD budgets
Abstract

Poverty and its effect on parenting in the context of the family stress model have a long tradition in research, but results are rather mixed. Following this theoretical approach, we analyse whether poverty and financial pressure are associated with disrupted parenting. We draw on data from the German Family Panel pairfam and implement both between and within approaches to test whether parenting behaviours are associated with economic hardship and pressure. While basic between-group regressions confirm the link between economic hardship and parenting as predicted by the family stress model, we do not find a significant association of poverty and parenting when including additional confounders or using fixed-effects models. We conclude that rather than the financial situation itself unobserved heterogeneity causes differences in parenting behaviours between better and worse off families, at least in Germany. [ABSTRACT FROM AUTHOR]

Published
2021
Full Text
View/download PDF

46. The Crowdsourced Replication Initiative: Investigating Immigration and Social Policy Preferences. Executive Report.

Author

Breznau, Nate, primary, Rinke, Eike Mark, additional, Wuttke, Alexander, additional, Adem, Muna, additional, Adriaans, Jule, additional, Alvarez-Benjumea, Amalia, additional, Andersen, Henrik Kenneth, additional, Auer, Daniel, additional, Azevedo, Flavio, additional, Bahnsen, Oke, additional, Balzer, Dave, additional, Bauer, Gerrit, additional, Bauer, Paul, additional, Baumann, Markus, additional, Baute, Sharon, additional, Benoit, Verena, additional, Berning, Carl, additional, Bernauer, Julian, additional, Berthold, Anna, additional, Bethke, Felix, additional, Biegert, Thomas, additional, Blinzler, Katharina, additional, Blumenberg, Johannes, additional, Bol, Thijs, additional, Bobzien, Licia, additional, Bohman, Andrea, additional, Bostic, Amie, additional, Brzozowska, Zuzanna, additional, Burgdorf, Katharina, additional, Burger, Kaspar, additional, Busch, Kathrin, additional, Castillo, Juan Carlos, additional, Chan, Nathan, additional, Christmann, Pablo, additional, Connelly, Roxanne, additional, Czymara, Christian S., additional, Damian, Elena, additional, Edelmann, Achim, additional, Ecker, Alejandro, additional, Eger, Maureen A., additional, Ellerbrock, Simon, additional, Forke, Anna, additional, Forster, Andrea Gabriele, additional, Gavras, Konstantin, additional, Gayle, Vernon, additional, Gaasendam, Chris, additional, Gessler, Theresa, additional, Gnambs, Timo, additional, Godefroidt, Amélie, additional, Greinert, Alexander, additional, Groß, Martin, additional, Grömping, Max, additional, Gruber, Stefan, additional, Gummer, Tobias, additional, Hadjar, Andreas, additional, Heisig, Jan Paul, additional, Hellmeier, Sebastian, additional, Heyne, Stefanie, additional, Hirsch, Magdalena, additional, Hjerm, Mikael, additional, Hochman, Oshrat, additional, Höffler, Jan H., additional, Hövermann, Andreas, additional, Huth, Nora, additional, Hunger, Sophia, additional, Hunkler, Christian, additional, Ignacz, Zsofia, additional, Jacobs, Laura, additional, Jacobsen, Jannes, additional, Jaeger, Bastian, additional, Jungkunz, Sebastian, additional, Jungmann, Nils, additional, Kauff, Mathias, additional, Kleinert, Manuel, additional, Klinger, Julia, additional, Kolb, Jan-Philipp, additional, Kolczynska, Marta, additional, Kuk, John, additional, Kunißen, Katharina, additional, Kurti, Dafina, additional, Lersch, Philipp M., additional, Löbel, Lea-Maria, additional, Lutscher, Philipp, additional, Mader, Matthias, additional, Madia, Joan Eliel, additional, Malancu, Natalia Cornelia, additional, Maldonado, Luis, additional, Marahrens, Helge, additional, Martin, Nicole, additional, Martinez, Paul, additional, Mayerl, Jochen, additional, MAYORGA, OSCAR Jose, additional, McManus, Patricia A., additional, Meeusen, Cecil, additional, Meierrieks, Daniel, additional, Mellon, Jonathan, additional, Merhout, Friedolin, additional, Merk, Samuel, additional, Meyer, Daniel, additional, Micheli, Leticia, additional, Mijs, Jonathan, additional, Moya, Cristóbal, additional, Neunhoeffer, Marcel, additional, Nüst, Daniel, additional, Nygård, Olav, additional, Ochsenfeld, Fabian, additional, Otte, Gunnar, additional, Pechenkina, Anna, additional, Prosser, Christopher, additional, Raes, Louis, additional, Ralston, Kevin, additional, Ramos, Miguel, additional, Roets, Arne, additional, Rogers, Jonathan, additional, Ropers, Guido, additional, Samuel, Robin, additional, Sand, Gergor, additional, Schachter, Ariela, additional, Schaeffer, Merlin, additional, Schieferdecker, David, additional, Schlueter, Elmar, additional, Schmidt, Katja, additional, Schmidt, Regine, additional, Schmidt-Catran, Alexander, additional, Schmiedeberg, Claudia, additional, Schneider, Jürgen, additional, Schoonvelde, Martijn, additional, Schulte-Cloos, Julia, additional, Schumann, Sandy, additional, Schunck, Reinhard, additional, Schupp, Juergen, additional, Seuring, Julian, additional, Silber, Henning, additional, Sleegers, Willem W. A., additional, Sonntag, Nico, additional, Staudt, Alexander, additional, Steiber, Nadia, additional, Steiner, Nils, additional, Sternberg, Sebastian, additional, Stiers, Dieter, additional, Striessnig, Erich, additional, Stojmenovska, Dragana, additional, Storz, Nora, additional, Stroppe, Anne-Kathrin, additional, Teltemann, Janna, additional, Tibajev, Andrey, additional, Tung, Brian B., additional, Vagni, Giacomo, additional, Van Assche, Jasper, additional, van der Linden, Meta, additional, van der Noll, Jolanda, additional, Van Hootegem, Arno, additional, Vogtenhuber, Stefan, additional, Voicu, Bogdan, additional, Wagemans, Fieke Maria Antoinet, additional, Wagner, Kyle, additional, Wehl, Nadja, additional, Werner, Hannah, additional, Wiernik, Brenton M., additional, Winter, Fabian, additional, Wolf, Christof, additional, Yamada, Yuki, additional, Zakula, Björn, additional, Ziller, Conrad, additional, Zins, Stefan, additional, Zhang, Nan, additional, Żółtak, Tomasz, additional, and Nguyen, Hung Hoang Viet, additional

Published
2019
Full Text
View/download PDF

48. Are incentive effects on response rates and nonresponse bias in large-scale, face-to-face surveys generalizable to Germany? Evidence from ten experiments

Author

Pforr, Klaus, Blohm, Michael, Blom, Annelies G., Erdel, Barbara, Felderer, Barbara, Fräßdorf, Anna, Hajek, Kristin, Helmschrott, Susanne, Kleinert, Corinna, Koch, Achim, Krieger, Ulrich, Kroh, Martin, Martin, Silke, Saßenroth, Denise, Schmiedeberg, Claudia, Trüdinger, Eva-Maria, Rammstedt, Beatrice, Pforr, Klaus, Blohm, Michael, Blom, Annelies G., Erdel, Barbara, Felderer, Barbara, Fräßdorf, Anna, Hajek, Kristin, Helmschrott, Susanne, Kleinert, Corinna, Koch, Achim, Krieger, Ulrich, Kroh, Martin, Martin, Silke, Saßenroth, Denise, Schmiedeberg, Claudia, Trüdinger, Eva-Maria, and Rammstedt, Beatrice

Abstract

In survey research, a consensus has grown regarding the effectiveness of incentives encouraging survey participation across different survey modes and target populations. Most of this research has been based on surveys from the United States, whereas few studies have provided evidence that these results can be generalized to other contexts. This paper is the first to present comprehensive information concerning the effects of incentives on response rates and nonresponse bias across large-scale surveys in Germany. The context could be viewed as a critical test for incentive effects because Germany’s population is among the most survey-critical in the world, with very low response rates. Our results suggest positive incentive effects on response rates and patterns of effects that are similar to those in previous research: The effect increased with the monetary value of the incentive; cash incentives affected response propensity more strongly than lottery tickets do; and prepaid incentives could be more cost effective than conditional incentives. We found mixed results for the effects of incentives on nonresponse bias. Regarding large-scale panel surveys, we could not unequivocally confirm that incentives increased response rates in later panel waves.

Published
2018

49. The effect of interviewers' motivation and attitudes on respondents' consent to contact secondary respondents in a multi-actor design

Author

Schröder, Jette, Schmiedeberg, Claudia, and Laura Castiglioni

Subjects
Erhebungstechniken und Analysetechniken der Sozialwissenschaften, Sozialwissenschaften, Soziologie, Forschungsreaktivität, intrinsische Motivation, longitudinal study, Umfrageforschung, Mehrebenenanalyse, labor, reactivity effect, Antwortverhalten, Längsschnittuntersuchung, multi-level analysis, data capture, Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods, motivation, PAIRFAM, survey research, ddc:300, response behavior, Interview, Datengewinnung, Social sciences, sociology, anthropology, intrinsic motivation, panel, Arbeit
Abstract

In surveys using a multi-actor design, data is collected not only from sampled ‘primary’ respondents, but also from related persons such as partners, colleagues, or friends. For this purpose, primary respondents are asked for their consent to survey such ‘secondary’ respondents. The existence of interviewer effects on unit nonresponse of sampled respondents in surveys is well documented, and research increasingly focuses on interviewer attributes in the non-response process. However, research regarding interviewer effects on unit nonresponse of secondary respondents, more specifically, primary respondents’ consent to include secondary respondents into the survey, is sparse. We use the German Family Panel (pairfam) and an interviewer survey conducted during the fifth wave of the panel (2012) to investigate the effects of interviewer motivation and attitudes on respondents’ consent to a survey of their parents via a separate mail questionnaire. Using multi-level models, we find a substantial interviewer effect on consent rates when not controlling for interviewer characteristics. In a second step, we include variables which capture interviewers’ work motivation and attitudes. Our results show that being motivated for the job as an interviewer by interest in the work itself as well as attitudes towards persuading respondents are both associated with interviewers’ success in obtaining respondent consent to a parent survey. However, interviewer characteristics (including motivation and attitudes) are only able to explain a small part of the interviewer effect.

Published
2016

50. Collecting event history data with a panel survey: combining an electronic event history calendar and dependent interviewing

Author

Brüderl, Josef, Castiglioni, Laura, Ludwig, Volker, Pforr, Klaus, Schmiedeberg, Claudia, Brüderl, Josef, Castiglioni, Laura, Ludwig, Volker, Pforr, Klaus, and Schmiedeberg, Claudia

Abstract

"Many panel surveys collect event history data on events occurring between two waves. This is usually done by asking lists of questions on the various changes that took place between interviews (Q-Lists). Recently, some panel surveys introduced a different data collection method: the Event History Calendar (EHC), credited for collecting more accurate data. However, even the use of an EHC cannot prevent the issue that events tend to be reported spuriously at the seam of consecutive waves (seam effect). On the other hand, research has shown that dependent interviewing (DI) can help reduce this seam effect. Thus, the combination of EHC and DI (DI-EHC) promises to provide more accurate event history data that are not plagued by a seam effect. The German Family Panel pairfam was one of the first panel studies to use DI-EHC. In this article we first report on the practical aspects and the pros and cons of DI-EHC. Further, we report the results of an experiment in which we test whether DI-EHC reduces the seam effect. In sum our practical experiences and the results of our experiment indicate that the instrument is less burdensome than traditional Q-Lists and produces more accurate data. In particular, DI-EHC reduces the seam effect significantly." (author's abstract)

Published
2017

Catalog

Books, media, physical & digital resources
See catalog results