1. Publishing Visualization Studies as Registered Reports: Expected Benefits and Researchers' Attitudes
- Author
-
Yvonne Jansen, Petra Isenberg, Pierre Dragicevic, Anastasia Bezerianos, Lonni Besançon, Monash University [Melbourne], Linköpings universitet, Interacting with Large Data (ILDA), Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Institut National de Recherche en Informatique et en Automatique (Inria)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS), Analysis and Visualization (AVIZ), Popular interaction with 3d content (Potioc), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Institut des Systèmes Intelligents et de Robotique (ISIR), Sorbonne Université (SU)-Centre National de la Recherche Scientifique (CNRS), CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Interaction avec l'Humain (IaH), and CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
- Subjects
Medical education ,Publishing ,business.industry ,Research quality ,[INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC] ,business ,Psychology ,Visualization - Abstract
Background: Registered Reports are publications in which study proposals are peer reviewed and pre-accepted before the study is ran. Their adoption in other disciplines has been found to promote research quality and save time and resources. Objectives: We offer a brief introduction to Registered Reports and their expected benefits for visualization research. We then report a survey of the visualization community on their attitudes towards Registered Reports. This survey takes the form of a quasi Registered Report, the first one presented at a visualization venue as far as we know.Method: We will run an online survey that will be open from the end of August until the day of the alt.VIS workshop.Results: Most respondents expressed interest in Registered Reports as an additional submission format. Junior researchers as well as researchers with prior experience of preregistration tended to be more inclined to adopt this format. However, qualitative feedback highlights several perceived drawbacks and worries about Registered Reports, such as low suitability for some types of research, and increased workload for reviewers and authors.Conclusion: While many respondents expressed interest in (and sometimes enthusiasm for) Registered Reports, many also voiced concerns that should be considered and discussed in the community.Reproducibility: All the material is available on osf.io/4nrma/.
- Published
- 2021