Search

Registered reports engender a review process in which reviewers evaluate the merits of the research question rather than the magnitude or direction of the results. In this process, authors first submit introduction, methods, and prespecified analyses sections of an article. Next, an initial peer-review process assesses the merits of the research question, in the absence of knowing the results. Worthy articles are granted an "in-principle acceptance." The authors, then conduct their study, analyze their data, write up the remainder of their article, and resubmit it. The in-principle acceptance means that if the authors adhere to the research design as originally submitted, then the article will be accepted. Building from seven of the earliest registered reports in education research, our introduction describes the benefits, opportunities, and challenges of registered reports as a means to increasing transparency in research and reducing the number of illusory results.

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.

To investigate the effect of innovations in the teaching-learning environment, researchers often compare study results from different cohorts across years. However, variance in scores can be attributed to both random fluctuation and systematic changes due to the innovation, complicating cohort comparisons. In the present study, we illustrate how using information about the variation in course grades over time can help researchers and practitioners better compare the grades and pass rates of different cohorts of students. To this end, all 375,093 grades from all 40,087 first-year students at a Dutch university during a period of six consecutive years were examined. Overall, about 17% of the variation in grades could be attributed to random variation between years and courses. With respect to passing courses, this percentage was almost 40%. Nonsignificant improvements in grades could be flagged as highly significant when this is ignored, thus leading to an overrepresentation of significant effects in educational literature. As a consequence, too many educational innovations are claimed to be effective.

The flipped classroom is becoming more popular as a means to support student learning in higher education by requiring students to prepare before lectures and actively engaging students during lectures. While some research has been conducted into student performance in the flipped classroom, students' study behaviour throughout a flipped course has not been investigated. This study explored students' study behaviour throughout a flipped and a regular course by means of bi-weekly diaries. Furthermore, student references to their learning regulation were explored in course evaluations. Results from the diaries showed that students' study behaviour in the flipped course did not appear to be very different from that of students in a regular course. Furthermore, study behaviour did not appear strongly related to student performance in both the flipped and the regular course. Exploration of student references to their learning regulation in the course evaluations showed that some students experienced the flipped course design as intended to support their learning process. Other students, however, demonstrated resistance to changing their study behaviour even though changing study behaviour is expected in order to benefit from the flipped classroom. Further research on the relationship between students' learning regulation and actual study behaviour and course results is necessary to understand when and why implementing the flipped classroom is successful. Recommendations that may help more effective flipped classroom implementation include considering the prior history between students and instructor(s), the broader curriculum context, and frequent expectation communication especially with large numbers of students and non-mandatory lecture attendance.

Based on Marcia's theory, many researchers consider exploration and commitment as the main processes in identity development. Although some identity theorists have hypothesized that emotional experience may also be an important part of the mechanisms of identity development, empirical research to investigate this claim has been lagging behind. In this study, we shed light on the role of emotional experiences in micro-level commitment dynamics, and compare this to the role of exploration. We take a within-individual approach, and particularly focus on educational commitment. We collected weekly measurements among 103 first year university students over several months, resulting in 22 to 30 measurements for each individual. Every week, the students reported an important experience and accompanying positive and negative emotions, their level of educational exploration and commitment. We generated linear growth models for each individual separately, using Dynamic Linear Modeling. These individual models generate regression weights that indicate how strong the impact is of exploration, positive and negative emotional experiences on changes in micro-level commitment for each individual. Our main finding is that both positive and negative emotional experiences are indeed related to changes in educational commitment. Positive experiences, but surprisingly, also negative experiences, are related to increases in educational commitment for the majority of individuals. Moreover, for the large majority of individuals, the impact of emotional experiences is larger than the impact of exploration. Therefore, we conclude that it is highly likely that emotional experiences are an essential part of the micro-level mechanisms of identity development.

With the rising popularity of intensive longitudinal research, the modeling techniques for such data are increasingly focused on individual differences. Here we present mixture multilevel vector-autoregressive modeling, which extends multilevel vector-autoregressive modeling by including a mixture, to identify individuals with similar traits and dynamic processes. This exploratory model identifies mixture components, where each component refers to individuals with similarities in means (expressing traits), autoregressions, and cross-regressions (expressing dynamics), while allowing for some interindividual differences in these attributes. Key issues in modeling are discussed, where the issue of centering predictors is examined in a small simulation study. The proposed model is validated in a simulation study and used to analyze the affective data from the COGITO study. These data consist of samples for two different age groups of over 100 individuals each whowere measured for about 100 days. We demonstrate the advantage of exploratory identifying mixture components by analyzing these heterogeneous samples jointly. The model identifies three distinct components, and we provide an interpretation for each component motivated by developmental psychology. In psychological research, individuals are sometimes assessed repeatedly on certain attributes, for example indicating their mood, for an extended period of time. Researchers are then interested to describe the between-individual differences that are present in the resulting intensive longitudinal data. In order to describe these differences, we propose the novel mixture multilevel vector-autoregressive model. This model identifies subgroups of individuals with similar traits and dynamic processes, while also allowing for between-individual differences in these attributes within the different subgroups. We illustrate the model in an application to emotion dynamics data. The sample consists of individuals from two different age groups. Using our mixture multilevel vector-autoregressive model, we describe the between-individual differences that are present in the emotion dynamics of this sample. We do so by describing the more homogeneous subgroups that were identified by our model, and by describing the between-individual differences within the different subgroups. [ABSTRACT FROM AUTHOR]

Measurement error is an inherent part of any test score. This uncertainty is generally communicated in ways that can be difficult to understand for clinical practitioners. In this empirical study, we evaluate the impact of several communication formats on the interpretation of measurement accuracy and its influence on the decision-making process in clinical practice. We provided 230 clinical practitioners with score reports in five formats: textual, error bar, violin plot, diamond plot, and quantile dot plot. We found that quantile dot plots significantly increased accuracy in the assessment of measurement uncertainty compared with other formats. However, a direct relation between visualization format and decision quality could not be found. Although traditional confidence intervals and error bars were favored by many participants due to their familiarity, responses revealed several misconceptions that make the suitability of these formats for communicating uncertainty questionable. Our results indicate that new visualization formats can successfully reduce errors in interpretation. [ABSTRACT FROM AUTHOR]

Background Dissociative experiences commonly occur in schizophrenia spectrum disorders (SSD). Yet little is known about how dissociative experiences in SSD are related to SSD symptoms. Accordingly, we investigated the relations between dissociative experiences and SSD symptoms, focusing on symptoms bridging these 2 symptom clusters as well as their relation to reported trauma history. Study Design Network analyses were conducted on the responses of 248 individuals with an SSD who enrolled from multiple mental health centers in The Netherlands. Dissociative experiences were assessed via the Dissociative Experience Scale, SSD symptoms using the Positive and Negative Syndrome Scale, and trauma history through the Trauma History Questionnaire. Study Results The results indicated that dissociative symptoms in SSD are mostly independent of other symptoms, but that emotional distress bridges between the dissociative and SSD symptom clusters. Furthermore, results revealed associations between positive and negative SSD symptoms and trauma through emotional distress, whereas dissociative symptoms remained relatively isolated. Conclusion Because SSD symptoms and dissociative experiences clustered relatively independent from each other, our findings promote the idea of tailored treatment approaches for individuals with an SSD with frequent dissociative experiences, specifically targeting these symptoms. [ABSTRACT FROM AUTHOR]