Search

Psychometric modeling has become a frequently used statistical tool in research on scientific reasoning. We review psychometric modeling practices in this field, including model choice, model testing, and researchers' inferences based on their psychometric practices. A review of 11 empirical research studies reveals that the predominant psychometric approach is Rasch modeling with a focus on itemfit statistics, applied in a way strongly similar to practices in national and international large-scale educational assessment programs. This approach is common in the educational assessment community and rooted in subtle philosophical views on measurement. However, we find that based on this approach, researchers tend to draw interpretations that are not within the inferential domain of this specific approach and not in accordance with the related practices and inferential purposes. In some of the reviewed articles, researchers put emphasis on item infit statistics for dimensionality assessment. Item infit statistics, however, cannot be regarded as a valid indicator of the dimensionality of scientific reasoning. Using simulations as illustration, we argue that this practice is limited in delivering psychological insights; in fact, various recent inferences about the structure, cognitive basis, and correlates of scientific reasoning might be unwarranted. In order to harness its full potential, we make suggestions towards adjusting psychometric modeling practices to the psychological and educational questions at hand.

People’s beliefs about everyday events are both of theoreti-cal interest in their own right and an important ingredient inmodel building—especially in Bayesian cognitive models ofphenomena such as logical reasoning, future predictions, andlanguage use. Here, we explore several recently used methodsfor measuring subjective beliefs about unidimensional contigu-ous properties, such as the likely price of a new watch. Asa first step towards a way of assessing and comparing beliefelicitation methods, we use hierarchical Bayesian modeling forinferring likely population-level beliefs as the central tendencyof participants’ individual-level beliefs. Three different depen-dent measures are considered: (i) slider ratings of (relative)likelihood of intervals of values, (ii) a give-a-number task, and(iii) choice of the more likely of two intervals of values. Ourresults suggest that using averaged normalized slider ratingsfor binned quantities is a practical and fairly good approxima-tor of inferred population-level beliefs.

Many real-world systems can exhibit tipping points and multiple stable states, creating the potential for sudden and difficult to reverse transitions into a less desirable regime. The theory of dynamical systems points to the existence of generic early warning signals that may precede these so-called critical transitions. Recently, psychologists have begun to conceptualize mental disorders such as depression as an alternative stable state, and suggested that early warning signals based on the phenomenon of critical slowing down might be useful for predicting transitions into depression and other psychiatric disorders. Harnessing the potential of early warning signals requires us to understand their limitations as well as the factors influencing their performance in practice. In this article, we (a) review limitations of early warning signals based on critical slowing down to better understand when they can and cannot occur, and (b) study the conditions under which early warning signals may anticipate critical transitions in online-monitoring settings by simulating from a bistable dynamical system, varying crucial features such as sampling frequency, noise intensity, and speed of approaching the tipping point. We find that, in sharp contrast to their reputation of being generic or model-agnostic, whether early warning signals occur or not strongly depends on the specifics of the system. We also find that they are very sensitive to noise, potentially limiting their utility in practical applications. We discuss the implications of our findings and provide suggestions and recommendations for future research. [ABSTRACT FROM AUTHOR]

Researchers are often interested in comparing statistical network models estimated from groups that are defined by the sum-score of the modeled variables. A prominent example is an analysis that compares networks of individuals with and without a diagnosis of a certain disorder. Recently, several authors suggested that this practice may lead to invalid inferences by introducing Berkson's bias. In this article, we show that whether bias is present or not depends on which research question one aims to answer. We review five possible research questions one may have in mind when separately estimating network models in groups that are based on sum-scores. For each research question, we provide an illustration with a simulated bivariate example and discuss the nature of the bias, if present. We show that if one is indeed interested in the network models of the groups defined by the sum-score, no bias is introduced. However, if one is interested in differences across groups defined by a variable other than the sum-score, detecting population heterogeneity, the network model in the general population, or inferring causal relations, then bias will be introduced in most situations. Finally, we discuss for each research question how bias can be avoided. [ABSTRACT FROM AUTHOR]

Testing the equality of two proportions is a common procedure in science, especially in medicine and public health. In these domains, it is crucial to be able to quantify evidence for the absence of a treatment effect. Bayesian hypothesis testing by means of the Bayes factor provides one avenue to do so, requiring the specification of prior distributions for parameters. The most popular analysis approach views the comparison of proportions from a contingency table perspective, assigning prior distributions directly to the two proportions. Another, less popular approach views the problem from a logistic regression perspective, assigning prior distributions to logit‐transformed parameters. Reanalyzing 39 null results from the New England Journal of Medicine with both approaches, we find that they can lead to markedly different conclusions, especially when the observed proportions are at the extremes (ie, very low or very high). We explain these stark differences and provide recommendations for researchers interested in testing the equality of two proportions and users of Bayes factors more generally. The test that assigns prior distributions to logit‐transformed parameters creates prior dependence between the two proportions and yields weaker evidence when the observations are at the extremes. When comparing two proportions, we argue that this test should become the new default. [ABSTRACT FROM AUTHOR]

Early warning indicators based on critical slowing down have been suggested as a model-independent and low-cost tool to anticipate the (re)emergence of infectious diseases. We studied whether such indicators could reliably have anticipated the second COVID-19 wave in European countries. Contrary to theoretical predictions, we found that characteristic early warning indicators generally decreased rather than increased prior to the second wave. A model explains this unexpected finding as a result of transient dynamics and the multiple timescales of relaxation during a nonstationary epidemic. Particularly, if an epidemic that seems initially contained after a first wave does not fully settle to its new quasi-equilibrium prior to changing circumstances or conditions that force a second wave, then indicators will show a decreasing rather than an increasing trend as a result of the persistent transient trajectory of the first wave. Our simulations show that this lack of timescale separation was to be expected during the second European epidemic wave of COVID-19. Overall, our results emphasize that the theory of critical slowing down applies only when the external forcing of the system across a critical point is slow relative to the internal system dynamics. [ABSTRACT FROM AUTHOR]

Interdisciplinary research is essential for the study of complex systems, and so there is a growing need to understand the factors that facilitate collaboration across diverse fields of inquiry. In this exploratory study, we examine the composition of self-organized project groups and the structure of collaboration networks at the Santa Fe Institute's Complex Systems Summer School. Using data from all iterations of the summer school from 2005 to 2019, comprising 823 participants and 322 projects, we investigate the factors that contribute to group composition. We first test for homophily with respect to individual-level attributes, finding that group composition is largely consistent with random mixing based on gender, career position, institutional prestige, and country of study. However, we find some evidence of homophilic preference in group composition based on disciplinary background. We then conduct analyses at the level of group projects, finding that project topics from the Social and Behavioral Sciences are over-represented. This could be due to a higher level of baseline interest in, or knowledge of, social and behavioral sciences, or the common application of methods from the natural sciences to problems in the social sciences. Consequently, future research should explore this discrepancy further and examine whether it can be mitigated through policies aimed at making topics in other disciplines more accessible or appealing for collaboration. [ABSTRACT FROM AUTHOR]

Time series of individual subjects have become a common data type in psychological research. The Vector Autoregressive (VAR) model, which predicts each variable by all variables including itself at previous time points, has become a popular modeling choice for these data. However, the number of observations in typical psychological applications is often small, which puts the reliability of VAR coefficients into question. In such situations it is possible that the simpler AR model, which only predicts each variable by itself at previous time points, is more appropriate. Bulteel et al. (2018) used empirical data to investigate in which situations the AR or VAR models are more appropriate and suggest a rule to choose between the two models in practice. We provide an extended analysis of these issues using a simulation study. This allows us to (1) directly investigate the relative performance of AR and VAR models in typical psychological applications, (2) show how the relative performance depends both on n and characteristics of the true model, (3) quantify the uncertainty in selecting between the two models, and (4) assess the relative performance of different model selection strategies. We thereby provide a more complete picture for applied researchers about when the VAR model is appropriate in typical psychological applications, and how to select between AR and VAR models in practice. [ABSTRACT FROM AUTHOR]

We propose to use the squared multiple correlation coefficient as an effect size measure for experimental analysis‐of‐variance designs and to use Bayesian methods to estimate its posterior distribution. We provide the expressions for the squared multiple, semipartial, and partial correlation coefficients corresponding to four commonly used analysis‐of‐variance designs and illustrate our contribution with two worked examples. [ABSTRACT FROM AUTHOR]

Social media is radically altering the human social landscape. Before the internet era, human interaction consisted chiefly of direct and reciprocal contact, yet with the rise of social media, the passive consumption of other users’ information is becoming an increasingly popular pastime. Passive consumption occurs when a user reads the posts of another user without interacting with them in any way. Previous studies suggest that people feel more connected to an artificial person after passively consuming their Facebook posts. This finding could help explain how relationships develop during passive consumption and what motivates this kind of social media use. This protocol proposes two studies that would make both a methodological and a theoretical contribution to the field of social media research. Both studies investigate the influence of passive consumption on changes in interpersonal attraction. The first study tests whether screenshots, which are widely used in present research, can be used as a proxy for real Facebook use. It measures the changes in interpersonal attraction after passive consumption of either a screenshot, an artificial in situ profile, or an acquaintance’s real Facebook profile. The second study relies on traditional theories of relationship formation and motivation to investigate which variables (perceived intimacy, perceived frequency of posts, perceived variety of post topics, attributional confidence, and homophily) moderate the link between interpersonal attraction before and after passive consumption. The results of the first study provide insights into the generalizability of the effect by using different stimuli, while also providing a valuable investigation into a commonly used method in the research field. The results of the second study supplement researchers’ understanding of the pathways linking passive use and interpersonal attraction, giving the field further insight into whether theories about offline relationship formation can be used in an online context. Taken together, this protocol aims to shed light on the intricate relation between passive consumption and interpersonal attraction, and variables moderating this effect. [ABSTRACT FROM AUTHOR]

The pre-registration of research via registered reports is a recent development in the field of psychology. The aim of pre-registration is to encourage research that presents sound hypotheses and methodology (Chambers, 2014) in order to counter undesirable but prevalent research practices such as cherry-picking and p-hacking. In this Letter from the Editors, we wish to echo calls for registered reports and outline how we, the Editors at the Journal of European Psychology Students (JEPS), plan to introduce registered reports for student research. We address the issues necessitating the introduction of registered reports and outline the approach needed for implementing this initiative in a student journal. [ABSTRACT FROM AUTHOR]

The ability to measure emotional states in daily life using mobile devices has led to a surge of exciting new research on the temporal evolution of emotions. However, much of the potential of these data still remains untapped. In this paper, we reanalyze emotion measurements from seven openly available experience sampling methodology studies with a total of 835 individuals to systematically investigate the modality (unimodal, bimodal, and more than two modes) and skewness of within-person emotion measurements. We show that both multimodality and skewness are highly prevalent. In addition, we quantify the heterogeneity across items, individuals, and measurement designs. Our analysis reveals that multimodality is more likely in studies using an analog slider scale than in studies using a Likert scale; negatively valenced items are consistently more skewed than positive valenced items; and longer time series show a higher degree of modality in positive and a higher skew in negative items. We end by discussing the implications of our results for theorizing, measurement, and time series modeling. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Objectives: Despite the paucity of evidence verifying its efficacy and safety, traditional Chinese medicine (TCM) is expanding in popularity and political support. Decisions to include TCM diagnoses in the International Classification of Diseases 11th Revision and campaigns to integrate TCM into national healthcare systems have occurred while public perception and usage of TCM, especially in Europe, remains undetermined. Accordingly, this study investigates TCM's popularity, usage and perceived scientific support, as well as its relationship to homeopathy and vaccinations., Design/setting: We performed a cross-sectional survey of the Austrian population. Participants were either recruited on the street (in-person) or online (web-link) via a popular Austrian newspaper., Participants: 1382 individuals completed our survey. The sample was poststratified according to data derived from Austria's Federal Statistical Office., Outcome Measures: Associations between sociodemographic factors, opinion towards TCM and usage of complementary medicine (CAM) were investigated using a Bayesian graphical model., Results: Within our poststratified sample, TCM was broadly known (89.9% of women, 90.6% of men), with 58.9% of women and 39.5% of men using TCM between 2016 and 2019. Moreover, 66.4% of women and 49.7% of men agreed with TCM being supported by science. We found a positive relationship between perceived scientific support for TCM and trust in TCM-certified medical doctors (ρ=0.59, 95% CI 0.46 to 0.73). Moreover, perceived scientific support for TCM was negatively correlated with proclivity to get vaccinated (ρ=-0.26, 95% CI -0.43 to -0.08). Additionally, our network model yielded associations between TCM-related, homeopathy-related and vaccination-related variables., Conclusions: TCM is widely known within the Austrian general population and used by a substantial proportion. However, a disparity exists between the commonly held public perception that TCM is scientific and findings from evidence-based studies. Emphasis should be placed on supporting the distribution of unbiased, science-driven information., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2023. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

Over the past decade, the idiographic approach has received significant attention in clinical psychology, incentivizing the development of novel approaches to estimate statistical models, such as personalized networks. Although the notion of such networks aligns well with the way clinicians think and reason, there are currently several barriers to implementation that limit their clinical utility. To address these issues, we introduce the Prior Elicitation Module for Idiographic System Estimation (PREMISE), a novel approach that formally integrates case formulations with personalized network estimation via prior elicitation and Bayesian inference. PREMISE tackles current implementation barriers of personalized networks; incorporating clinical information into personalized network estimation systematically allows theoretical and data-driven integration, supporting clinician and patient collaboration when building a dynamic understanding of the patient's psychopathology. To illustrate its potential, we estimate clinically informed networks for a patient suffering from obsessive-compulsive disorder. We discuss open challenges in selecting statistical models for PREMISE, as well as specific future directions for clinical implementation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).