Search

Disengaged item responses pose a threat to the validity of the results provided by large-scale assessments. Several procedures for identifying disengaged responses on the basis of observed response times have been suggested, and item response theory (IRT) models for response engagement have been proposed. We outline that response time-based procedures for classifying response engagement and IRT models for response engagement are based on common ideas, and we propose the distinction between independent and dependent latent class IRT models. In all IRT models considered, response engagement is represented by an item-level latent class variable, but the models assume that response times either reflect or predict engagement. We summarize existing IRT models that belong to each group and extend them to increase their flexibility. Furthermore, we propose a flexible multilevel mixture IRT framework in which all IRT models can be estimated by means of marginal maximum likelihood. The framework is based on the widespread Mplus software, thereby making the procedure accessible to a broad audience. The procedures are illustrated on the basis of publicly available large-scale data. Our results show that the different IRT models for response engagement provided slightly different adjustments of item parameters of individuals' proficiency estimates relative to a conventional IRT model. [ABSTRACT FROM AUTHOR]

The current study is concerned with the stability of and changes in vocational interest profiles and interest congruence in vocational education and training (VET). Specifically, we examined (1) the stability of vocational interest profiles, (2) the existence of occupational socialization effects that manifest themselves as increases in person-environment (P-E) congruence, and (3) the question of whether or not changes in P-E congruence are psychologically relevant because they are related to trainees' attitudes towards their VET course. We used data from a three-wave longitudinal sample comprising N = 2611 trainees from five different VET courses in Germany. Through the use of meta-analytical aggregation techniques, we were able to analyze interindividual differences in intraindividual interest stability and P-E congruence and to relate these differences to trainees' satisfaction with VET. On average, interest profiles turned out to be highly stable over the entire course of VET. However, we found substantial interindividual and intergroup differences in interest stability. Average P-E congruence increased slightly in two groups, providing only little evidence for the presumed socialization effects. Nevertheless, interindividual differences in P-E congruence and changes in P-E congruence were psychologically relevant because they were linked to trainees' satisfaction with their VET course and changes therein. [ABSTRACT FROM AUTHOR]

Tests administered in studies of student achievement often have a certain amount of not-reached items (NRIs). The propensity for NRIs may depend on the proficiency measured by the test and on additional covariates. This article proposes a semiparametric model to study such relationships. Our model extends Glas and Pimentel's item response theory model for NRIs by (1) including a semiparametric representation of the distribution of the onset of NRIs, (2) modeling the relationships of NRIs with proficiency via a flexible multinomial logit regression, and (3) including additional covariates to predict NRIs. We show that Glas and Pimentel's and our model have close connections to event history analysis, thereby making it possible to apply tools developed in this context to the analysis of NRIs. Our model was applied to a timed low-stakes test of mathematics achievement. Our model fitted the data better than Glas and Pimentel's model, and allowed for a more fine-grained assessment of the onset of NRIs. The results of a simulation study showed that our model accurately recovered the relationships of proficiency and covariates with the onset of NRIs, and reduced bias in the estimates of item parameters, proficiency distributions, and covariate effects on proficiency. [ABSTRACT FROM AUTHOR]

The constructs grit and conscientiousness are closely connected. However, this relationship has not been analysed while accounting for the complex structure of conscientiousness and the multifaceted conception of grit (perseverance of effort; consistency of interest). In this study, we analysed the connection while considering the hierarchical structure of conscientiousness, differentiating between a superordinate factor, a first‐level common factor (industriousness), and lower level unique factors. Drawing on two samples (N = 413, Mage = 15.29, and N = 530, Mage = 31.75), we applied an extension procedure for confirmatory factor analysis that enables a simultaneous investigation of the relationships on all levels. The perseverance facet of grit was tightly aligned to the common factors (95% shared variance) and was strongly related to the industriousness factor. Consistency shared less variance with the common factors of conscientiousness (53%), but it was additionally correlated with the self‐discipline facet. The results for the global grit scale were most similar to the results for perseverance. Grit appears to be a construct that combines the superordinate and industrious aspects of conscientiousness and shares the unique aspect of the self‐discipline facet; this suggests that grit and its facets can be fully integrated into the hierarchical structure of conscientiousness. [ABSTRACT FROM AUTHOR]

The aim of the present investigation is to examine key aspects regarding the validity of the spherical model of vocational interests in Germany, namely, its structural validity, its convergent validity—with an instrument assessing vocational interests according to the RIASEC (R—Realistic, I—Investigative, A—Artistic, S—Social, E—Enterprising, and C—Conventional) model—and its construct validity regarding the pattern of gender differences. To this end, the Personal Globe Inventory (PGI) was translated and completed by a sample of German university students. Results of randomization tests of hypothesized order relations provided support for the structural validity of the instrument in female and male university students. Principal components analyses with target rotations identified two particular scales as outliers. RIASEC scores derived from the PGI correlated strongly with corresponding scales of another instrument, and gender differences were in line with previous findings reported in the literature. Overall, our results provide evidence for the validity of the spherical model in German university students. [ABSTRACT FROM AUTHOR]

This study examines the validity of the three-factor model of person–environment (P-E) fit perceptions in a sample of German university students (N = 326) and examines the connection between these fit types, the Big Five personality traits, and markers of academic success, namely, academic satisfaction, academic performance, and major change intention. Building upon previous research, a three-factor model of P-E fit perceptions with complex loadings was hypothesized differentiating between interest-major (I-M) fit, needs-supplies (N-S) fit, and demands-abilities (D-A) fit. Results from confirmatory factor analyses supported the suggested three-factor solution. Zero-order correlations, multiple regression analyses, and relative weight analyses identified perceived I-M fit as the key predictor of academic satisfaction and major change intention. D-A fit was the strongest predictor of academic performance. Finally, a hierarchical regression approach revealed that personality traits did not improve the prediction of any outcome over perceived P-E fit. [ABSTRACT FROM AUTHOR]

This study examines the relationships of vocational interests and mathematical literacy both cross-sectionally and longitudinally. Extending previous research, the results of Holland's RIASEC (Realistic, Investigative, Artistic, Social, Enterprising, and Conventional) scale scores are compared with results from a reductionist approach using individual interest profiles (including the parameters level, differentiation, and orientation). Both analyses find significant relations between interests and mathematical literacy. The scale score analyses reveal positive associations of Realistic interests with mathematical literacy, whereas Artistic interests show a negative association. Interest profiles from a dimensional representation show individuals with interest orientations close to the Realistic domain score highest on mathematical literacy, with those with interests in both Artistic and Social domains scoring lowest. Results from profile analyses suggest that interest differentiation moderates the interest-ability relation. Only interest profiles are predictive for mathematical literacy over and above covariates, indicating that interest profiles are more robust predictors than the scale scores. Analyses show that interest profiles are a valid reduction of the scale score models. [ABSTRACT FROM AUTHOR]