Search

This study explores the usefulness of covariates on equating test scores from nonequivalent test groups. The covariates are captured by an estimated propensity score, which is used as a proxy for latent ability to balance the test groups. The objective is to assess the sensitivity of the equated scores to various misspecifications in the propensity score model. The study assumes a parametric form of the propensity score and evaluates the effects of various misspecification scenarios on equating error. The results, based on both simulated and real testing data, show that (1) omitting an important covariate leads to biased estimates of the equated scores, (2) misspecifying a nonlinear relationship between the covariates and test scores increases the equating standard error in the tails of the score distributions, and (3) the equating estimators are robust against omitting a second-order term as well as using an incorrect link function in the propensity score estimation model. The findings demonstrate that auxiliary information is beneficial for test score equating in complex settings. However, it also sheds light on the challenge of making fair comparisons between nonequivalent test groups in the absence of common items. The study identifies scenarios, where equating performance is acceptable and problematic, provides practical guidelines, and identifies areas for further investigation.

The overall aim was to examine the equated values when using different linkage plans and different observed-score equipercentile equating methods with the equivalent groups (EG) design and the nonequivalent groups with anchor test (NEAT) design. Both real data from a college admissions test and simulated data were used with frequency estimation, chained equating, and kernel equating methods. The overall results were that different linkage plans gave different equated values and standard errors (SEs) both in the EG design and in the NEAT design, and there were some differences between the equating methods. The simulation study confirmed the empirical results and suggested that the kernel equating methods gave lower SEs in the examined conditions and had fewer differences that mattered compared with traditional equating methods when different linking plans were used. Finally, when one of the test forms was easier or if the ability of the test groups differed, the choice of linkage plan had more of an impact than when the test forms or test groups were more similar.

The aim of this paper is to describe, analyze, and discuss how Swedish schools and the national tests in schools, university teaching and examination, and the college admissions test, Swedish Scholastic Aptitude Test (SweSAT), have been affected by the COVID-19 situation. A further aim is to discuss the challenges in schools, universities and in the admissions test process in Sweden which are due to the COVID-19 situation. Contrary to many other countries, Swedish schools remained open, except for upper secondary school and universities where teaching went online. However, the spring administrations of the national tests and the high-stake college admission test, SweSAT, were cancelled, which had impact on admissions to universities in the fall. By using documentation from the news, school, and university authorities, as well as governmental reports of the events and a student survey, challenges are discussed. The novelty of this study includes a discussion of the events and their upcoming challenges. A discussion of what could be learned and what to expect in the close future is included, as well as conclusions which can be drawn from this situation.

The overall aim of this study was to examine the different self-reported students' socioeconomic status (SES) measures in the Trends in Mathematics and Science Study (TIMSS) in comparison to national SES measures obtained from Swedish official registers. A further aim was to determine if the same conclusions could be drawn if different student measures were used to define SES when modelling the students' TIMSS mathematics achievement. The overall results showed that the choice of SES measures matters. The home educational resource index and books at home from the TIMSS data base were good indicators of SES. We conclude that when one has access to SES information from official registers it is recommended to use it because these measures have less missing information compared with the TIMSS variables.

Research has recently demonstrated the use of multiple anchor tests and external covariates to supplement or substitute for common anchor items when linking and equating with nonequivalent groups. This study examines the conditions under which external covariates improve linking and equating accuracy, with internal and external anchor tests of varying lengths and groups of differing abilities. Pseudo forms of a state science test were equated within a resampling study where sample size ranged from 1,000 to 10,000 examinees and anchor tests ranged in length from eight to 20 items, with reading and math scores included as covariates. Frequency estimation linking with an anchor test and external covariate was found to produce the most accurate results under the majority of conditions studied. Practical applications of linking with anchor tests and covariates are discussed.

While well-being does generally constitute a moderate predictor of school achievement, research on the predictive validity of cognitive ability for wellbeing in school contexts remains scant. The current study analyzed longitudinal relations between cognitive ability measured at age 13 (Grade 6) and wellbeing measured at age 18 (Grade 12, valid N = 2,705) in a Swedish sample, using several multivariate model techniques. The results indicate that cognitive ability was not a statistically significant predictor when several predictors were entered in a multiple regression model. However, gender was a significant covariate as girls and young women have a substantially lower degree of self-reported well-being. This casts light on the limitations of cognitive ability as a construct for some non-cognitive outcomes, at least in shorter and narrower spatial-temporal contexts. [ABSTRACT FROM AUTHOR]

Item response theory (IRT) models the relationship between the possible scores on a test item against a test taker's attainment of the latent trait that the item is intended to measure. In this study, we compare two models for tests with polytomously scored items: the optimal scoring (OS) model, a nonparametric IRT model based on the principles of information theory, and the generalized partial credit (GPC) model, a widely used parametric alternative. We evaluate these models using both simulated and real test data. In the real data examples, the OS model demonstrates superior model fit compared to the GPC model across all analyzed datasets. In our simulation study, the OS model outperforms the GPC model in terms of bias, but at the cost of larger standard errors for the probabilities along the estimated item response functions. Furthermore, we illustrate how surprisal arc length, an IRT scale invariant measure of ability with metric properties, can be used to put scores from vastly different types of IRT models on a common scale. We also demonstrate how arc length can be a viable alternative to sum scores for scoring test takers. [ABSTRACT FROM AUTHOR]

Ramsay and Wiberg used a new version of item response theory that represents test performance over nonnegative closed intervals such as [0, 100] or [0, n] and demonstrated that optimal scoring of binary test data yielded substantial improvements in point-wise root-mean-squared error and bias over number right or sum scoring. We extend these results by showing that optimal scoring of the full information in option choices produces about as much further improvement in these measures of score performance as was achieved by going from sum scoring to optimal binary scoring.

When equating two test forms, the equated scores will be biased if the test groups differ in ability. To adjust for the ability imbalance between nonequivalent groups, a set of common items is often used. When no common items are available, it has been suggested to use covariates correlated with the test scores instead. In this article, we reduce the covariates to a propensity score and equate the test forms with respect to this score. The propensity score is incorporated within the kernel equating framework using poststratification and chained equating. The methods are evaluated using real college admissions test data and through a simulation study. The results show that propensity scores give an increased equating precision in comparison with the equivalent groups design and a smaller mean squared error than by using the covariates directly. Practical implications are also discussed.

The aim of this study was to examine the association between students' TIMSS (Trends in Mathematics and Science Study) science achievement, and students' school achievements, in terms of national tests and grades from school years 6 and 9. Further to examine the association with TIMSS science achievement and different subgroups of students based on their home background. The study is based on a unique possibility to analyse TIMSS 2015 data together with register data of the Swedish students' national test results from school years 6 and 9 and their science subject grades from school years 6 and 9. The overall results show that there were moderate associations between TIMSS science achievement and school achievement measures. The association between grades and the high-stakes national tests were stronger than between grades and TIMSS. The students' home background had a clear impact on the results as students with highly educated mothers, who comes from homes with many books and are nonimmigrants had on average higher TIMSS science achievements.

The aim of this paper was to examine the relationship between Trends in Mathematics and Science Study (TIMSS) mathematics achievement and the two school achievement measures of grades and national test results in Sweden. A further aim was to examine the association of TIMSS mathematics achievement with different subgroups of students. The results show that there is a strong positive relationship between TIMSS mathematics achievement and national tests and obtained grades from both grade 6 and grade 9. Students from more educated homes performed better overall on TIMSS than those from less-educated homes, and the relationships between TIMSS and the school achievement measures were stronger for students from more educated home backgrounds. The school context and the students' background had an impact on the students' TIMSS result. The results have implications for how one should view the results from TIMSS as a measure of student mathematics achievement and thus how TIMSS results can be used in a national context.

Compassion-focused interventions for young people have started to emerge to treat depressive symptoms, and reliable and valid measures of the construct "self-compassion" is needed for this age-group in Swedish. This study aims to validate the Swedish translation of the Self-Compassion Scale for Youth (SCS-Y). Self-report questionnaires were collected from students (N = 316) aged 15–20 recruited from schools in Sweden, in a cross-sectional design. Confirmatory factor analyses, internal consistency, test-retest reliability, measurement invariance and convergent and divergent validity were calculated. A model with one general bi-factor and six specific factors had the best fit and confirmed the factor structure of SCS-Y. Internal consistencies were good, except for the subscale mindfulness for boys which was questionable. Three-week test-retest reliability was good. We found measurement invariance for age and no equivalence for sex. Evidence was found for convergent and divergent validity using correlations. Sex differences were found: girls scored higher on self-judgement, feelings of isolation and showed more over-identification, than boys. The Swedish version of SCS-Y (SCS-Y-SE) is a reliable and valid self-report questionnaire, with some limitations, to assess self-compassion in clinical practice and research. What is already known about this topic: Compassion-focused interventions can potentially help young people overcome self-criticism and poor psychological health. Reliable and valid self-report questionnaires for compassion focused interventions are needed in Swedish. Self-Compassion Scale for Youths (SCS-Y) is a short, age-appropriate, valid and reliable instrument for adolescents in US populations. What this topic adds: We translated and adapted the SCS-Y to Swedish (SCS-Y-SE) and tested it in a school sample. The factor structure of SCS-Y-SE was established by confirmatory factor analyses, three-week test-retest reliability was good, and convergent and divergent validity were good. SCS-Y-SE can be considered a reliable and valid Swedish questionnaire for self-compassion in the age-range 15–20 years. [ABSTRACT FROM AUTHOR]