Search

The relationship between students' subject-specific academic self-concept and their academic achievement is one of the most widely researched topics in educational psychology. A large proportion of this research has considered cross-lagged panel models (CLPMs), oftentimes synonymously referred to as reciprocal effects models (REMs), as the gold standard for investigating the causal relationships between the two variables and has reported evidence of a reciprocal relationship between self-concept and achievement. However, more recent methodological research has questioned the plausibility of assumptions that need to be satisfied in order to interpret results from traditional CLPMs causally. In this substantive-methodological synergy, we aimed to contrast traditional and more recently developed methods to investigate reciprocal effects of students' academic self-concept and achievement. Specifically, we compared results from CLPMs, full-forward CLPMs (FF-CLPMs), and random intercept CLPMs (RI-CLPMs) with two weighting approaches developed to study causal effects of continuous treatment variables. To estimate these different models, we used rich longitudinal data of N = 3757 students from lower secondary schools in Germany. Results from CLPMs, FF-CLPMs, and weighting methods supported the reciprocal effects model, particularly when math self-concept and grades were considered. Results from the RI-CLPMs were less consistent. Implications from our study for the interpretation of effects from the different models and methods as well as for school motivation theory are discussed.

Prior research has shown that brief motivation interventions, such as interventions targeting students' perceptions concerning relevance of the learning material, can have long-lasting effects on students' motivation and performance. However, the educational contexts in which these interventions have been implemented have their own motivational affordances, such as the extent to which teachers support students' perceptions of relevance in regular classes. According to the seed-and-soil hypothesis for the effectiveness of psychological interventions, such interventions can be seen like a "seed" that needs to be implemented in a supportive educational context (i.e., the "soil") in order to work. Therefore, in this study we examined the interplay between a one-time relevance intervention implemented in mathematics classrooms and the mathematics teacher's relevance support as perceived by the students before and after the intervention. Data stemmed from a cluster-randomized controlled trial with 79 ninth-grade mathematics classes (N = 1744 students) in which the intervention was implemented by the mathematics teacher or a master's student, both trained for this purpose. Multilevel moderation models showed that both intervention conditions had larger effects when students perceived higher relevance support before or after the intervention, thus providing support for the seed-and-soil hypothesis. Furthermore, multilevel mediation models indicated a positive effect of the teacher condition on perceived relevance support at posttest compared with the control condition, which partly explained the positive effect of this intervention condition on utility value at follow-up. The results shed light on the contexts in which these interventions are most effective and the mechanisms through which they work.

Many students suffer from motivational problems when doing homework. To investigate whether an intervention that effectively promoted value beliefs in mathematics promoted students' homework motivation and behavior, we analyzed data from a cluster randomized controlled study with two classroom-based relevance interventions (writing a text or evaluating quotes from interviews) with 82 classrooms and 1,978 ninth-grade students. Students' math-specific homework motivation and behavior were assessed with homework diaries over a period of 4 weeks after the intervention. Latent growth curve analyses revealed that students in the text condition reported higher triggered interest but also lower homework completion than students in the control condition in the first week after the intervention. Students in the quotations condition reported higher utility of homework for future life, and higher homework effort directly after the intervention. The study highlights the potential of classroom-based relevance interventions to foster homework-specific outcomes, when considering situational, behavior-related measures.

Well-informed decisions on curricular materials can be an efficient way to boost student achievement. Prior studies have employed experimental and quasi-experimental designs to investigate the effects of textbooks on mathematics achievement. This is the first study to consider textbook effects in social studies education. Within the context of a textbook adoption cycle in Texas, we use a difference-in-differences approach with district-level administrative data and estimate the effects of adopting a state-approved textbook on social studies achievement. We find no evidence of a practically meaningful adoption effect. We conclude by highlighting the need for further high-quality research in this often-overlooked school subject area.

In their situated expectancy-value theory, Eccles and Wigfield (2020) assume students' competence and value beliefs to be situation-specific and thereby to be "situative" in nature. Even though motivation research has gradually been developing an understanding of this situative nature, for instance, by disentangling time-consistent and fluctuating proportions of competence and value beliefs at the analytical level of the individual, most studies still have not disentangled them at the class level. The present study sought to close this gap by applying a multilevel modeling approach based on data from 1,617 ninth-grade students in 78 classrooms across five consecutive math lessons. Our findings revealed significant proportions of trait variance and state residual variance in students' competence beliefs, value beliefs, and their perceptions of autonomy-supportive teaching behaviors at the individual and class levels. Larger amounts of variance could be attributed to the individual level compared with the class level and to fluctuating compared with time-consistent proportions (across levels). Furthermore, students' perceptions of autonomy-supportive teaching behaviors predicted their situation-specific competence and value beliefs, whereby time-consistent differences, both between students and between classes, explained more variance than fluctuations within students and within classes. Thus, our findings supported the situative nature of competence and value beliefs but also revealed that, by and large, time-consistent differences in the perceptions of autonomy-supportive teaching behaviors between students and classes had more predictive power for students' competence and value beliefs than intraindividual and intraclass fluctuations over time.

Students' academic achievement is a key predictor of various life outcomes and is commonly used for selection as well as for educational monitoring and accountability. With regard to achievement indicators, a differentiation has traditionally been drawn between grades and standardized tests. There is initial, albeit inconclusive, evidence that these indicators might differentially reflect students' personality as encapsulated in the Big Five personality traits as well as measures of cognitive abilities. In this article, we propose the personality-achievement saturation hypothesis (PASH) as an overarching model that describes the association between achievement indicators and personality. The PASH suggests that the differentiation between grades and tests is too simplistic and that associations between personality and achievement instead vary across five main features of the achievement measures that are used: level of standardization, relevance for the student, curricular validity, instructional sensitivity, and cognitive ability saturation. On the basis of findings from prior studies, we focused in particular on conscientiousness and openness to test the PASH. We used data from three large-scale studies (total N = 14,953) and aggregated our findings across these studies. In line with the PASH, the Big Five trait of conscientiousness was most strongly related to measures that were less standardized and less saturated with cognitive ability but higher on curriculum validity, relevance, and instructional sensitivity. In addition, openness was most strongly related to measures that were higher on standardization and cognitive ability saturation but lower on relevance, curriculum validity, and instructional sensitivity in English.

Understanding how early reading and mathematics co-develop is important from both theoretical and pedagogical standpoints. Previous research has provided mixed results. This paper investigates the development of reading and mathematics in a longitudinal sample of N = 355,883 students from the United Kingdom (2005-2019) aged 5 to 12 (49% girls). Results indicate a positive relation between the development of the two domains. In addition, a substantial statistically significant positive association between prior reading scores and subsequent changes in achievement in mathematics was found, whereas changes in reading were smaller for students with a higher prior performance in mathematics. The findings suggest that acquiring good reading skills is highly relevant for developing mathematics skills. Implications for theory and practice are discussed.

Equally able students have lower academic self-concept in high achieving schools or classes, a phenomenon known as the big fish little pond effect (BFLPE). The class (more so than the school) has been shown to be the pivotal frame-of-reference for academic self-concept formation--a local dominance effect. However, many school systems worldwide employ forms of course-by-course tracking, thus exposing students to multiple class environments. Due to the high correlation between multiple student environments, the frame-of-reference used for academic self-concept formation in course-by-course tracked systems is unclear to date. We addressed this unresolved issue by using data from a comprehensive survey that measured the entire population of Austrian eighth-grade students in the domain of mathematics in 2012. General secondary school students were in the core subjects (i.e., mathematics, German, and English) grouped according to ability, whereas regular class composition was the same in all other subjects. Using cross-classified multilevel models, we regressed math self-concept on average math achievement of students' school, math class, and regular class. Consistent with the local dominance effect, we found the BFLPE on the school level to be weak after controlling for the class levels. We found a stronger BFLPE on the regular class level and the strongest BFLPE on the math class level. Our study demonstrates the importance of multiple class environments as frames-of-reference for academic self-concept formation.

This study set out to examine the basic reading skills (accuracy and fluency in decoding, word and text reading) and some of the reading-related language skills (phonological awareness and rapid-naming) of 54 adults with low reading comprehension, who read the transparent German orthography. Participants were born in Germany and showed a typical non-verbal processing speed. With the exception of reading accuracy, participants were expected to present deficits in all basic reading and reading-related skills. The average performance in measures of decoding and word reading fluency was extremely low. A notable proportion of the sample, however, did not present a deficit in these measures. As expected, the average rate of reading errors was generally low. Nevertheless, text reading accuracy was deficient for one quarter of the sample. Tests addressing the reading-related language skills also indicated an average low performance in phonological awareness, but not in rapid-naming. Here too, a notable variance was observed. These results suggest that deficits in the basic reading skills and in phonological awareness characterise, on average, adults with low reading comprehension. At the same time, significant deficits in reading comprehension in this population do not necessarily imply deficits in the more basic skills of reading as well. In addition, the results indicate that reading accuracy constitutes a source of difficulty for some of these adults, despite the reading of a transparent orthography. The sources for the variance in performance throughout the different reading and reading-related measures remain to be explored.

Relevance interventions have shown a great potential to foster motivation and achievement (Lazowski & Hulleman, 2016). Yet, further research is warranted to test how such interventions can be successfully implemented in practice. We conducted a cluster-randomized trial in ninth-grade math classrooms to test the effectiveness of a relevance intervention, which was shown to be efficacious when implemented by researchers, for fostering motivation and achievement under real-world conditions. The 78 participating classrooms (N = 1,744 students) were randomly assigned to one of two intervention conditions or a waitlist control condition. The intervention was implemented by master's students or the regular math teachers. Intervention effects were evaluated using self-reports, teacher ratings, and achievement tests 4 weeks and 3 months after the intervention, controlling for the initial levels of the outcomes. Compared with the control condition, both intervention conditions showed similar positive effects on utility value. Unexpectedly, students in both intervention conditions also reported higher perceived cost compared with students in the control condition after the intervention. When implemented by master's students, additional intervention effects on students' growth mindsets and a standardized achievement test could be observed. Only small differences in effectiveness were observed between the intervention conditions, although master's students showed a higher level of adherence. In both intervention conditions, higher levels of adherence and lower levels of discipline problems were associated with more positive changes in utility value. Overall, the intervention thus showed mixed effects. Future research should therefore continue to examine the conditions under which relevance interventions work in practice.

Personality traits and social cognitive variables are central constructs in psychological research. It is often assumed that personality traits are less changeable than social cognitive variables, and thus interventions usually tend to focus on the latter. However, these assumptions about the mutability of personality and social cognitive variables have never been tested side-by-side in a longitudinal study. Using a large longitudinal study with four time points and N = 3,876 students in 136 classes (99 schools), we compared the mutability of the Big Five personality traits and social cognitive constructs more often described as socioemotional skills or motivational variables (individual interest, self-concept, and academic effort in the school subjects math, English, and German). The results indicated that there are no marked differences between personality traits and social cognitive constructs across multiple indicators of stability or changeability.

The present study illustrates the utility of applying multilevel mixture models in educational research, using data on the homework behavior of 1,812 Swiss eighth-grade students in French as a second language. A previous person-centered study identified 5 homework learning types characterized by different patterns of high or low homework time and effort. Via multilevel latent profile analyses (MLPAs), the dependence of homework learning types on between-classroom differences was investigated. Based on the proportions of homework learning profiles across classrooms, 3 class-level profiles were identified: A "low time", "high time" and an "average" profile. Predictors of the latent profiles at the student and class levels were assessed. The study offers insights into the advantages of multilevel mixture models for educational research.

Introduction: Despite having sufficient formal education, a large group of people cannot complete everyday tasks like reading, writing, or making basic calculations. Regarding reading, millions of people are not able to understand more complex texts despite the ability to read simple words or sentences; they have low literacy skills. Even though this problem has been known for decades, the causes and predictors of their poor reading comprehension skills are not fully explored. Socioeconomic, sociodemographic, and reading-related (i.e., linguistic) factors, especially of English-speaking participants and thus users of an opaque orthography, were often assessed. The goal of this study was to examine which linguistic, domain-general, or numerical factors predict substandard complex text reading as the core symptom of low literacy skills in adulthood. Methods: To this end, we assessed a group of German-speaking participants--users of a transparent orthography--who are at risk for complex text reading deficits. Results: The results indicated that linguistic variables (reduced word/pseudoword reading, weaker oral semantic and grammatical comprehension), working memory, and age predicted lower performance in text comprehension. This model explained 73% of the total variance, indicating that most of the deficits in complex text reading can be explained by a group of basic underlying linguistic and domain-general factors. Discussion: We conclude that interventions for adults with low literacy skills and others at risk for complex text reading deficits should address word/pseudoword reading and focus on both written and oral comprehension. [ABSTRACT FROM AUTHOR]

A two-level data set can be structured in either long format (LF) or wide format (WF), and both have corresponding SEM approaches for estimating multilevel models. Intuitively, one might expect these approaches to perform similarly. However, the two data formats yield data matrices with different numbers of columns and rows, and their cols : rows is related to the magnitude of eigenvalue bias in sample covariance matrices. Previous studies have shown similar performance for both approaches, but they were limited to settings where cols ≪ rows in both data formats. We conducted a Monte Carlo study to investigate whether varying cols : rows result in differing performances. Specifically, we examined the p : N ( cols : rows ) effect on convergence and estimation accuracy in multilevel settings. Our findings suggest that (1) the LF approach is more likely to achieve convergence, but for the models that converged in both, (2) the LF and WF approach yield similar estimation accuracy, which is related to (3) differential cols : rows effects in both approaches, and (4) smaller ICC values lead to less accurate between-group parameter estimates. [ABSTRACT FROM AUTHOR]

One way to address the leaking pipeline toward STEM-related careers (i.e., science, technology, engineering, and mathematics) is to intervene on students' STEM motivation in school. However, a neglected question in intervention research is how such interventions affect motivation in subjects not targeted by the intervention. This question was addressed through data from a cluster-randomized study in which a value intervention was successfully implemented in 82 ninth-grade math classrooms. Side effects on value, self-concept, and effort in German as students' native language and English as a foreign language were assessed 6 weeks and 5 months after the intervention. Negative effects on value for German, but not for English, were found 5 months after the intervention. The theoretical and educational implications of such effects are discussed.

Drawing on expectancy-value theory, the present study examined the unique contributions of the four major value beliefs and self-concept on achievement, self-reported effort, and teacher-rated behavioral engagement in mathematics. In particular, we examined the multiplicative effects of self-concept and task values on educational outcomes using the latent moderated structural equation approach. Participants were 1,868 German ninth-grade students. The data analyses relied on a higher-order structure of value beliefs, which is suited to parsing the differential patterns of predictive relations for different value beliefs. The findings revealed that (a) self-concept was more predictive of achievement, whereas value beliefs were more predictive of self-rated effort; (b) self-concept and value beliefs emerged as equally important predictors of teacher-reported engagement; (c) among the four value beliefs, achievement was more associated with low cost, whereas effort was more associated with attainment value; and (d) latent interactions between self-concept and value beliefs predicted the three outcomes synergistically.

Conscientiousness and interest are well-known predictors of academic effort and achievement. As hypothesized by the Conscientiousness × Interest Compensation (CONIC) model, conscientiousness and interest can (partly) compensate for each other, leading to (comparatively) high effort if either conscientiousness or interest is high. The present research (a) provides a test of this prediction across four school subjects, (b) examines whether the compensatory interaction can also be found when academic achievement is the outcome instead of academic effort, and (c) probes for the compensatory interaction when interest is replaced by utility value as a predictor variable. A total of 830 students in Grades 5 to 12 participated in this study. We assessed their conscientiousness and measured task value beliefs, academic effort, and achievement in 4 school subjects (German, English, mathematics, and biology). The predictions of the CONIC model were supported in all 4 subjects. In addition, we found compensatory interactions between conscientiousness and interest in predicting both academic effort and achievement. Furthermore, we observed similar compensatory interactions between conscientiousness and utility value. In sum, the results suggest a broader applicability of the CONIC model than originally proposed.

Teacher-assigned grades provide important information that is used by universities and colleges to make admission decisions and by employers to make hiring decisions. Besides grades, the results of standardized achievement tests are frequently used for student selection and allocation. However, correlations between the two achievement measures are far from perfect, and researchers have argued that this discrepancy can be at least partially attributed to norm-referenced grading, which is based on the composition of performance in a class. In this study, we investigated the results of a curricular intensification reform, which introduced changes in the distribution of student performance by making enrollment in certain courses mandatory. We investigated whether the reform resulted in changes in the relationship between standardized achievement-test results and teacher-assigned grades. We analyzed cohort control design data from two large representative samples of students from two German states (Baden-Württemberg: N = 5,574; Thuringia: N = 2,202) before and after the reform. Results indicated that students who received a certain grade before the reform (e.g., a grade of A, B, C, or D) differed in their standardized test performance from students who received the same grade after the reform. Furthermore, in math, course-level-specific reform effects on the association between grades and standardized test performance were found to vary between groups of students receiving good and poor grades. Implications for educational policy and school reforms and suggestions for grading are discussed.

Position effects (PE) cause decreasing probabilities of correct item responses towards the end of a test. We analysed PEs in science, mathematics and reading tests administered in the German extension to the PISA 2006 study with respect to their variability at the student- and school-level. PEs were strongest in reading and weakest in mathematics. Variability in PEs was found at both levels of analysis. PEs were stronger for male students, for students with a migration background (science and mathematics), and for students with a less favourable socio-economic background (reading). At the school level, PEs were stronger in lower school tracks and in schools with a high proportion of students with a migration background. The relationships of the test scores with the covariates partly reflected the covariates' relationships with PEs. Our findings suggest that PEs should be taken seriously in large-scale assessments as they have an undesirable impact on the results.

In recent decades, several countries have made an effort to increase the enrollment rates and performance of students in science and mathematics by means of mandatory, rigorous course work, which is often referred to as curricular intensification (CI). However, there is a lack of research on intended and unintended effects of CI reforms on achievement and motivation. Using representative data from the National Educational Panel Study, we examined effects of a prototypical CI reform in 1 German state. We compared data from the last student cohort before and the first student cohort after the reform at the end of upper secondary school. There was no statistically significant effect on average achievement. However, we found first evidence for differential effects on English reading and a higher English self-concept of young men after the reform, whereas the reform had a negative effect on young women's math self-concept.

Enrichment programs provide learning opportunities for a broader or deeper examination of curricular or extracurricular topics and are popular in gifted education. Herein, we investigated the effectiveness of a statewide extracurricular enrichment program for gifted elementary school children in Germany. The program implemented a "grass roots" strategy by which local units developed and offered the enrichment courses, which spanned a broad array of topics. The courses targeted different outcomes, including students' cognitive abilities, school achievement, interests, creativity, self-control, self-concept, and social competencies. We compared third-grade students attending the enrichment program (N =423) with nonattending third-grade students (N = 2,328) by means of a propensity score analysis. Specifically, we controlled for potential selection effects and estimated the average causal effect of the enrichment program for children attending the program. The findings revealed positive program effects on academic achievement but not on the other targeted outcomes.

Using data from 1,571 ninth-grade students (M[subscript age] = 14.62) from 82 academic track schools in Germany and their predominantly Caucasian middle-class parents, configurations of different family characteristics reported by parents were investigated. Latent profile analyses considering academic involvement, family interest, parents' self-concept, child's need for support, and parents' time and energy identified average, indifferent, motivated and engaged, motivated and disengaged, and involved families. Cross-sectional and longitudinal associations with students' motivational (self-concept, effort, and interest) and achievement outcomes (achievement test and grades) in math were analyzed. Students from families classified as motivated and disengaged showed higher initial levels motivation and achievement. Over 5 months, these students also showed an increase in self-concept and higher achievement than students from other family types.

An emerging literature demonstrates that relevance interventions, which ask students to produce written reflections on how what they are learning relates to their lives, improve student learning outcomes. As part of a randomized evaluation of a relevance intervention (N = 1,978 students from 82 ninth-grade classes), we used Complier Average Causal Effects (CACE) to identify the effect of the intervention on participants who were assigned to the intervention group and were actually compliant with the intervention (i.e., treatment fidelity or compliance). Results revealed larger differences for compliers than noncompliers, although this impact depended on several factors. Implications for the application of CACE models in educational interventions, in general, and relevance interventions, in particular, are discussed.

The present study investigated the effectiveness of two short relevance interventions (writing a text or evaluating quotations about the utility of mathematics) using a sample of 1,916 students in 82 math classrooms in a cluster randomized controlled experiment. Short-term and sustained effects (6 weeks and 5 months after the intervention) of the two intervention conditions on students' competence beliefs (self-concept, homework self-efficacy), teacher-rated individual effort, and standardized test scores in mathematics were assessed. Hierarchical linear regression analyses showed that students' homework self-efficacy was higher in both intervention groups 6 weeks and 5 months after the intervention compared to the control condition. Students' self-concept, teacher-rated effort, and achievement in mathematics were promoted through the quotations condition, partly in the long term.