Search

IntroductionSelf-report questionnaires are widely used in high schools and universities to gain insights into students’ learning strategies and enhance the quality of their education. However, it is important to acknowledge the possibility of respondents being inattentive when completing these questionnaires. While reliability analyses are typically performed at the group level, when providing individual feedback, it is crucial that each respondent’s results are reliable. This study aimed to evaluate the prevalence of careless response behaviour in a questionnaire concerning student learning.MethodsData analysis encompassed a substantial sample of 12,000+ students in their final two years of secondary education, averaging around 17 years of age. Employing five complementary detection techniques, the study identified instances of careless responding present in the questionnaire data.ResultsOur results underscore a notable prevalence of careless response behaviour among the surveyed students. Application of the five detection techniques revealed a substantial number of instances indicating inattentive responding. Furthermore, the questionnaire’s measurement scales were evaluated for reliability. The study noted the presence of carelessness but observed minimal impact on group-level results.DiscussionThe outcomes of this study hold important implications for using self-report questionnaires in education. The prevalence of careless responding emphasizes the need for scrutinizing individual responses. Despite careless responses, their influence on overall group-level data integrity seems restricted. Nonetheless, the study underscores the importance of cautiously interpreting individual-level outcomes, particularly when using these results for individual feedback.

To date, there has been little agreement on what important facets should be incorporated in quantitative measures of the academic and social first-year experience. Moreover, such scales are typically developed in academic higher education (HE) contexts (i.e., universities providing more theoretical and scientific education), and are disconnected from the experiences of students in professional HE contexts (i.e., university colleges, offering more vocational education that prepares students for practicing a specific occupation, such as social work). The First-year Integration Test (FIT) is a newly developed instrument that aims to map out students’ perceptions of how they are dealing with their academic and social transition in the first semester of HE, and was based on thorough qualitative research in professional HE. In the present study, the psychometric value of FIT is explored. Results show that FIT has good construct validity, and all scales are internally consistent. Also, evidence was found for the convergent, discriminant and criterion-related validity of the instrument. We argue that FIT holds potential as a tool for generating student feedback, as a monitoring tool within an institution’s quality assurance system, and as a valuable research instrument.

IntroductionSince previous research on educational career exploration has mainly been cross-sectional and therefore has been unsuccessful in explaining how this process can change during the final year in secondary education before students make the transition to higher education, this study aimed to examine changes over time in the exploration process. A person-centered research perspective was taken to further deepen the understanding of how different exploration tasks jointly combine into meaningful profiles. In this way, this study tried to gain more insight into why some students go through this process successfully and others do not. Four goals guided this study: identifying exploration profiles of students in Fall and Spring of the final year in secondary school based on four decisional tasks (orientation, self-, broad and in-depth exploration), investigating transitions between exploration profiles across these two timepoints, and examining the role which different antecedents (i.e., academic self-efficacy, academic self-concept, motivation, test anxiety, gender, educational track, socio-economic status) play in explaining both profile membership and transitions between profiles.MethodsUsing self-report questionnaires to measure the exploration tasks and the antecedents in final year students, two cross-sectional samples collected in Fall (n = 9,567) and Spring (n = 7,254), and one longitudinal sample (n = 672) were examined.ResultsLatent profile analyses identified three exploration profiles at both timepoints: passive, moderately active, and highly active explorers. Latent transition analysis showed the moderately active explorers profile to be the most stable profile, while the passive profile was the most variable profile. Academic self-concept, motivation, test anxiety, and gender had an effect on the initial states, while motivation and test anxiety affected the transition probabilities. For both academic self-concept and motivation, students scoring higher were found to be less present in the passive or the moderately active than in the highly active profile. Furthermore, compared to students who remained in the passive profile, higher levels of motivation were associated with a higher probability to transition to the moderately active profile. Next to that, compared to students who remained in the highly active profile, higher levels of motivation were associated with a lower probability to transition to the moderately active profile. Results on anxiety were inconsistent.DiscussionBased on substantial cross-sectional as well as longitudinal data, our findings contribute to a more comprehensive understanding of the explanatory base of important differences in the study choice making process of students opting for higher education. This may ultimately lead to more timely and fitting support for students with different exploration profiles.

Research on learning strategies and learning motivation in different educational contexts has provided valuable insights, but in this field, low-educated adults remain an understudied population. This study addresses this gap by means of a person-oriented approach and seeks to investigate whether quantitatively and qualitatively different learner profiles can be distinguished among low-educated adults in second-chance education (SCE) by relating three key components of learning: learning motivation, regulation and processing strategies. Five hundred twelve adult learners of six SCE-institutions filled in a Learning and Motivation questionnaire. Latent profile analysis showed the presence of motivational profiles differing both in quantity and quality (i.e. good- versus poor-quality and high- versus low-quantity motivational profiles) and regulatory profiles being distinct in the use of regulation strategies (i.e. self-regulated versus unregulated profiles). Mainly quantitatively different processing profiles were found among low-educated adults (i.e. active, moderate, inactive processing profiles). When integrating all three components of learning, analyses identified two more optimal motivational-learning profiles, combining good-quality motivation with a moderately active use of self-regulation and processing strategies (i.e. good-quality motivation -- self-regulated -- active processing profile and good-quality motivation -- moderate profile) and two more suboptimal profiles in which poor-quality or low-quantity motivation was combined with the inactive use of self-regulation and processing strategies (i.e. poor-quality motivation -- unregulated -- inactive processing profile, low-quantity motivation -- unregulated -- inactive processing profile). A fifth motivational-learning profile exhibited a pattern of poor-quality motivation combined with a moderately-active use of self-regulation and processing strategies.

Learning in the workplace supports physicians in developing competences to ensure quality medical care. As such, learning in the workplace is essential for physicians' life-long professional development. Notwithstanding its importance, research on physicians' learning in the workplace and the corresponding motivational drivers is limited. In this study, 17 semi-structured interviews were conducted to explore experienced physicians' learning activities and their motivation for learning in the workplace. In addition, it was examined whether differences could be noted in learning in the workplace depending on physicians' experience, specialism, gender or the type of hospital they work in. Concepts from learning in the workplace and motivation theories, i.e. learning activities in the workplace, self-determination theory and achievement goal theory, guided the data analysis, and an inductive analysis was conducted as well. Results revealed various learning activities for instance but not limited to: learning by asking colleagues for feedback, asking for help while performing particular medical actions, helping students while conducting their assignments or observing colleagues. Besides, the participants indicated different motives for learning. Physicians reported that they are motivated to properly perform their job, they enjoy learning and/or like learning in relation to solving challenging cases. The study shows that participants' differences in motivation can be related to seniority and the type of hospitals physicians are employed in.

This study tests an integrative model, which delineates how students’ academic motivation, academic self-efficacy and learning strategies (processing strategies and regulation strategies) at the end of secondary education impact academic adjustment in the first semester of the first year of higher education (FYHE) and subsequent academic achievement at the end of the FYHE, in two types of HE programmes. More precisely, the present study explores the extent to which the explanatory values of aforementioned determinants of academic adjustment and academic achievement differ across academic (providing more theoretical and scientific education) and professional (offering more vocational education that prepares students for a particular occupation, such as nursing) programmes. Hereto, multiple-group SEM analyses were carried out on a longitudinal dataset containing 1987 respondents (Academic programmes: N=1080, 54.4%; Professional programmes: N=907, 45.6%), using Mplus 8.3. Results indicate differences in the predictive power of determinants under scrutiny between professional and academic contexts. Firstly, learning strategies and motivational variables at the end of secondary education have more predictive power in the prediction of FYHE academic adjustment in the academic programmes than in professional programmes. Secondly, our results indicate that academic adjustment in the first semester of the FYHE influences academic achievement to a bigger extent in professional programmes than in academic programmes. Moreover, these differences across HE contexts were found after controlling for prior education. Implications of the findings are discussed.

The advantage of comparative judgment is that it is particularly suited to assess multidimensional and complex constructs as text quality. This is because assessors are asked to compare texts holistically and to make a quality judgment for each text in a pairwise comparison based upon on the most salient and critical differences. Also, the resulted rank order is based on the judgment of all assessors, representing the shared consensus. In order to be able to select the right number of assessors, the question is to what extent the conceptualization of assessors prevails in the aspects they base their judgment on, or whether comparative judgment minimizes the differences between assessors. In other words, can we detect types of assessors who tend to consider certain aspects of text quality more often than others? A total of 64 assessors compared argumentative texts, after which they provided decision statements on what aspects of text quality had informed their judgment. These decision statements were coded on six overarching themes of text quality: argumentation, organization, language use, language conventions, source use, references, and layout. Using a multilevel-latent class analysis, four different types of assessors could be distinguished: narrowly focused, broadly focused, source-focused, and language-focused. However, the analysis also showed that all assessor types mainly focused on argumentation and organization, and that assessor types only partly explained whether the aspect of text quality was mentioned in a decision statement. We conclude that comparative judgment is a strong method for comparing complex constructs like text quality. First, because the rank order combines different views on text quality, but foremost because the method of comparative judgment minimizes differences between assessors.

Although teacher effectiveness plays a critical role in the learning process, little is known about its conceptualization and assessment, particularly in higher education (HE). This review aims to fill this gap by (a) listing the literature on teacher effectiveness, (b) identifying the instruments that have been used to assess teacher effectiveness (HE), and (c) highlighting the most effective teaching approaches based on the relevant literature. The selection process considered studies published since 1990 and conducted in higher education contexts with students. The research articles measured instructional processes and faculty effectiveness in terms of student outcomes, focusing on student achievement and student satisfaction. In reviewing the international research, special attention was paid to Southeastern Europe and Greece in particular. After a thorough review, the analysis revealed 26 studies. The results show that there is no universal definition of effective higher education teaching. Effective teaching may manifest itself in high scores on student performance assessments or in rewarding classroom interactions. Based on this principle, the way teacher effectiveness is defined is closely linked to proposed solutions in educational policy. Furthermore, research has shown that student-centered teaching styles are perceived by students as more effective, engaging, and performance-enhancing. However, several studies have not clarified why different teachers use different teaching styles in similar contexts. This review represents a step forward in our understanding of teacher effectiveness in HE. Nonetheless, effective teaching strategies could be better conceptualized through future research aimed at assessing the contextual nature of teaching along with student perceptions of effectiveness and expectations for an effective classroom climate.

To date, little understanding exists of how first-year students in professionally oriented higher-education (HE) programs (i.e., those that provide vocational education to prepare students for a particular occupation) experience their academic transition process. In the present study, we first argued how the constructs of academic adjustment and academic integration can provide complementary perspectives on the academic transition of first-year students in (professional) HE. Next, we examined what first-year students in professional HE contexts perceive to be the most important experiences associated with their academic transition process in the first semester of their first year of higher education (FYHE). To this end, we adopted the fundamentals of the critical incident technique and asked 104 students in a Flemish (Dutch-speaking part of Belgium) university college (which offers professional HE programs, such as nursing) to complete “reflective logs” with open questions at the start of the second semester of their FYHE, wherein they reflected on three critical academic experiences during their first semester. An inductive, cross-case content analysis of the collected narratives showed that students reported on nine themes of academic experiences, which relate to five adjustment themes (dealing with the organization of the study program, organizing study work, committing to the study, following class and taking notes, and processing learning content outside class) and four integration themes (feeling competent, feeling stressed, feeling prepared, and feeling supported). Further analyses showed that although some of the nine themes of academic experiences appear to be more important at different times in the first semester, they all seem to be meaningful throughout the whole semester.

In contrast with the plethora of studies on the academic motivation of regular students in regular educational settings, this study aims to shed light on the motivation and educational support needs of chronically ill children in hospital schools. This in-depth qualitative study seeks to explore whether the expected motivational dimensions central in SDT research are present in this specific population and setting and if the expected relationships with 'needs' are present. In contrast with research on academic motivation and needs in common classrooms, research on hospital schools is very scarce. Using the theoretical framework of self-determination theory, we investigated the presence of different types of motivation linked with ABC. More specifically, we investigated students' motivational types linked with the educational support needs that they expect their hospital school teacher(s) to address. A purposive selected sample of six students with severe chronic or long-term illnesses from three different hospital schools in Flanders (Belgium) was interviewed, using elicitation techniques to further deepen the data collection. Despite their chronic illnesses, all participating students were academically motivated, although some students indicated that not feeling well could cause temporary motivational regression. We were able to distinguish differences in motivation and expected need support. More controlled motivated students from the university hospital schools indicated a preference for support in terms of relatedness. More autonomously motivated students from a hospital school within a revalidation center showed more autonomous motivation and preferred competence support, instead of the autonomy-support that would be expected according to self-determination theory.

Although self-report questionnaires are widely used, researchers debate whether responses to these types of questionnaires are valid representations of the respondent’s actual thoughts and beliefs. In order to provide more insight into the quality of questionnaire data, we aimed to gain an understanding of the processes that impact the completion of self-report questionnaires. To this end, we explored the process of completing a questionnaire by monitoring the eye tracking data of 70 students in higher education. Specifically, we examined the relation between eye movement measurements and the level of internal consistency demonstrated in the responses to the questionnaire. The results indicated that respondents who look longer at an item do not necessarily have more consistent answering behaviour than respondents with shorter processing times. Our findings indicate that eye tracking serves as a promising tool to gain more insight into the process of completing self-report questionnaires.

In the last decade, the Achievement Orientation Model (AOM) of Siegle and McCoach has often been used to quantitatively explore different pathways for academic achievement among intellectually gifted students in educational settings, mostly in secondary education. To study the dynamics of the different components in the AOM, we further examined the inhibiting and facilitating factors associated with academic achievement as experienced by well-performing and underperforming gifted students. Because the transition from elementary to secondary education is a crucial phase for intellectually gifted students, we selected students from the 7th and 8th grade, using purposive sampling. Six gifted students, three well-performing and three underperforming, from two different high schools participated in in-depth interviews. By capturing the lived experiences of six intellectually gifted students in this study, we were able to get more insight into the complex processes that relate to students’ (dis)engagement and (under)achievement in school. The findings underline the value of the AOM and stress the importance of taking learner perceptions into account.

Studies on learning strategies across cultures in higher education inform the internationalisation of teaching and learning. Previous comparisons relied on geographical generalisations (e.g., "Asian", "Western", "Latin-American") or only variable-centred methods, which can overgeneralise the contexts they represent. Eight learning strategy datasets (ILS; Inventory of Learning patterns of Students) from seven countries (n = 4883) were obtained and (re-)analysed using variable-centred and person-centred (Latent Profile Analysis; LPA) methods. Employing Hofstede's individualism-collectivism and power distance indices as predictors, lower individualism and higher power distance scores corresponded to students' overall combined reporting of meaning-directed, reproduction-directed and application-directed learning strategies. Furthermore, sample LPAs found that less individualistic contexts presented profiles with similar shape (i.e., profiles differed by similar amounts across most learning strategies). More individualistic contexts presented profiles with different shapes (i.e., different profiles preferred different strategies). Multiple "Western" contexts presented profiles that describe the "Asian" and "Latin-American" learner stereotypes. These results question the existence of such stereotypes and point to the usefulness of cultural indicators for making cross-cultural learning strategy comparisons. Theoretical and practical implications are discussed.

Nowadays, comparative judgment (CJ) is used to assess competences. Judges compare two pieces of student work and judge which of both is better regarding the competence assessed. Using these pairwise comparison data, students’ work is scaled according to its quality. Since student work is highly information loaded and heterogeneous of nature, this raises the question whether judges can handle this type of complex judgments? However, research into the complexity of CJ and its relation with decision accuracy is currently lacking. Therefore, this study initiates a theoretical framework on the complexity of CJ and relates it to decision accuracy. Based on this framework, two hypotheses are formulated and their plausibility is examined. The first hypothesis states that the distance between two pieces of student work on the rank-order (rank-order distance) is negatively related to experienced complexity, irrespectively of decision accuracy. In contrast, hypothesis 2 expects decision accuracy to moderate the relation between rank-order distance and experienced complexity. A negative relation is expected for accurate decisions. Meanwhile, inaccurate decisions are assumed to result in higher experienced complexity than accurate decisions, irrespective of rank-order distance. In both hypotheses, judges are expected to vary in mean experienced complexity as well as in the strength of the expected relationship between rank-order distance and experienced complexity. Using an information-theoretic approach, both hypotheses are translated into a statistical model and their relative fit is assessed. All analyses are replicated on three samples. Sample 1 and 2 comprise CJ data on the assessment of writing, while sample 3 contains pairwise comparison data on the assessment of visual arts. In all samples, results unambiguously confirm the moderating role of decision accuracy (hypothesis 2). Inaccurate decisions are experienced as more complex than accurate decisions, irrespective of rank-order distance. Meanwhile, for accurate decisions, rank-order distance is negatively related to experienced complexity. In line with expectations, differences between judges are found in mean experienced complexity and in the strength of the relationship between rank-order distance and experienced complexity. Suggestions for further theory development are formulated based on the results of this study.

Teachers' instructional beliefs and interests in Education for Sustainable Development (ESD) are related to holistic, pluralistic, and action-oriented instructional practices in ESD teaching. To explore this hypothesis, we examine teachers' ESD teaching profiles based on their instructional beliefs, interests, and instructional practices in ESD. We apply a mixed method design using a survey (quantitative data) and vignettes with open accompanying questions (qualitative data). Our sample consists of 535 Flemish elementary and secondary school teachers for the scales. A subsample of 187 teachers responded to the vignettes. Our analysis indicates two teachers' ESD teaching profiles: the lower ESD practice-oriented teachers who hold several instructional beliefs about holistic and pluralistic instructional practices, are interested in action-orientation in ESD, but do not apply the practices in class; and the higher ESD practice-oriented teachers who also have varying instructional beliefs about holistic and pluralistic instructional practices but are not very interested in action-orientation in ESD. However, they use holistic, pluralistic, or action-oriented practices in ESD teaching.

Longitudinal data is almost always burdened with missing data. However, in educational and psychological research, there is a large discrepancy between methodological suggestions and research practice. The former suggests applying sensitivity analysis in order to the robustness of the results in terms of varying assumptions regarding the mechanism generating the missing data. However, in research practice, participants with missing data are usually discarded by relying on listwise deletion. To help bridge the gap between methodological recommendations and applied research in the educational and psychological domain, this study provides a tutorial example of sensitivity analysis for latent growth analysis. The example data concern students' changes in learning strategies during higher education. One cohort of students in a Belgian university college was asked to complete the Inventory of Learning Styles-Short Version, in three measurement waves. A substantial number of students did not participate on each occasion. Change over time in student learning strategies was assessed using eight missing data techniques, which assume different mechanisms for missingness. The results indicated that, for some learning strategy subscales, growth estimates differed between the models. Guidelines in terms of reporting the results from sensitivity analysis are synthesised and applied to the results from the tutorial example.

This study starts from the observation that current empirical research on students’ processing strategies in higher education has mainly focused on the use of self-report instruments to measure students’ general preferences towards processing strategies. In contrast, there is a rather limited use of more direct and online observation techniques to uncover differences in processing strategies at a task specific level. We based our study on one of the most influential studies in the domain of Students’ Approaches to Learning (SAL) (Marton, Dahlgren, Säljö, & Svensson, 1975). In our exploratory experiment we used eye tracking followed by a cued recall to investigate how students use processing strategies in learning from expository text. Nineteen university students participated in the experiment. Results suggested that students in the deep condition did not look longer at the essentials in the text compared with students in the surface condition, but that they processed them in a more deep way. In our sample, students in the surface condition looked longer at facts and details and also reported repeating these facts and details more often. We suggest that the combination of eye tracking followed by a cued recall is a promising tool to investigate students’ processing strategies since not all differences in processing strategies are reflected in overt eye movement behaviour. The current methodology allows researchers in the domain of SAL to complement and extend the present knowledge base that has accumulated through years of research with self-report questionnaires and interviews on students’ general preferences towards processing strategies.

The low success rate of first-year college students in Science, Technology, Engineering, and Mathematics (STEM) programs has spurred many academic achievement studies in which explanatory factors are studied. In this study, we investigated from a person-oriented perspective whether different motivational and academic self-concept profiles could be discerned between male and female first-year college students in STEM and whether differences in early academic achievement were associated with these student groups. Data on autonomous motivation, academic self-concept, and early academic achievement of 1,400 first-year STEM college students were collected. Cluster analyses were used to distinguish motivational profiles based on the relative levels of autonomous motivation and academic self-concept for male and female students. Differences in early academic achievement of the various profiles were studied by means of ANCOVA. Four different motivational profiles were discerned based on the dimensions of autonomous motivation (A) and academic self-concept (S): students scoring high and respectively low on both dimensions (HA-HS or LA-LS), and students scoring high on one dimension and low on the other (HA-LS or LA-HS). Also gender differences were found in this study: male students with high levels of academic self-concept and autonomous motivation had higher academic achievement compared to male students with low levels on both motivational dimensions. For female students, motivational profiles were not associated with academic achievement. The findings partially confirm the internal and external validity of the motivational theories underpinning this study and extend the present insights on identifying subgroup(s) of at risk students in contemporary STEM programs at university level.

The change in learning strategies during higher education is an important topic of research in the Student Approaches to Learning field. Although the studies on this topic are increasingly longitudinal, analyses have continued to rely primarily on traditional statistical methods. The present research is innovative in the way it uses a multi-indicator latent growth analysis in order to more accurately estimate the general and differential development in learning strategy scales. Moreover, the predictive strength of the latent growth models are estimated. The sample consists of one cohort of Flemish University College students, 245 of whom participated in the three measurement waves by filling out the processing and regulation strategies scales of the Inventory of Learning Styles--Short Versions. Independent-samples t-tests revealed that the longitudinal group is a non-random subset of students starting University College. For each scale, a multi-indicator latent growth model is estimated using Mplus 6.1. Results suggest that, on average, during higher education, students persisting in their studies in a non-delayed manner seem to shift towards high-quality learning and away from undirected and surface-oriented learning. Moreover, students from the longitudinal group are found to vary in their initial levels, while, unexpectedly, not in their change over time. Although the growth models fit the data well, significant residual variances in the latent factors remain.

The student-centred education project is an action research project conducted by lecturers at an institution of higher education and university researchers. over a 2-year period. Valuable experience has been gained about working with lecturers on projects that affect their beliefs about learning and instruction in practice. This article focuses on the use of an action research [ABSTRACT FROM AUTHOR]