Search

IntroductionSelf-report questionnaires are widely used in high schools and universities to gain insights into students’ learning strategies and enhance the quality of their education. However, it is important to acknowledge the possibility of respondents being inattentive when completing these questionnaires. While reliability analyses are typically performed at the group level, when providing individual feedback, it is crucial that each respondent’s results are reliable. This study aimed to evaluate the prevalence of careless response behaviour in a questionnaire concerning student learning.MethodsData analysis encompassed a substantial sample of 12,000+ students in their final two years of secondary education, averaging around 17 years of age. Employing five complementary detection techniques, the study identified instances of careless responding present in the questionnaire data.ResultsOur results underscore a notable prevalence of careless response behaviour among the surveyed students. Application of the five detection techniques revealed a substantial number of instances indicating inattentive responding. Furthermore, the questionnaire’s measurement scales were evaluated for reliability. The study noted the presence of carelessness but observed minimal impact on group-level results.DiscussionThe outcomes of this study hold important implications for using self-report questionnaires in education. The prevalence of careless responding emphasizes the need for scrutinizing individual responses. Despite careless responses, their influence on overall group-level data integrity seems restricted. Nonetheless, the study underscores the importance of cautiously interpreting individual-level outcomes, particularly when using these results for individual feedback.

Although teacher effectiveness plays a critical role in the learning process, little is known about its conceptualization and assessment, particularly in higher education (HE). This review aims to fill this gap by (a) listing the literature on teacher effectiveness, (b) identifying the instruments that have been used to assess teacher effectiveness (HE), and (c) highlighting the most effective teaching approaches based on the relevant literature. The selection process considered studies published since 1990 and conducted in higher education contexts with students. The research articles measured instructional processes and faculty effectiveness in terms of student outcomes, focusing on student achievement and student satisfaction. In reviewing the international research, special attention was paid to Southeastern Europe and Greece in particular. After a thorough review, the analysis revealed 26 studies. The results show that there is no universal definition of effective higher education teaching. Effective teaching may manifest itself in high scores on student performance assessments or in rewarding classroom interactions. Based on this principle, the way teacher effectiveness is defined is closely linked to proposed solutions in educational policy. Furthermore, research has shown that student-centered teaching styles are perceived by students as more effective, engaging, and performance-enhancing. However, several studies have not clarified why different teachers use different teaching styles in similar contexts. This review represents a step forward in our understanding of teacher effectiveness in HE. Nonetheless, effective teaching strategies could be better conceptualized through future research aimed at assessing the contextual nature of teaching along with student perceptions of effectiveness and expectations for an effective classroom climate.

Although self-report questionnaires are widely used, researchers debate whether responses to these types of questionnaires are valid representations of the respondent’s actual thoughts and beliefs. In order to provide more insight into the quality of questionnaire data, we aimed to gain an understanding of the processes that impact the completion of self-report questionnaires. To this end, we explored the process of completing a questionnaire by monitoring the eye tracking data of 70 students in higher education. Specifically, we examined the relation between eye movement measurements and the level of internal consistency demonstrated in the responses to the questionnaire. The results indicated that respondents who look longer at an item do not necessarily have more consistent answering behaviour than respondents with shorter processing times. Our findings indicate that eye tracking serves as a promising tool to gain more insight into the process of completing self-report questionnaires.