Search

Over the last two decades, the educational use of digital devices, including digital assessments, has become a regular feature of teaching in primary education in the Netherlands. However, researchers have not reached a consensus about the so-called "mode effect," which refers to the possible impact of using computer-based tests (CBT) instead of paper-and-pencil-based tests (PBT) to assess student performance. Some researchers suggest that the occurrence of a mode effect might be related to the type of device used, the subject being assessed and the characteristics of both the test and the students taking the test. The international TIMSS 2019 Equivalence Study offered the opportunity to explore possible performance differences between a PBT and a tablet assessment in mathematics and science among Dutch primary school students. In the spring of 2017, the TIMSS PBT and tablet test were administered to 532 grade-four Dutch students. Item response theory was used to explore potential mode effects. This exploration revealed no significant differences in the student ability scales between the paper and the tablet tests for mathematics and science. Also, no systematic mode effects were found for the items with high reading demand. A marginal difference was found for girls outperforming boys on the TIMSS tablet test, although no gender differences in achievement were found for the PBT.

Over the last two decades, the educational use of digital devices, including digital assessments, has become a regular feature of teaching in primary education in the Netherlands. However, researchers have not reached a consensus about the so‐called "mode effect," which refers to the possible impact of using computer‐based tests (CBT) instead of paper‐and‐pencil‐based tests (PBT) to assess student performance. Some researchers suggest that the occurrence of a mode effect might be related to the type of device used, the subject being assessed and the characteristics of both the test and the students taking the test. The international TIMSS 2019 Equivalence Study offered the opportunity to explore possible performance differences between a PBT and a tablet assessment in mathematics and science among Dutch primary school students. In the spring of 2017, the TIMSS PBT and tablet test were administered to 532 grade‐four Dutch students. Item response theory was used to explore potential mode effects. This exploration revealed no significant differences in the student ability scales between the paper and the tablet tests for mathematics and science. Also, no systematic mode effects were found for the items with high reading demand. A marginal difference was found for girls outperforming boys on the TIMSS tablet test, although no gender differences in achievement were found for the PBT. [ABSTRACT FROM AUTHOR]

In this paper, we present an escape box as a means to introduce the escape room concept into classrooms. Recreational escape rooms have inspired teachers all over the world to adapt the popular entertainment activity for education. Escape rooms are problem‐based and time‐constrained, requiring active and collaborative participants, a setting that teachers want to achieve in their classroom to promote learning. This paper explores the adaptation of the escape room concept into educational escape game boxes. These technology‐enhanced escape boxes have become hybrid learning spaces, merging individual and collaborative learning, as well as physical and digital spaces. The design of the box with assignments on each side puts users face to face with each other and requires them to collaborate in the physical world, instead of being individually absorbed in a digital world. The developed box is a unique concept in the field of escape rooms; the content is adaptable. This paper describes the process leading to the design criteria, the design process, test results and evaluation, and provides recommendations for designing educational escape rooms. [ABSTRACT FROM AUTHOR]

This paper describes a dataset consisting of longitudinal data gathered in the BRXXX project. The aim of the project was to investigate the effectiveness of online mathematics mini-games in enhancing primary school students' multiplicative reasoning ability (multiplication and division). The dataset includes data of 719 students from 35 primary schools in the Netherlands, who were followed from end Grade 1 to end Grade 3. Participating schools were randomly divided over three experimental conditions (playing at school, at home or at home with debriefing at school) and a control group. Tests of multiplicative reasoning ability were administered at the end of Grade 1 (pretest) and the end of Grade 2 and Grade 3 (posttests). In addition to the scores on these tests, the dataset includes measures of gameplay behavior, ie, the time and effort students put in the games, and some student background variables. [ABSTRACT FROM AUTHOR]

This paper describes a dataset with data from three individually randomized educational technology experiments on differentiation, formative testing and feedback during one school year for a group of 8th grade students in the Netherlands, using administrative data and the online motivation questionnaire of Boekaerts. The dataset consists of pre- and posttest scores for each experiment, as well as background information on the students, such as gender, age, ability, grade repetition and neighborhood characteristics. It also includes motivation of students. The dataset, or parts of it, could be interesting to use in future studies, focusing on effects of the use of educational technology, for comparison with similar and/or slightly different experiments, and for studies such as meta-analyses or replication studies, especially given the individual experimental setup. [ABSTRACT FROM AUTHOR]

This paper reports a study aimed at revealing special-educational-needs pupils' learning potential by means of an ICT-based assessment including a dynamic visual tool that might help pupils when solving mathematics problems. The study focused on subtraction problems up to 100, which require ‘borrowing’. These problems, in which the value of the ones-digit of the subtrahend is larger than the ones-digit of the minuend, are known as a serious difficulty for weak pupils in mathematics. Seven of such problems from a standardised test were placed in the ICT environment. Data were collected from two test conditions: the standardised written test format and the ICT version of the test items including the tool that provided pupils with a set of virtual manipulatives. The 37 pupils involved in the study were 8–12 years old and from two special-education schools in the Netherlands. Comparison of the performance scores in the two formats showed that an ICT-based assessment format, including a dynamic visual tool, can reveal weak pupils' learning potential and strategy use. The study also pointed out that ‘partial-tool use’, ie, not carrying out the complete subtraction operation with the tool, can provide sufficient support to find the correct answer. [ABSTRACT FROM AUTHOR]

This paper explored the effects of in-class-level differentiation by making innovative use of an interactive whiteboard (SMARTboard) on math proficiency. Therefore, this paper evaluates the use of SMARTboard in class, in combination with teacher training, using a randomized field experiment among 199 pre-vocational students in seventh grade in the Netherlands. During 6 weeks, students in the intervention group participated in math classes in which the SMARTboard was used to apply level differentiation. The teachers of these classes received a specific training (Technological Pedagogical and Content Knowledge [TPACK]) in using the SMARTboard in class. Control classes were taught by teachers without the training, who did not use the SMARTboard in class. The results showed that level differentiation in class, which was possible because of the efficient use of the SMARTboard, significantly increased math proficiency with 0.25 points.

The GOALS study ( Grootschalig Onderzoek naar Activiteiten van Limburgse Scholieren [ Large-scale Research of Activities in Dutch Students]) was set up to investigate possible associations between different forms of physical activity and inactivity with cognitive performance, academic achievement and mental well-being. It was conducted at a secondary school in the south of the Netherlands. Data collection took place during normal school weeks from October 2011 to March 2012, and 1 year later from October 2012 to May 2013. The study was approved by the local Ethical Committee of the Open University of the Netherlands. All students in grades 7 and 9 of senior general secondary education and university preparatory education were invited to participate ( n = 526). At baseline, a sample of 440 Dutch-speaking adolescents was willing to participate (83.7%). Of these, 344 participated in the follow-up. Physical activity was measured objectively by an Activ Pal3TM accelerometer (Paltechnologies, Glasgow, UK). Cognitive performance was measured by the d2 Test of Attention and the Symbol Digit Modalities Test. Academic achievement was determined using the mean of school grades in Dutch, English and Mathematics. Several well-validated instruments were used to determine mood/depressive symptoms, self-esteem and goal orientation. Information on several covariates such as sex, academic year, school level, ethnicity, socio-economic status, body mass index, pubertal status, smoking, drinking, viewing television, computer use, etc., are available. [ABSTRACT FROM AUTHOR]

This paper explores the effect of digital differentiation on student performance using a randomized experiment. The experiment is conducted in a second year biology class among 115 prevocational students in the Netherlands. Differentiation allowed students in the treatment group to work at three different levels. The results show that there is a significant effect of digital differentiation on the posttest score. This effect is robust to adding covariates such as students' ability, grade repetition, age, gender, class and average neighborhood income. There are no differential effects when dividing students in three groups, by ability. The results imply that differentiation in large classrooms is possible and beneficial for all students, once done digitally.

This paper describes a dataset with data from three individually randomized educational technology experiments on differentiation, formative testing and feedback during one school year for a group of 8th grade students in the Netherlands, using administrative data and the online motivation questionnaire of Boekaerts. The dataset consists of pre- and posttest scores for each experiment, as well as background information on the students, such as gender, age, ability, grade repetition and neighborhood characteristics. It also includes motivation of students. The dataset, or parts of it, could be interesting to use in future studies, focusing on effects of the use of educational technology, for comparison with similar and/or slightly different experiments, and for studies such as meta-analyses or replication studies, especially given the individual experimental setup.

This paper describes a dataset consisting of longitudinal data gathered in the BRXXX project. The aim of the project was to investigate the effectiveness of online mathematics mini-games in enhancing primary school students' multiplicative reasoning ability (multiplication and division). The dataset includes data of 719 students from 35 primary schools in the Netherlands, who were followed from end Grade 1 to end Grade 3. Participating schools were randomly divided over three experimental conditions (playing at school, at home or at home with debriefing at school) and a control group. Tests of multiplicative reasoning ability were administered at the end of Grade 1 (pretest) and the end of Grade 2 and Grade 3 (posttests). In addition to the scores on these tests, the dataset includes measures of gameplay behavior, i.e., the time and effort students put in the games, and some student background variables.

The authors present the methodological background to and underlying research design of an ongoing research project on the scientific evaluation of serious games and/or computer-based simulation games (SGs) for advanced learning. The main research questions are: (1) what are the requirements and design principles for a comprehensive social scientific methodology for the evaluation of SGs?; (2) to what extent do SGs contribute to advanced learning?; (3) what factors contribute to or determine this learning?; and (4) to what extent and under what conditions can SG-based learning be transferred to the real world? In the Netherlands between 2005 and 2012, several hundred SG sessions with 12 SGs were evaluated systematically, uniformly and quantitatively to create a dataset, which comprises data on 2488 respondents in higher education or work organizations. The authors present the research model, the quasi-experimental design and the evaluation instruments. This focus in this paper is on the methodology and dataset, which form a sound foundation for forthcoming publications on the empirical results.

This paper reports on a controlled experiment on the effects of three types of reflection triggers in an online course. Fifty-four volunteers, distributed in five groups, used these structured opportunities for reflection during learning. Results show that reflection triggers were extensively employed by the test persons and were perceived as quite useful to reflection and learning. Test persons in the experimental groups reported significantly more reflective prompting and more intensive reflection than those in the control group. In contrast, no positive effects on learner performance and retention could be established. This paradox elicits different possible explanations, which are discussed in the light of the common pedagogical claim that more thoughtful approaches to learning should be promoted. (Contains 2 figures and 3 tables.)

This paper reports a study aimed at revealing special-educational-needs pupils' learning potential by means of an ICT-based assessment including a dynamic visual tool that might help pupils when solving mathematics problems. The study focused on subtraction problems up to 100, which require "borrowing". These problems, in which the value of the ones-digit of the subtrahend is larger than the ones-digit of the minuend, are known as a serious difficulty for weak pupils in mathematics. Seven of such problems from a standardised test were placed in the ICT environment. Data were collected from two test conditions: the standardised written test format and the ICT version of the test items including the tool that provided pupils with a set of virtual manipulatives. The 37 pupils involved in the study were 8-12 years old and from two special-education schools in the Netherlands. Comparison of the performance scores in the two formats showed that an ICT-based assessment format, including a dynamic visual tool, can reveal weak pupils' learning potential and strategy use. The study also pointed out that "partial-tool use", i.e., not carrying out the complete subtraction operation with the tool, can provide sufficient support to find the correct answer.