Search

Distractors might display discriminatory power with respect to the construct of interest (e.g., intelligence), which was shown in recent applications of nested logit models to the short-form of Raven&rsquo, s progressive matrices and other reasoning tests. In this vein, a simulation study was carried out to examine two effect size measures (i.e., a variant of Cohen&rsquo, s &omega, and the canonical correlation RCC) for their potential to detect distractors with ability-related discriminatory power. The simulation design was adopted to item selection scenarios relying on rather small sample sizes (e.g., N = 100 or N = 200). Both suggested effect size measures (Cohen&rsquo, only when based on two ability groups) yielded acceptable to conservative type-I-error rates, whereas, the canonical correlation outperformed Cohen&rsquo, in terms of empirical power. The simulation results further suggest that an effect size threshold of 0.30 is more appropriate as compared to more lenient (0.10) or stricter thresholds (0.50). The suggested item-analysis procedure is illustrated with an analysis of twelve Raven&rsquo, s progressive matrices items in a sample of N = 499 participants. Finally, strategies for item selection for cognitive ability tests with the goal of scaling by means of nested logit models are discussed.

Although formative assessment is regarded as a promising way to improve teaching and learning, there is considerable need for research on precisely how it influences student learning. In this study we developed and implemented a formative assessment intervention for mathematics instruction and investigated whether it had effects on students' interest and achievement directly and via students' perception of the usefulness of the feedback and their self-efficacy. We conducted a cluster randomized field trial with pretest and posttest. The 26 participating classes were randomly assigned to a control group or the intervention group. Results of path analyses indicate that feedback was perceived as more useful in the formative assessment condition, self-efficacy was greater, and interest tended to increase; learning progress did not differ between the groups. The assumed indirect effects were partly confirmed: formative assessment showed an indirect effect on interest via its perceived usefulness. (DIPF/Orig.)

Formative assessment has been identi?ed as a promising intervention to support students' learning. How to successfully implement this means of assessment, however, is still an open issue. This study contributes to the implementation of formative assessment by analyzing the impact of a training measure on teachers' formative feedback practice, with a special focus on mediating and moderating variables. Research questions are as follows: (1) Is there an indirect training effect on teachers' instructional feedback practice via (a) teachers' declarative feedback knowledge and (b) the ability to generate feedback in a test situation? (2) Is this indirect effect moderated by teachers' self-efficacy? A total of 67 secondary education mathematics teachers participated in the study, taking part in professional development either on formative assessment and feedback (PD-FA) or on mathematical modelling and problem solving (PD-PM). Training was provided in two sessions (T1 and T2; each lasting 3 days) with 10 weeks in between T1 and T2. Teachers' self-efficacy regarding feedback was measured before T1 with a questionnaire. Declarative feedback knowledge and the ability to apply this knowledge were tested after T2. Teachers' instructional feedback practice was assessed with a student questionnaire (before T1 and 4-6 weeks after T2). Path analyses show that (1) there is no indirect training effect (PD-FA vs. PD-PM) on the development of teachers' feedback practices in mathematics instruction; but an indirect effect on the ability to generate feedback in a test situation via teachers' declarative feedback knowledge. Teachers participating in PD-FA show a higher level of declarative feedback knowledge than teachers in the PD-PM condition. Declarative feedback knowledge in turn is positively related to the ability to generate feedback in a test situation. (2) This indirect effect is moderated by teachers' self-efficacy. Teachers with a high level of self-efficacy are better able to use their knowledge to generate feedback in a test situation than teachers with a low level of self-efficacy. (DIPF/Orig.)