Search

This study set out to examine the range of legibility demonstrated by Western Australian students required to handwrite tasks of increasing intrinsic cognitive load. A representative sample of students in Years 1, 2 and 3 (N=437) was recruited for a cross sectional study and teachers administered handwriting tasks. Year 1 students were administered easier tasks (copying from the board and dictation), and Year 3 students were administered more difficult tasks (dictation and composition), whilst students in Year 2 were administered all three tasks. A rubric was then constructed for six aspects of legibility from selected participant exemplars: letter formation, size, space in word, space between words, line placement, and slant, providing 18 items for analysis (3 tasks x 6 aspects). The rubric demonstrated acceptable inter- and intra-reliability. Scores were assigned following pairwise comparisons; a Rasch model (RM) analysis was applied to scores. Fit to the RM was confirmed to permit a more accurate assessment of legibility. The study substantiates many assumptions about handwriting in the extant literature, and more specifically reveals how cognitive load governs legibility when students are learning to handwrite. Implications for practice are discussed.

Even though guessing biases difficulty estimates as a function of item difficulty in the dichotomous Rasch model, assessment programs with tests which include multiple-choice items often construct scales using this model. Research has shown that when all items are multiple-choice, this bias can largely be eliminated. However, many assessments have a combination of multiple-choice and constructed response items. Using vertically scaled numeracy assessments from a large-scale assessment program, this article shows that eliminating the bias on estimates of the multiple-choice items also impacts on the difficulty estimates of the constructed response items. This implies that the original estimates of the constructed response items were biased by the guessing on the multiple-choice items. This bias has implications for both defining difficulties in item banks for use in adaptive testing composed of both multiple-choice and constructed response items, and for the construction of proficiency scales.

Recent research has shown how the statistical bias in Rasch model difficulty estimates induced by guessing in multiple-choice items can be eliminated. Using vertical scaling of a high-profile national reading test, it is shown that the dominant effect of removing such bias is a nonlinear change in the unit of scale across the continuum. The consequence is that the proficiencies of the more proficient students are increased relative to those of the less proficient. Not controlling the guessing bias underestimates the progress of students across 7 years of schooling with important educational implications.

This study explores the development, description, and illustration of inherent requirement (IR) statements to make explicit the requirements for performance on an initial teacher education (ITE) practicum. Through consultative group processes with stakeholders involved in ITE, seven IR domains were identified. From interviews with academics, first-person narratives (vignettes) were developed to illustrate pre-service teachers' performance in complex professional practice scenarios. The narratives were rated by university staff and pre-service teachers in relation to three of the IR domains: self-awareness, social awareness, and sustained professional conduct. Narratives were placed along a continuum of performance using Rasch-model statistical analysis. The findings suggest that the IR domains and the narratives illustrating them could be valuable resources for making explicit required performance standards. The findings suggest that the development of explicit IR statements has the potential to improve all stakeholders' awareness of professional practice requirements and enhance course outcomes for all ITE students.

This paper presents results of an investigation into the relationship between Kenyan Sign Language (KSL) and English literacy skills. It is derived from research undertaken towards an MEd degree awarded by The University of Western Australia in 2011. The study employed a correlational survey strategy. Sixty upper primary deaf students from four residential schools for the hearing impaired participated in the tests that evaluated their KSL proficiency and English literacy skills. KSL skills were tested using an adapted American Sign Language Proficiency Assessment tool while the English literacy skills were evaluated using a combination of five selected sub-tests of the "Test of Reading Comprehension-Fourth Edition" ("TORC 4") and the "Test of Written Language-Fourth Edition" ("TOWL 4"). Additional data were collected from participants' audiograms and a questionnaire completed by parents. Data were analysed using the "Statistical Package for the Social Sciences" (SPSS) computer software package. A significant positive correlation was found between participants' proficiency in KSL and their English literacy scores. The results suggested KSL has a role to play in English literacy acquisition.

The psychometric properties of the General Functioning subscale of the McMaster Family Assessment Device were examined using the Rasch Model (N = 237 couples). Mothers' and fathers' ratings of the General Functioning subscale of the McMaster Family Assessment Device are recommended, provided these are analyzed separately. More than a quarter of couples differed significantly in their ratings.

Andersen (1995, 2002) proves a theorem relating variances of parameter estimates from samples and subsamples and shows its use as an adjunct to standard statistical analyses. The authors show an application where the theorem is central to the hypothesis tested, namely, whether random guessing to multiple choice items affects their estimates in the Rasch model. Taking random guessing to be a function of the difficulty of an item relative to the proficiency of a person, the authors describe a method for creating a subsample of responses, which is least likely to be affected by guessing. Then using Andersen's theorem, the authors assess the difference in difficulty estimates between responses from the whole sample and the subsample for each item. To demonstrate the effectiveness of the procedure, data are simulated according to a class of models in which random guessing is a function of the proficiency of a person relative to the difficulty of an item. The procedure is also applied to an empirical data set from Raven's Advanced Progressive Matrices, with the results indicating that guessing is present in a substantial number of items. It is noted that one especially important application in which estimating the correct relative difficulty of items is required is where the items will form part of an item bank and where on subsequent occasions the items will be administered interactively. In this case, items too difficult for a person are not administered and therefore unlikely to attract random guessing. (Contains 3 tables and 6 figures.)

Models of modern test theory imply statistical independence among responses, generally referred to as "local independence." One violation of local independence occurs when the response to one item governs the response to a subsequent item. Expanding on a formulation of this kind of violation as a process in the dichotomous Rasch model, this article generalizes the dependence process to the case of the unidimensional, polytomous Rasch model. It then shows how the magnitude of this violation can be estimated as a change in the location of thresholds separating adjacent categories in the second item caused by the response dependence on the first. As in the dichotomous model, it is suggested that this index is relatively more tangible in interpretation than other indices of dependence that are either a weight in the interaction term in a model or a correlation coefficient. One function of this method of assessing dependence is likely to be in the development of tests and assessment formats where evidence of the magnitude of dependence of one item on another in a pilot study can be used as part of the evidence in deciding which items will be retained in a final version of a test or which formats might need to be reconstructed. A second function might be to identify the magnitude of response dependence that may then need to be taken into account in some other way, perhaps by applying a model that takes account of the dependence. (Contains 1 figure and 6 tables.)