Search

We examined semiotic exchangeability in pop-up glossary translations and illustrations used as supports for second language learners (SLLs) in computer-administered mathematics tests. In a sample of 516 mathematics items, Grades 3-8 and 11, from a large-scale assessment program in the US, test developers identified terms that could be translated and terms that could be illustrated without altering the target constructs. In each item, we examined: number of unique words (w), number of unique terms identified for translation (t), and number of unique terms identified for illustration (i.) Of the 3,186 terms identified for translation or for illustration, only about one sixth were identified both for translation and for illustration. We observed statistically significant "w" and "t" differences attributable to the main effect of depth of knowledge and type of item and statistically significant "i" differences attributable to the main effect of type of item. The correlation of item translatability (T = t/w) and item illustratability (I = i/w) was low for all items combined but higher and statistically significant for some types of items and for greater values of depth of knowledge. We conclude that translation and illustration pop-up glossaries are functionally different sets of semiotic resources that support SLLs in different ways.

This paper is concerned with fair and valid testing. It reports on a long-term project aimed at creating visual accessibility resources in mathematics computer-administered test items in a large-scale assessment system. We discuss our experience designing and developing pop-up illustration glossaries (IGs) for second language learners (SLLs) -- students who are not native users of the predominant language in the society in which they live, are typically schooled in that predominant language, and face the challenge of learning content and demonstrating knowledge in a language that is not their first language. An IG is a visual representation of a word/term identified as likely to be linguistically challenging to a substantial proportion of SLL test takers and which appears on the screen when the test taker clicks on that word/term. Because they interact with the user, IGs are more sensitive than other accessibility resources to students' individual needs -- a characteristic that addresses the linguistic heterogeneity of SLL populations. We discuss the extent to which IGs contribute to ensuring valid, fair assessment for SLL students, and the implications of the lessons learned for improving assessment systems.

We address valid testing for English language learners (ELLs)--students in the United States who are schooled in English while they are still acquiring English as a second language. Also, we address the need for procedures for systematically developing ELL testing accommodations--changes in tests intended to support ELLs to gain access to the content of items. We report our experience developing and investigating illustration-based accommodations for ELLs in terms of five main activities: specification, design, production, evaluation, and revision. Our findings indicate that, to benefit from a given accommodation, ELLs need to possess certain skills that enable them to use it but that are not related to the knowledge assessed. Critical to developing effective accommodations is examining how their properties interact with the characteristics of the students and the characteristics of test items.

We examined semiotic exchangeability in pop-up glossary translations and illustrations used as supports for second language learners (SLLs) in computer-administered mathematics tests. In a sample of 516 mathematics items, Grades 3–8 and 11, from a large-scale assessment program in the US, test developers identified terms that could be translated and terms that could be illustrated without altering the target constructs. In each item, we examined: number of unique words (w), number of unique terms identified for translation (t), and number of unique terms identified for illustration (i.) Of the 3,186 terms identified for translation or for illustration, only about one sixth were identified both for translation and for illustration. We observed statistically significant w and t differences attributable to the main effect of depth of knowledge and type of item and statistically significant i differences attributable to the main effect of type of item. The correlation of item translatability (T = t/w) and item illustratability (I = i/w) was low for all items combined but higher and statistically significant for some types of items and for greater values of depth of knowledge. We conclude that translation and illustration pop-up glossaries are functionally different sets of semiotic resources that support SLLs in different ways. [ABSTRACT FROM AUTHOR]

This paper is concerned with fair and valid testing. It reports on a long-term project aimed at creating visual accessibility resources in mathematics computer-administered test items in a large-scale assessment system. We discuss our experience designing and developing pop-up illustration glossaries (IGs) for second language learners (SLLs) – students who are not native users of the predominant language in the society in which they live, are typically schooled in that predominant language, and face the challenge of learning content and demonstrating knowledge in a language that is not their first language. An IG is a visual representation of a word/term identified as likely to be linguistically challenging to a substantial proportion of SLL test takers and which appears on the screen when the test taker clicks on that word/term. Because they interact with the user, IGs are more sensitive than other accessibility resources to students' individual needs – a characteristic that addresses the linguistic heterogeneity of SLL populations. We discuss the extent to which IGs contribute to ensuring valid, fair assessment for SLL students, and the implications of the lessons learned for improving assessment systems. [ABSTRACT FROM AUTHOR]