Search

Beginning in 2002, researchers developed, implemented, and evaluated the efficacy of an English reading intervention for first-grade English learners using multiple randomized control trials (RCTs). As a result of this efficacy work, researchers successfully competed for an IES Goal 4 effectiveness study using the same intervention. Unlike the efficacy studies, the findings from the effectiveness study begun in 2011 did not yield significant differences in favor of the treatment. We investigated the identification and pre-intervention performance levels of students in efficacy and effectiveness RCT studies and provide data and compare samples from these studies as one means of explaining variation in findings. Findings indicate that pre-intervention performance levels are higher for students in effectiveness RCT studies. This article serves as an exemplar for other effectiveness studies that may not replicate findings from previous efficacy trials.

We investigate the impact of a relatively brief cross-curricular intervention, Word Generation, on middle school students' development of taught academic vocabulary. Students (n = 8382) in forty-four middle schools in three urban districts were randomly assigned to treatment or control conditions. Treatment teachers implemented the program with minimal support and varying levels of commitment. Students in treatment schools scored almost a point higher on the curriculum-based vocabulary posttests than those in control schools (Hedges's g = 0.094, p < 0.05). Though there was no main treatment effect on the standardized measures of students' general vocabulary knowledge or reading comprehension, baseline-by-treatment interactions at the school and student level acted to attenuate the Matthew Effect in reading and vocabulary growth.

Difficulties suppressing previously encountered but currently irrelevant information from working memory characterize less skilled comprehenders in studies in which they are matched to skilled comprehenders on word decoding and nonverbal IQ. These "extreme" group designs are associated with several methodological issues. When sample size permits, regression approaches permit a more accurate estimation of effects. Using data for students in Grades 6 through 12 (n = 766), regression techniques assessed the significance and size of the relation of suppression to reading comprehension across the distribution of comprehension skill. After accounting for decoding efficiency and nonverbal IQ, suppression, measured by performance on a verbal proactive interference task, accounted for a small amount of significant unique variance in comprehension (less than 1%). A comparison of suppression in less skilled comprehenders matched to more skilled comprehenders (48 per group) on age, word reading efficiency, and nonverbal IQ did not show significant group differences in suppression. The implications of the findings for theories of reading comprehension and for informing comprehension assessment and intervention are discussed.

The goal of this study was to assess the effectiveness of an intervention--Quality English and Science Teaching 2--designed to help English language learners (ELLs) and their English proficient classmates develop academic language in science, as required by the Common Core State Standards. The intervention consisted of supplementary instructional materials and professional development. Participants included 1,309 students, of whom 353 were ELLs. Sixty sections taught by 15 teachers in seven middle schools were randomized within teacher to the intervention or the control condition. Treatment effects were tested separately for academic language and science knowledge. For the whole group, results indicated posttest differences favoring the treatment group sections were statistically significant for academic language and science. For ELLs however, posttest differences favored the treatment group for academic language only. Follow-up analyses investigating implementation found that treatment fidelity was related to gains in both academic language and science knowledge for the group as a whole and for ELLs. Effect sizes suggest the intervention was promising in promoting the academic language in science of both ELLs and their English proficient classmates.

This study compared the effects on reading outcomes of delivering supplemental, small-group intervention to first-grade students at risk for reading difficulties randomly assigned to one of three different treatment schedules: extended (4 sessions per week, 16 weeks; n = 66), concentrated (4 sessions per week, 8 weeks; n = 64), or distributed (2 sessions per week, 16 weeks; n = 62) schedules. All at-risk readers, identified through screening followed by 8 weeks of oral reading fluency (ORF) progress monitoring, received the same Tier 2 reading intervention in groups of 2 to 4 beginning in January of Grade 1. Group means were higher in word reading and ORF at the final time point relative to pretest; however, the groups did not differ significantly on any reading outcome or on rates of adequate intervention response. Of potential covariates, site, age, free lunch status, program coverage rate, and tutor were significantly related to student outcomes; however, the addition of these variables in multivariate models did not substantially change results. Rates of adequate intervention response were lower than have been reported for some first-grade interventions of longer duration. (Contains 3 tables.)

The goal of this study was to assess the effectiveness of an intervention--Quality English and Science Teaching (QuEST)--designed to develop the science knowledge and academic language of middle grades English language learners studying science in their second language and their English-proficient classmates. Ten sixth-grade science teachers in 5 middle schools in a large south Texas district participated in the study. For each teacher, 2 sections were randomly assigned to the intervention, Project QuEST, and 2 sections were randomly assigned to the district curriculum. The sample of students included English language learners, former English language learners, and fluent English-speaking students. Treatment effects were tested separately for science knowledge and vocabulary using a 3-level multilevel analysis of covariance (students nested within section, sections nested within teacher, and teacher) with the analogous pretest serving as the covariate. Analyses included fixed effects of treatment assignment and the covariate. Treatment effects were tested at the level of the section. Results indicated that posttest differences favoring the treatment group sections were statistically significant for both science knowledge and vocabulary. (Contains 5 tables, 1 figure and 7 footnotes.)

Two experimental studies to improve vocabulary knowledge and comprehension were conducted in 7th-grade social studies classes with English language learners (ELLs). Two different nonoverlapping samples of classes of 7th-grade students (N = 381 and N = 507) were randomly assigned at the classroom (i.e., section) level to a social studies intervention or to business as usual comparison groups. The number of sections assigned to treatment was 7 and 9 in Experiments 1 and 2, respectively. Eight sections were assigned to comparison in each experiment. In addition, students were randomly assigned to sections prior to assignment of sections to treatment and control. Treatment students received a multicomponent social studies instruction including explicit vocabulary instruction, use of structured pairing, strategic use of video to build concepts and promote discussion, and use of graphic organizers for approximately 12 weeks daily during social studies class. Findings indicated significant differences in favor of the treatment students on curriculum-based vocabulary and comprehension measures for both experimental studies for all students including students who were ELLs. (Contains 5 tables.)

We provide data 3 to 4 years postintervention for four samples of English language learners from two sequential Grade 1 cohorts who received supplemental Grade 1 reading interventions in Spanish or English and for whom the language of instruction for intervention was matched with language of core reading instruction. Participants were 300 students at risk for reading difficulties who were randomly assigned to intervention or comparison groups; there were 186 students from the four samples assessed in both languages (Spanish, English) 3 or 4 years after intervention completion (Spring Grade 4 or 5). Findings from the Spanish study revealed few statistically significant differences in favor of intervention students on Spanish measures, although effect sizes generally favored this group (median d = +0.33). Findings from the English study also revealed few statistically significant differences in favor of intervention students, though again, effect sizes were positive (median d = +0.23). Transfer effects were generally small, though nearly all were positive. Although the effects were small, receipt of intervention in Grade 1 was associated with clinically significant gains in a variety of literacy-related domains 3 to 4 years after the termination of supplemental instruction. (Contains 5 tables and 3 figures.)

We investigate the impact of a relatively brief cross-curricular intervention, Word Generation, on middle school students' development of taught academic vocabulary. Students (n = 8382) in forty-four middle schools in three urban districts were randomly assigned to treatment or control conditions. Treatment teachers implemented the program with minimal support and varying levels of commitment. Students in treatment schools scored almost a point higher on the curriculum-based vocabulary posttests than those in control schools (Hedges's g = 0.094, p < 0.05). Though there was no main treatment effect on the standardized measures of students' general vocabulary knowledge or reading comprehension, baselineby- treatment interactions at the school and student level acted to attenuate the Matthew Effect in reading and vocabulary growth. [ABSTRACT FROM AUTHOR]