Search

Educational researchers conduct studies to gather critical empirical evidence in the determination of what are "evidence-based" curricular programs, which in turn, directly inform adoption efforts. The predominate method of validating these programs is through the use of group experimental designs, although single-case designs have also been advocated. This article posits the current standards set forth when validating curricular programs using single-case designs are significantly lacking. We propose an expansion of the existing standards to ensure a rigorous, accurate examination of curricular programs when determining their use as an evidence-based practice. We apply these standards to a subset of studies reviewed by McKenna, Kim, Shin, and Pfannenstiel (2017) in a recent evaluation of single-case reading intervention investigations including students with and at risk for emotional and behavioral disorders. Using our expanded standards, we found none of the 14 studies met quality standards for curricular program validation. Recommendations are discussed.

Students with writing difficulties may have difficulty when writing informational text with source material due to (a) inexperience with such text and (b) difficulties reading and understanding source material. Teaching students to take notes related to informational text using text structures (e.g., description, compare/contrast) may help them access source text and improve planning and organization of their ideas. Two pilot studies examining the usability, feasibility, and promise of a note-taking and text structure intervention are presented in this manuscript. In study 1, the researchers employed a multiple-probe design across three 4th grade participants with reading difficulties. In study 2, the researchers employed an underpowered experimental design, comparing the intervention to a narrative-based reading and writing strategies. Fidelity of implementation was acceptable to high in both studies, indicating preservice teachers find it useable and it is feasible to implement the lessons within the 30-minute time frame. However, there were mixed results of the intervention on note-taking outcomes. In study 1, a functional relation was demonstrated for two of three participants for the note-taking measure. In study 2, the intervention group did not statistically outperform the control group on the note-taking measure, but there was a non-significant effect size of 0.75 between the groups. The findings, though mixed, warrant further study of the intervention in a fully powered study. Results on reading outcomes for both studies are also discussed.

Expository writing may be especially difficult for elementary grade students due to lack of background knowledge and unfamiliar text structures. A text structure writing intervention aimed at teaching students to write informational text using text structures has been shown to have promise for improving the informational text writing of upper elementary grade students using small group instruction ("Reading and Writing," 31, 2115-2145; "Reading and Writing: An Interdisciplinary Journal," 31, 2165-2190; "Learning Disabilities: A Multidisciplinary Journal," 23, 35-55.). There are disadvantages to small group instruction, however, because it requires additional resources. In the current study, 41 students in grade 4 were randomly assigned to receive the "Structures Writing" intervention or BAU narrative writing instruction. Both groups received instruction in a large group setting. At posttest, students who received the "Structures Writing" intervention statistically significantly outperformed the control group on researcher-created measures of simple description, compare/contrast, sequence, problem-solution, and cause-effect writing. Results indicated no differences between on distal reading outcomes. The intervention components completed within the allotted time-frame were completed with a high degree of fidelity (97%), providing an indicator of usability. However, students only fully completed 57% of lesson activities, indicating that it is not feasible to complete the lessons within a 30-min time frame. The discussion highlights the "Structures Writing" intervention as a promising approach for improving informational text writing skills of fourth grade students with moderate to large effect sizes that support findings of a prior pilot test. A larger efficacy trial is warranted following revision of the lessons to shorten lesson duration.

We investigated the extent to which working memory and behavioral attention predicted reading and listening comprehension in grades 1 through 3 and, whether their relative contributions differed by modality and grade. Separate grade samples (N = 370; ns = 125, 123, and 122 for grades 1, 2, and 3 respectively) completed multiple measures of word reading, working memory, and parallel measures of reading and listening comprehension. Teachers and parents provided behavioral attention ratings. Concurrently, working memory was more important for listening than for reading comprehension and predicted significant variance in both modalities across grades, after controlling for background measures and behavioral attention ratings. For both modalities, working memory explained the greatest proportion of variance in grade 3. Behavioral attention predicted variance in grades 1 and 2 for reading comprehension and all grades for listening comprehension. Subsidiary analyses demonstrated that the influence of working memory and behavioral attention on reading comprehension was indirect, through word reading and listening comprehension both concurrently and also longitudinally between grades 1-3. These findings indicate that delivery of classroom materials orally will not always be beneficial to the young beginner reader or one who struggles with word decoding, and that children with poor working memory/attention may require additional support to access meaning from both written and spoken text.

The purpose of this cross-sectional study, conducted with a random sample of 166 students with emotional disturbance (ED), was to establish, with attention to age and gender differences, the extent to which students with ED served in public school settings experience language skill deficits. This study also examined particular types of problem behaviors related to language skills. Students with ED showed moderate to large language deficits, which appeared to be more pronounced in the expressive language domain. The language deficits of a majority of the students were clinically significant. These language deficits appeared to be relatively stable across age and gender. Furthermore, externalizing behaviors were related to receptive and expressive language skills, whereas internalizing ones were not.

In this meta-analysis of 45 studies involving students in Grades 2-12, the authors present evidence on the effects of text structure instruction on the expository reading comprehension of students. The meta-analysis was deigned to answer 2 sets of questions. The first set of questions examined the effectiveness of text structure instruction on proximal measures of comprehension, including examination of potential moderators and effectiveness for students with or at-risk for disabilities. The second set of questions examined the effectiveness on transfer measures of the effectiveness of the intervention across temporal contexts (maintenance), near-contexts (untaught text structures), and far-contexts (general reading comprehension). Overall, the results indicated that text structure instruction improves expository reading comprehension, but the effects were tempered when text structure instruction was compared with stronger comparison groups. The findings also identified 2 moderators that led to increased effect sizes (teaching more text structures and including writing in the instruction). Text structure instruction was also found to be effective across all 3 levels of transfer, although the effects for far-transfer are small and lack consistency. Recommendations include conducting more research to understand the nuances of potential interactions between various instructional approaches and student populations.

Multi-tiered system of supports represents one of the most significant advancements in improving the outcomes of students for whom typical instruction is not effective. While many practices need to be in place to make multi-tiered systems of support effective, accurate implementation of evidence-based practices by individuals at all tiers is critical to obtain student outcomes. Effective strategies to achieve program fidelity are available; however, maintaining program fidelity at the individual level remains elusive. Lessons drawn from medicine indicate strategies to maintain program fidelity should address the implementer. Medical practitioners have used self-monitoring checklists to maintain fidelity with striking results. Research evaluating strategies to maintain program fidelity at the individual level represents an important next step in the field of education. Recommendations for a systematic research agenda focused on self-monitoring checklists are presented.

This systematic descriptive historical review was conducted to examine the status and trends in expository text structure instruction efficacy research for first through twelfth grade students. The analysis included sixty studies, which spanned the years 1978 to 2014. Descriptive dimensions of the research included study type, research design, treatment fidelity, school level, number of participants, service delivery settings, and comprehensiveness of demographic reporting, text structure instruction, and measurement. Researchers primarily used randomized and quasi-experimental research designs. Analysis of results revealed that (a) a relatively large number of text structure efficacy research studies have been conducted, (b) complete demographic information was difficult to ascertain for many of the participants, (c) researchers of few studies instructed students in all five expository text structures, (d) treatment fidelity data were often missing, and (e) researchers rarely used both direct and indirect measures of effects. Limitations of the analysis and future research directions are discussed.

In our previous research (Benner, Nelson, Sanders, & Ralston, 2012), elementary schools were randomly assigned to either a primary-level behavior intervention directed at externalizing behavior (treatment, n = 7 schools) or to business-as-usual condition (control, n = 6 schools). A screening procedure was used to identify K through 3-grade students who exhibited externalizing behavior. The results showed that treatment students (n = 44) exhibited lower levels of problem behavior (ES = -0.99) and higher rates of on-task behavior (ES = 0.61) compared to controls (n = 26). The results also suggested that individual baseline behavior and school context as measured by free and reduced-priced meal rates moderated the findings. Given this latter finding, our interest in the current study was to test whether individual and school aggregate baseline behavior levels moderate students' response to two years of the behavior intervention. Schools originally assigned to treatment continued to implement the intervention during the subsequent academic year; schools in the control condition continued with their business-as-usual behavior management approaches. During the winter of the second year, students who remained in their schools were re-assessed on their behavior (n = 35 and n = 19 in treatment and control conditions, respectively). Analyses involving multilevel context modeling showed that students with relatively high initial baseline behavior levels (pretreatment) were more responsive to the intervention if they were in schools with higher school aggregate baseline behavior levels. Conversely, students tended to be less responsive to intervention if they were in schools with lower school aggregate baseline behavior levels. Limitations and practical implications are discussed. (Contains 2 tables and 1 figure.)

This study examines the longer term effectiveness of a standard protocol, Tier 2 supplemental vocabulary intervention for kindergarten English learners, designed to develop root word vocabulary knowledge and reinforce beginning word reading skills. Participating students in the original study ("n" = 93 treatment, 92 control) received 20 weeks of small group instruction from paraeducator tutors during kindergarten. After attrition, students ("n" = 74 treatment, 66 control) were followed up midyear Grade 1 on English measures of proximal and distal vocabulary as well as word reading. At 6 months postintervention, the treatment benefits were maintained on all three outcomes, and furthermore, there was no evidence to suggest that early receptive vocabulary knowledge moderated longer term treatment effects. Results also showed kindergarten intervention year gains in proximal (i.e., root word) vocabulary uniquely predicted midyear Grade 1 distal vocabulary above and beyond kindergarten gains in distal vocabulary. Implications for English learner early intervention are discussed. (Contains 3 tables and 3 notes.)

This article examined the efficacy of a primary-level, standard-protocol behavior intervention for students with externalizing behavioral disorders. Elementary schools were randomly assigned to treatment (behavior intervention) or control (business as usual) conditions, and K-3 students were screened for externalizing behavior risk status. The final sample included 7 treatment schools (n = 44 students) and 6 control schools (n = 26 students). Results of multilevel models showed that students with externalizing behavior in the treatment schools had significantly lower levels of problem behavior than those in the control schools. A positive but statistically nonsignificant treatment trend was observed for increased on-task behavior. No effects were observed for academic skills. The positive effects of the behavior intervention were smaller in schools serving higher proportions of students with low socioeconomic status and for students who had higher baseline levels of externalizing behavior. The discussion includes the results, practical importance, and limitations. (Contains 4 tables and 2 figures.)

The purpose of this study was to test the efficacy of a Tier 2 standard protocol supplemental intervention designed simultaneously to develop root word vocabulary and reinforce decoding skills being taught to all students in the core beginning reading program with kindergarten Spanish-speaking English learners (ELs). Participating students were drawn from six public elementary schools in the Midwest. Within classrooms, students were randomly assigned to either the supplemental intervention (treatment) or the specified control condition (i.e., used to control for instructional time and consistency). All instruction in both conditions was delivered by paraeducator tutors and occurred in small groups for approximately 20 min a day, 5 days a week, for 20 weeks (October to April). At posttest, treatment students (n = 93) in the experimental condition significantly outperformed controls (n = 92) on a proximal (i.e., linked directly with the instructional focus of the intervention) measure of root word vocabulary (d = 1.04) and word reading (d = 0.69). Treatment students did not significantly outperform controls on a distal (i.e., not linked directly to the instructional focus of the intervention) measure of reading vocabulary (d = 0.38). The results, practical importance, and limitations are discussed. (Contains 3 tables.)

The purpose of this study is to examine the extent to which two specific elements of fidelity of implementation (i.e., adherence and quality of delivery) enhanced or constrained the effects of a reading intervention for middle school students experiencing reading difficulties. A total of 281 middle school students with reading difficulties received an intensive reading intervention (i.e., Corrective Reading Decoding strand) delivered by trained school staff (n = 21) at three middle schools. Although students receiving the Corrective Reading Decoding strand made statistically significant (p less than 0.001) improvements in their basic reading skills and passage comprehension overall, variations in student gains were found. Overall fidelity of implementation accounted for 22% and 18% of the variance in the gains in basic reading skills and passage comprehension of middle school students with reading difficulties, respectively (p less than 0.05). Two teacher actions, following the lesson format as designed and reteaching lessons when needed, predicted student basic reading and passage comprehension skills above and beyond other teacher actions (p less than 0.05). Results, implications, and limitations are discussed. (Contains 2 tables and 1 figure.)

The findings of a meta-analysis of the effect of reading instruction on the reading skills of students with or at risk of behavioral disorders (BD) are reported. The goal of the synthesis was to extend the work of Coleman and Vaughn by (a) detailing independent variables and outcome measures for each study, (b)including studies sampling from students with or at risk of BD, (c) analyzing study outcomes using average effect size estimates as a common metric, and (d) summarizing literature on reading interventions conducted with students with or at risk of BD over nearly four decades (from 1970 to present). Results of the review suggest that effective literacy instruction has a positive effect on the reading skills of students with or at risk of BD. Limitations and future directions are presented. (Contains 4 tables.)

Within 3-tier behavioral models, universal interventions are expected to prevent the onset of problem behavior in a majority of children altogether and to sustain improvements in child outcomes by the selected and indicated interventions. A cohort longitudinal design was used to assess the extent to which a 3-tier model achieves these expected outcomes. The respective universal, selected, and indicated interventions included Behavior and Academic Support and Enhancement, First Step to Success, and MultiSystemic Therapy. A total of 407 children in Grades K-3 from 1 of 4 longitudinal cohorts participated. The results of 2-level linear growth analyses indicate that the 3-tier behavior model achieved the anticipated outcomes with respect to social behavior. The results, limitations, and implications are discussed. (Contains 2 figures and 6 tables.)

Building on research showing the interdependence of language skills and reading proficiency, this study examined the effects of using the "Language Arts" strand of the "Reading Mastery Signature" 2008 series program as a supplement to non-Direct Instruction reading programs with English Language Learner (ELL) students. Seventy-six kindergarten through fifth-grade ELL students received the intensive intervention delivered by trained school staff (n = 5) at three elementary schools. Multiple classroom-based fidelity of implementation monitoring demonstrated that the Language Arts strand was well taught on a consistent basis by all teachers and paraprofessionals. Statistically significant gains were made in the word recognition, oral reading accuracy, silent reading comprehension, spelling, and word meaning percentile ranks of participants from pre- to posttest (p less than 0.01). Absolute change and effect size estimates (see Gresham, 2005) indicated reliable changes in the reading and language skills of participants. Results, implications, and future research priorities were discussed. (Contains 2 tables.)

This study describes the academic, social, and behavioral performance of elementary and secondary students with emotional and behavioral disorders (EBD) receiving services in a self-contained school for students with serious behavior problems, with an emphasis on how school adjustment and problem behavior patterns predict academic performance. Results revealed that elementary and secondary group scores were well below the 25th percentile on reading, math, and written expression measures. Further, a seven variable model representing academic, social, and behavioral domains was able to differentiate between age groups explaining 54% of the variance and correctly classifying 78.26% (n = 18) of the elementary students and 84.21% (n = 16) of the secondary students. Findings also suggested that behavioral variables (e.g., school adjustment, externalizing, and internalizing) were predictive of broad reading and broad written expression scores, with school adjustment (a protective factor) accounting for the most variance in the three-variable model. Limitations and recommendations for future research are addressed.

The results from previous research suggest that there is a relatively small (albeit statistically significant) relationship between the externalizing behavior and academic skills of students with emotional disturbance (ED). Researchers have also found that the majority of these students have language deficits that hinder their academic performance. The purposes of this study were to investigate the mediating role of academic processing speed (i.e., academic fluency) on the relationship between: (a) The externalizing behavior and academic skills of K-12 students with ED; and (b) language skills and academic skills of students with ED. Results indicate that academic processing speed mediated the influence of both language skills and externalizing behavior on academic skills of this population. The findings, limitations, and implications were discussed.

Multinomial stepwise logistic regression analyses were used to establish the most robust set of risk factors that would best predict low basic reading skills (i.e., a standard score less than 85 on the Woodcock Reading Mastery Test-Revised Basic Reading Skills cluster) of kindergarten and first-grade children at risk for emotional and behavioral disorders. Results showed that among the 11 risk factor domains considered, four were most predictive of low reading skills: demographic characteristics, childhood maladjustment, family functioning, and maternal depression. Within these four domains, the most robust set of individual risk factors were gender, history of psychiatric hospitalization, abusive to animals, and maternal depression. Results, limitations, and implications are discussed. (Contains 3 tables.)

This study examined the convergent validity of the parent and teacher versions of the Early Childhood Behavior Problem Screening Scale (ECBPSS) with the Child Behavior Checklist (CBCL) and the Caregiver-Teacher Report Form (C-TRF), respectively. Data were collected on a sample of preschool and kindergarten students (n = 149) from two medium-sized cities in the Midwest. Analyses of both the parent and teacher versions of the ECBPSS were correlated with the corresponding Internalizing, Externalizing, and Total Problem scale scores of the CBCL and the C-TRF. The present findings and future research directions and limitations are discussed. (Contains 3 tables.)

Secondary schools--be they middle schools or high schools--are reading-rich environments. Secondary schools provide contexts in which students must regularly read and write competently to demonstrate their literacy achievement. In any given semester, there are short stories and novels to read, comprehend, and analyze; civics and science texts whose content must be mastered; math problems that must be understood and then successfully solved; and even high-stakes tests that must be passed for advancement or graduation to take place. It is for these and other reasons that addressing the likely reading deficits of secondary students with emotional and behavioral disorders (EBD) takes on urgency in middle and high school settings. In this article, the authors provide research-based and practical suggestions for secondary teachers who are faced with educating students with EBD. The authors briefly describe the reading skills of secondary students with EBD, reading research designed to improve these reading skills, and a theoretical framework from which to formulate classroom and schoolwide reading intervention for students with EBD. (Contains 2 figures.)

Logistic regression analyses were used to establish the most robust set of risk factors that would best predict borderline/clinical levels of problem behavior (i.e., a t score at or above 60 on the Child Behavior Checklist Total Problem scale) of kindergarten and first-grade children at risk for emotional and behavioral disorders. Results showed that among the 11 risk factor domains considered, 5 were most predictive of borderline/clinical levels of problem behavior: externalizing behavior pattern, internalizing behavior pattern, early childhood child maladjustment, family functioning, and maternal depression. Within these 5 domains, the most robust set of individual risk factors were difficult child (i.e., temperament, parent management skills, interaction between temperament and parent management skills), destroys own toys, and maternal depression. Results, limitations, future research, and implications are discussed. (Contains 3 tables.)

As prevention and early intervention opportunities for young children at risk of emotional disturbance (ED) increase, questions regarding the effectiveness of these programs for specific subpopulations of children have emerged. To date, few investigators have examined young children entering early school prevention/intervention programs to determine if clear subpopulations can be identified, and if so, which characteristics are most distinguishing. This study examined the risk factors of 140 kindergarten and first-grade students, identified by teachers as at risk of ED, to determine if distinct profiles exist. Cluster analysis procedures using teacher, child, and parent reports of family, academic, and social/emotional data revealed five distinct clusters: Parent nominated (n = 24), Elevated risks (n = 43), Primarily behavior (n = 25), Primarily academic (n = 27), and False positives (n = 21). Validation techniques revealed that the five clusters were distinguished by clear profiles, which differed across level of severity (i.e., high or low levels of risk per domain) and primary focus of risk (i.e., academic, social/emotional, or familial). Similarities and differences across cluster groups, possible implications for targeted prevention or early intervention programs, study limitations, and directions for future research are presented. (Contains 3 tables and 1 figure.)

There is growing interest in understanding the factors that influence the academic achievement of students with emotional disturbance (ED). Structural equation modeling was used to test the interrelationships among language skills, externalizing behavior, and academic fluency and their impact on the academic skills of students with ED. Results showed that language skills exerted a significant proximal effect and distal effect on academic skills. The effect of language skills was mediated through academic fluency (path coefficient = 0.389) but also had a proximal effect on academic skills (path coefficient = 0.359). However, externalizing behavior failed to have a statistically significant effect on language skills, academic fluency, or academic skills. Overall, fit indices suggested a marginally acceptable fit of the data. Results and implications are discussed.

A descriptive study of 22 students (K-10th grade) with emotional and behavioral disabilities (EBD) who were referred for functional behavioral assessment (FBA) revealed less on-task and more avoidant and inappropriate behaviors in comparison to classroom peers without EBD. Students who had been diagnosed as having attention-deficit/hyperactivity disorder and were taking psychotropic medications had higher levels of inappropriate behavior. However, sequential analysis showed that individual variation in teacher and peer attention as consequent events best predicted students' inappropriate behavior. These findings indicate that individual differences in the consequent events that purportedly maintain problem behavior are unique to the student, as proponents of FBA have suggested.

The purpose of this study was to investigate the effects of a cohesive and intensive preventive prereading intervention on the phonological awareness, word reading, and rapid naming skills of children at risk of emotional disturbance and reading problems. Thirty-six children were assigned randomly to an experimental or comparison condition. Children in the experimental condition received "Stepping Stones to Literacy". "Stepping Stones" includes 25 lessons designed to teach children pivotal prereading skills (e. g., phonological awareness, letter identification). Children in the experimental condition showed statistically significant improvements in their phonological awareness, word reading, and rapid naming skills relative to children in the comparison condition. Effect size estimates indicate that the improvements were moderate to large across all of the phonological awareness, word reading, and rapid naming measures. Treatment nonresponder analyses indicated that a relatively small number of children in the experimental group failed to show satisfactory gains in their phonological awareness (n = 3), word reading (n = 1), and rapid naming (n = 3) skills.