Search

One of the controversies surrounding charter schools is whether these schools may either “cream skim” high-performing students from traditional public schools or “pushout” low-achieving students or students with discipline histories, leaving traditional public schools to educate the most challenging students. In this study, we use longitudinal statewide data from Tennessee and North Carolina and linear probability models to examine whether there is evidence consistent with these selective enrollment practices. Because school choice programs managed by districts (magnet and open enrollment programs) have a similar ability to cream skim and pushout students, we also examine these outcomes for these programs. Across the various school choice programs, magnet schools have the most evidence of cream skimming, but this might be expected as they often have selective admissions. For charter schools, we do not find patterns in the data consistent with cream skimming, but we do find evidence consistent with pushout behaviors based on discipline records. Finally, some have raised concerns that students may be pushed out near accountability test dates, but our results suggest no evidence consistent with this claim.

Many public school diversity efforts rely on reassigning students from one school to another. While opponents of such efforts articulate concerns about the consequences of reassignments for students’ educational experiences, little evidence exists regarding these effects, particularly in contemporary policy contexts. Using an event study design, we leverage data from an innovative socioeconomic school desegregation plan to estimate the effects of reassignment on reassigned students’ achievement, attendance, and exposure to exclusionary discipline. Between 2000 and 2010, North Carolina’s Wake County Public School System (WCPSS) reassigned approximately 25 percent of students with the goal of creating socioeconomically diverse schools. Although WCPSS’s controlled school choice policy provided opportunities for reassigned students to opt out of their newly reassigned schools, our analysis indicates that reassigned students typically attended their newly reassigned schools. We find that reassignment modestly boosts reassigned students’ math achievement, reduces reassigned students’ rate of suspension, and has no offsetting negative consequences on other outcomes. Exploratory analyses suggest that the effects of reassignment do not meaningfully vary by student characteristics or school choice decisions. The results suggest that carefully designed school assignment policies can improve school diversity without imposing academic or disciplinary costs on reassigned students.

Summer learning loss is a perennial concern for educators and parents alike. However, researchers have recently questioned whether summer learning loss is just a statistical artifact driven by how achievement is measured across the school year. In this study, we empirically investigated a plausible critique of summer learning loss research, namely that students do not put forth their best effort on the fall test compared with the spring test. While we cannot conclude based on our findings that students do in fact lose ground during the summer, we did not find evidence that seasonal differences in test effort are a main driver of summer learning patterns estimated with MAP Growth assessments.

Using a dataset that includes over 17 million students from across all 50 states, we estimate the causal impact of making structural transitions into middle school (in grades 4, 5, 6, or 7) on student math and reading achievement trajectories. This dataset provides an ideal opportunity to engage in the valuable scientific practice of conducting replication studies. Prior research on the impacts of middle school transitions is of high quality and rests on a strong causal warrant, but the study settings vary greatly and use data from a prior decade. We conduct a replication (i.e., using the same methods on different data) using larger, broader, and more recent data. We extend prior analyses in ways that may further strengthen the causal warrant. Finally, we explore heterogeneity of effects across subgroups and states, which may help reconcile differences in the magnitude of estimated effects across studies.

The Equality of Educational Opportunity Study (1966)—the Coleman Report—lodged a key takeaway in the minds of educators, researchers, and parents: Schools do not strongly shape students’ achievement outcomes. This finding has been influential to the field; however, Coleman himself suggested that—had longitudinal data been available to him—decomposing the variance in students’ growth rates rather than their levels of achievement would have provided a clearer insight into school effects. Inspired by an intriguing finding from an earlier study conducted in 1988 by Bryk and Raudenbush, we take up Coleman’s suggestion using data provided by NWEA, which has administered over 200 million vertically scaled assessments across all 50 states since 2008. We replicated Bryk and Raudenbush’s surprising finding that most of the variation in student learning rates lies between rather than within schools. For students moving from Grades 1 through 5, we found 75% (math) to 80% (English language arts) of the variance in achievement rates is at the school level. We find similar results in preliminary analyses of data from the Early Childhood Longitudinal Study-Kindergarten Class 1998-99 (ECLS-K:99). These results are intriguing because they call into question one of the dominant narratives about the extent to which schools shape students’ achievement; however, more research is needed. Our goal is to invite other scholars to conduct similar analyses in other data contexts. We delineate four key dimensions along which results need to be further probed, first and foremost with an eye toward the role of test score scaling practices, which may be of central importance.

Summer learning loss (SLL) is a familiar and much-studied phenomenon, yet new concerns that measurement artifacts may have distorted canonical SLL findings create a need to revisit basic research on SLL. Though race/ethnicity and socioeconomic status only account for about 4% of the variance in SLL, nearly all prior work focuses on these factors. We zoom out to the full spread of differential SLL and its contribution to students’ positions in the eighth-grade achievement distribution. Using a large, longitudinal NWEA data set, we document dramatic variability in SLL. While some students actually maintain their school-year learning rate, others lose nearly all their school-year progress. Moreover, decrements are not randomly distributed—52% of students lose ground in all 5 consecutive years (English language arts).

How should schools assign students to more rigorous math courses so as best to help their academic outcomes? We identify several hundred California middle schools that used 7th-grade test scores to place students into 8th-grade algebra courses and use a regression discontinuity design to estimate average impacts and heterogeneity across schools. Enrolling in 8th-grade algebra boosts students’ enrollment in advanced math in ninth grade by 30 percentage points and eleventh grade by 16 percentage points. Math scores in tenth grade rise by 0.05 standard deviations. Women, students of color, and English-language learners benefit disproportionately from placement into early algebra. Importantly, the benefits of 8th-grade algebra are substantially larger in schools that set their eligibility threshold higher in the baseline achievement distribution. This suggests a potential tradeoff between increased access and rates of subsequent math success.

In the wake of political and legal challenges facing race-based integration, districts have turned to socioeconomic integration initiatives in an attempt to achieve greater racial balance across schools. Empirically, the extent to which these initiatives generate such balance is an open question. In this article, we leverage the school assignment system that the Wake County Public School System employed throughout the 2000s to provide evidence on this issue. Although our results show that Wake County Public School System’s socioeconomic-based assignment policy had negligible effects on average levels of segregation across the district, it substantially reduced racial segregation for students who would have attended majority-minority schools under a residence-based assignment policy. The policy also exposed these students to peers with different racial/ethnic backgrounds, higher mean achievement levels, and more advantaged neighborhood contexts. We explore how residential context and details of the policy interacted to produce this pattern of effects and close the article by discussing the implications of our results for research and policy.

Schools utilize an array of strategies to match curricula and instruction to students’ heterogeneous skills. While generations of scholars have debated “tracking” and its consequences, the literature fails to account for diversity of school-level sorting practices. In this paper we draw upon the work of Sorenson (1970) to articulate and develop empirical measures of five distinct dimensions of school cross-classroom tracking systems: (1) the degree of course differentiation, (2) the extent to which sorting practices generate skills-homogeneous classrooms, (3) the rate at which students enroll in advanced courses, (4) the extent to which students move between tracks over time, and (5) the relation between track assignments across subject areas. Analyses of longitudinal administrative data following 24,000 8th graders enrolled in 23 middle schools through the 10th grade indicate that these dimensions of tracking are empirically separable and have divergent effects on student achievement and the production of inequality.

State and federal accountability policies are predicated on the ability to estimate valid and reliable measures of school impacts on student learning. The typical spring-to-spring testing window potentially conflates the amount of learning that occurs during the school year with learning that occurs during the summer. We use a unique dataset to explore the potential for students’ summer learning to bias school-level value-added models used in accountability policies and research on school quality. The results of this paper raise important questions about the design of performance-based education policies, as well as schools’ role in the production of students’ achievement.

The Every Student Succeeds Act (ESSA) changed federal teacher policy in a number of important ways. This article uses No Child Left Behind (NCLB), Race to the Top, NCLB waivers, and ESSA to detail these shifts. Since ESSA is in the early phase of implementation, we analyze the policy through the lens of previous empirical work as a way of anticipating how the various components of the law may function. The goal is to understand how the policy differs from previous federal efforts, detail the theory of action of teacher policy under ESSA, and provide concrete ways for educational leaders to implement the law. We find that ESSA focuses on the distribution of highly effective teachers and allows states more autonomy to define teacher quality.

We utilize state data of nearly 1.7 million students in Ohio to study a specific sector of online education: K–12 schools that deliver most, if not all, education online, lack a brick-and-mortar presence, and enroll students full-time. First, we explore e-school enrollment patterns and how these patterns vary by student subgroups and geography. Second, we evaluate the impact of e-schools on students’ learning, comparing student outcomes in e-schools to outcomes in two other schooling types, traditional charter schools and traditional public schools. Our results show that students and families appear to self-segregate in stark ways where low-income, lower achieving White students are more likely to choose e-schools while low-income, lower achieving minority students are more likely to opt into the traditional charter school sector. Our results also show that students in e-schools are performing worse on standardized assessments than their peers in traditional charter and traditional public schools. We close with policy recommendations and areas for future research.

This article analyzes the Every Student Succeeds Act of 2015 and the evolving role of the federal government in educational policy. We rely on John Kingdon’s policy window framework to evaluate how key political constituencies on both the political right and left pressured Congress to limit both the executive branch and federal roles in educational policy. We find that policies during the Obama Administration shifted political attitudes on key issues and within key constituencies that had previously supported a stronger federal role. We conclude with a discussion of how this shift in federal education policy can yield insights applicable to other policy areas and also how this informs the current direction of federal–state relations.

Black and poor students are suspended from U.S. schools at higher rates than White and nonpoor students. While the existence of these disparities has been clear, the causes of the disparities have not. We use a novel data set to examine how and where discipline disparities arise. By comparing the punishments given to Black and White (or poor and nonpoor) students who fight one another, we address a selection challenge that has kept prior studies from identifying discrimination in student discipline. We find that Black and poor students are, in fact, punished more harshly than the students with whom they fight.

This article analyzes how the Obama administration used executive power to grant waivers from federal education policies and assesses whether they used this power differently than previous administrations and in other sectors (e.g., health or welfare). The executive use of waivers to shape state policy is not a new trend. However, we find that recent education waivers differ in purpose and specificity from past education waivers, as well as waivers in other social policy arenas, and that the Obama administration is using this executive power to further its policy objectives in ways that often circumvent congressional intent. As the executive branch continues to utilize waivers as a policy lever, this research has important implications for the future of federal involvement in educational policy and provides critical background for Congress’s reaction to waivers in the recently reauthorized Elementary and Secondary Education Act.

Between 2003 and 2013, the proportion of California eighth graders enrolled in algebra or a more advanced course nearly doubled to 65%. In this article, we consider the organizational processes that accompanied this curricular intensification. Facing a complex set of accountability, institutional, technical/functional, and internal political pressures, California schools responded to the algebra-for-all effort in diverse ways. While some schools detracked by enrolling all eighth graders in algebra, others “tracked up,” creating more advanced geometry opportunities while increasing algebra enrollments. These responses created a new differentiated course structure that is likely to benefit advantaged students. Consistent with the effectively maintained inequality hypothesis, we find that detracking occurred primarily in disadvantaged schools while “tracking up” occurred primarily in advantaged schools.

In recent decades, school choice policies predicated on student mobility have gained prominence as urban districts address chronically low-performing schools. However, scholars have highlighted equity concerns related to choice policies. The case of post-Hurricane Katrina New Orleans provides an opportunity to examine student mobility patterns in a choice-based district. This paper analyzes student mobility between and within the various sectors and school types using a multinomial framework. We find rates of student mobility in post-Katrina New Orleans to be similar to other traditional urban school districts. Overall, our results indicate that high-achieving students switch to high-quality schools whereas low-achieving students transfer to low-quality schools. It is clear some students are taking advantage of the ability to choose a high-quality educational option, although many students are still not. Policy implications, especially for education policy makers implementing or considering school choice policies, and areas for future research are discussed.

Executive leadership of the U.S. Department of Education (USDOE) initiated a flexibility offering from No Child Left Behind. Our work explores specific design decisions made in these state-specific accountability systems as associated with state political environments, resources, and demographic characteristics. Our analysis, focused on 42 states with approved flexibility waivers, provides some evidence that design decisions are associated with prior education policies, political leanings, and financial resources within each state. Policymakers should also take note, as these results suggest that state political factors may influence how state policymakers will react in future negotiations with the USDOE.

The vast majority of literature on school choice, and charter schools in particular, focus on attending an elementary or middle school grades and often focus on test scores or other proximal outcomes. Much less is known about the long-term effects of attending a charter school in 9th grade. It is important to fill this information void for a few reasons. First, schools in general affect more than just students’ test scores. Second, secondary schools (including grades 9–12) make up a larger share of the charter sector. Third, school choice depends on freely available information for parents and students to make informed decisions about where to attend, including potential long-term benefits. We add to the empirical research on charter school effects by using a doubly-robust inverse probability weighted approach to evaluate the impacts of secondary charter school attendance on 9th grade behavioral outcomes and individuals propensity to commit crime and participate in elections as young adults in North Carolina, a state with a large and growing charter school sector.

The TNTP Core Teaching Rubric uses assessments of student behavior, rather than teacher actions, to rate a teacher's instructional practices. In this report, RAND researchers assess whether the TNTP Core Teaching Rubric produces scores that are representative of teachers' overall instructional practices and whether raters' content expertise influence scores on TNTP Core. The report includes recommendations to improve the use of TNTP Core.

RAND researchers assessed whether the TNTP Core Teaching Rubric produces scores that are representative of teachers' overall instructional practices and whether raters' content expertise influences scores on TNTP Core.

The United States is in the midst of an effort to intensify middle school mathematics curricula by enrolling more 8th graders in Algebra. California is at the forefront of this effort, and in 2008, the state moved to make Algebra the accountability benchmark test for 8th-grade mathematics. This article takes advantage of this unevenly implemented policy to understand the effects of curricular intensification in middle school mathematics. Using district-level panel data from all California K–12 public school districts, we estimate the effects of increasing 8th-grade Algebra enrollment rates on a 10th-grade mathematics achievement measure. We find that enrolling more students in advanced courses has negative average effects on students’ achievement, driven by negative effects in large districts.

The relatively low status of teaching as a profession is often given as a factor contributing to the difficulty of recruiting teachers, the middling performance of American students on international assessments, and the well-documented decline in the relative academic ability of teachers through the 1990s. Since the turn of the 21st century, however, a number of federal, state, and local teacher accountability policies have been implemented toward improving teacher quality over the objections of some who argue the policies will decrease quality. In this article, we analyze 25 years of data on the academic ability of teachers in New York State and document that since 1999 the academic ability of both individuals certified and those entering teaching has steadily increased. These gains are widespread and have resulted in a substantial narrowing of the differences in teacher academic ability between high- and low-poverty schools and between White and minority teachers. We interpret these gains as evidence that the status of teaching is improving.

Researchers examined school choice outcomes in New Orleans following 2005's Hurricane Katrina, including exit patterns of students across sectors and school types in New Orleans and the destination schools of mobile students.

To better understand who is taking advantage of e-schools and what effects such choices have on achievement, researchers analyzed data from Ohio, which has authorized e-schools since the early 2000s.

We identify California public middle schools that use a 7th grade achievement threshold to place students into 8th grade Algebra. These schools provide 439 opportunities to estimate regression discontinuity effects of 8th grade Algebra placement. We meta-analyze these effects and find small positive effects on students’ high school math and English achievement, and substantial positive effects on high school math course-taking. Further, our analyses indicate substantial treatment effect heterogeneity across schools. Descriptive analyses suggest a positive relationship between treatment effects and average school student achievement and the location of the placement threshold, and a negative relationship with student poverty.

One of the enduring problems in education is the persistence of achievement gaps between White, wealthy, native English-speaking students and their counterparts who are minority, lower-income, or English language learners. This study shows that one intensive technical assistance (TA) intervention—California’s District Assistance and Intervention Teams (DAITs)—implemented in conjunction with a high-stakes accountability policy improves the math and English performance of traditionally underserved students. Using a 6-year panel of student-level data from California, we find that the DAIT intervention significantly reduces achievement gaps between Black, Hispanic, and poor students and their White and wealthier peers. These results indicate that capacity-building TA helps to close achievement gaps in California’s lowest performing districts.

Forty-two states and the District of Columbia have recently received waivers to the school accountability requirements of the No Child Left Behind Act (NCLB). As the prospects for reauthorizing the Act in the near term are dim, these new accountability systems will be law for at least several years. Drawing on a four-part framework from the measurement literature, we describe and critique the approved waiver accountability plans, comparing them to the NCLB accountability rules. We find a mixed bag—some states have made large improvements and others have not. Overall we conclude that states missed opportunities to design more effective school accountability systems that might minimize negative unintended consequences of these policies. The article concludes with suggestions for state and federal policy in light of the available literature.

This brief summarizes the outcomes of two summers of voluntary academic programming (2013 and 2014) on 3,192 low-income urban students accepted into the programs who had completed third grade before the first summer.

This article uses data from California to analyze the results of the proposed accountability system in the Senate’s Harkin-Enzi draft Elementary and Secondary Education Act reauthorization. The authors analyze existing statewide school-level data from California, applying the accountability criteria proposed in the draft law. Comparing the proposed system to the No Child Left Behind Act’s Adequate Yearly Progress provisions, they draw conclusions about the stability of the proposed identification schemes and the types of schools likely to be identified. They conclude with several policy recommendations that could be easily incorporated into the law, based on their analysis and the existing literature.

The theory of action upon which high-stakes accountability policies are based calls for systemic reforms in educational systems that will emerge by pairing incentives for improvement with extensive and targeted technical assistance (TA) to build the capacity of low-performing schools and districts. To this end, a little discussed and often overlooked aspect of the No Child Left Behind Act (NCLB) mandated that, in addition to sanctions, states were required to provide TA to build the capacity of struggling schools and Local Education Agencies (LEAs, or districts) to help them improve student achievement. Although every state in the country provides some form of TA to its lowest performing districts, we know little about the content of these programs or about their efficacy in improving student performance. In this paper, we use both quantitative and qualitative analyses to explore the actions taken by TA providers in one state—California—and examine whether the TA and support tied to California's NCLB sanctions succeeds in improving student achievement. Like many other states, California requires that districts labeled as persistently failing under NCLB (in Program Improvement year 3, PI3) work with external experts to help them build the capacity to make reforms that will improve student achievement. California's lowest performing PI3 districts are given substantial amounts of funding and are required to contract with state-approved District Assistance and Intervention Teams (DAITs), whereas the remaining PI3 districts receive less funding and are asked to access less intensive TA from non-DAIT providers. We use a five-year panel difference-in-difference design to estimate the impacts of DAITs on student performance on the math and English language arts (ELA) standardized tests relative to non-DAIT TA during the two years of the program intervention. We find that students in districts with DAITs perform significantly better on math California Standards Tests (CSTs) averaged over both treatment years and in each of the first and second years. We do not find evidence that students in districts with DAITs perform higher on ELA CSTs over the combined two years of treatment, although we find suggestive evidence that ELA performance increases in the second year of treatment relative to students in districts with non-DAIT TA. Ordinary least squares (OLS) regressions that explore the association between specific activities fostered by DAITs and changes in districts’ gains in achievement over the two years of treatment show that DAIT districts that report increasing their focus on using data to guide instruction, shifting district culture to generate and maintain high expectations of students and staff, and increasing within-district accountability for student performance, have higher math achievement gains over the course of the DAIT treatment. In addition, DAIT districts that increase their focus on ELA instruction and shift district culture to one of high expectations have higher ELA achievement gains than do DAIT districts that do not have a similar focus. © 2012 by the Association for Public Policy Analysis and Management.

The authors examine how the collective bargaining agreement (CBA) negotiated between teachers’ unions and districts is associated with schools’ and districts’ performance under accountability pressures in California. They find that CBA restrictiveness is associated with the increased likelihood that districts will be in Program Improvement (PI) and at higher levels of PI, and with lower school- and district-level proficiency and graduation rates. They also show that strong contract schools and districts that have higher proportions of minority, low-income, and low-achieving student are even less likely to meet performance targets and have even lower proficiency rates.

Over the past 30 years, in the mass media and educational stakeholder and research communities, there has been increased interest in urban education. A controversial report, A Nation At Risk (National Commission on Excellence in Education, 1983), fueled the current discussion about the underperformance of American schools, especially in urban areas. The attention of countless policies, billions of dollars, and innumerable person hours have been spent trying to fix urban schools. Since the Industrial Revolution, there has been a population boom in America’s urban cities. The majority of individuals now live in urban areas, and these areas have unique economic environmentsenvironments that have adverse effects on education. Considering that economic growth and prosperity are tied to the quality of education within a country (Hanushek & Kimko, 2000), special attention must be given to the unique economic environments that surround students, families, and other education stakeholders in urban areas.