Search

The public narrative surrounding efforts to improve low-performing K-12 schools in the United States has been notably gloomy. But what is known empirically about whether school improvement works, which policies are most effective, which contexts respond best to intervention, and how long it takes? We meta-analyze 141 estimates from 67 studies of post-No Child Left Behind Act turnaround policies. On average, policies had moderate positive effects on math and no effect on English Language Arts achievement on high-stakes exams. We find positive impacts on low-stakes exams and no evidence of harm on non-test outcomes. Extended learning time and teacher replacements predict greater effects. Contexts serving majority-Latina/o populations saw the largest improvements. We cannot rule out publication bias entirely but find no differences between peer-reviewed versus non-peer-reviewed estimates.

Critics of test-based accountability warn that test preparation has a negative influence on teachers' instruction due to a focus on procedural skills. Others advocate that the adoption of more rigorous assessments may be a way to incentivize more ambitious test preparation instruction. Drawing on classroom observations and teacher surveys, we do find that test preparation activities predict lower quality and less ambitious mathematics instruction in upper-elementary classrooms. However, the magnitudes of these relationships appear smaller than the prevailing narrative has warned. Further, our findings call into question the hypothesis that test rigor can serve as a lever to elevate test preparation to ambitious teaching. Therefore, improving the quality of mathematics instruction in the midst of high-stakes testing likely will require that policymakers and school leaders undertake comprehensive efforts that look beyond the tests themselves.

The public narrative surrounding efforts to improve low-performing K-12 schools in the United States has been notably gloomy. But what is known empirically about whether school improvement works, which policies are most effective, which contexts respond best to intervention, and how long it takes? We meta-analyze 141 estimates from 67 studies of post-No Child Left Behind Act turnaround policies. On average, policies had moderate positive effects on math and no effect on English Language Arts achievement on high-stakes exams. We find positive impacts on low-stakes exams and no evidence of harm on nontest outcomes. Extended learning time and teacher replacements predict greater effects. Contexts serving majority-Latina/o populations saw the largest improvements. We cannot rule out publication bias entirely but find no differences between peer-reviewed versus nonpeerreviewed estimates. [ABSTRACT FROM AUTHOR]

Critics of test-based accountability warn that test preparation has a negative influence on teachers’ instruction due to a focus on procedural skills. Others advocate that the adoption of more rigorous assessments may be a way to incentivize more ambitious test preparation instruction. Drawing on classroom observations and teacher surveys, we do find that test preparation activities predict lower quality and less ambitious mathematics instruction in upper-elementary classrooms. However, the magnitudes of these relationships appear smaller than the prevailing narrative has warned. Further, our findings call into question the hypothesis that test rigor can serve as a lever to elevate test preparation to ambitious teaching. Therefore, improving the quality of mathematics instruction in the midst of high-stakes testing likely will require that policymakers and school leaders undertake comprehensive efforts that look beyond the tests themselves. [ABSTRACT FROM AUTHOR]