Search

The onset of the pandemic in spring 2020 substantially disrupted routes into teaching and offered a unique opportunity to study this process with different requirements for initial entry into the classroom. We examine the impacts of the Temporary Certificate of Eligibility (Temporary CE), which allowed teacher candidates in New Jersey to enter the workforce before completing assessment and performance requirements. Relative to the novice teacher workforce before the pandemic, Temporary CE teachers were substantially more diverse without any significant effects on teacher performance or student test scores. However, Temporary CE holders were less likely to remain in the same school or in the New Jersey teaching workforce between 2020-21 and 2021-22. Although Temporary CE holders disproportionately entered through alternate routes into teaching, these patterns hold for both traditional- and alternate-route entrants.

This study examines the extent to which students obtain postsecondary credentials in the career technical education (CTE) fields of focus they choose in high school. Using school fixed effects models, we find that focusing on a particular CTE field in high school is associated with an increased probability of enrolling and obtaining a postsecondary credential in that field. The secondary-postsecondary relationship varies across focus areas, and it is strongest in health (increase of 12.5 percentage points), which is disproportionately chosen by females. Across all fields of focus, however, most students enroll and obtain a postsecondary credential in fields that are different from what they focused on in high school.

This paper examines the impact of Teach For America (TFA) on following-year student test and non-test outcomes in Miami-Dade County Public Schools. This paper measures the extent to which exposure to TFA is followed by improved student outcomes in the future. In particular, this paper measures days missed due to absences or suspensions, course grades in each core subject, and progression in math courses. We find that students taught by TFA math teachers go on to have higher grades in math courses in the following year and are less likely to miss school due to being absent or suspended. However, while students in TFA classrooms score higher on math and ELA assessments in a given year, these test score gains fade out by the following year.

Student-teacher relationships are at the core of student experiences in schools and, arguably, fundamental to influencing student outcomes. Using a statewide, student-level school climate survey from Massachusetts, we investigate teachers' contributions to school climate, which we refer to as climate value added (VA), and how it varies by student race/ethnicity. We first show that climate VA contributes to student learning: Teachers whose students report positive feelings about climate also contribute more to student test scores and to an aggregate of nontest student outcomes (student absences, suspensions, and grade progression). And teachers identified by students of color as contributing to better school climate have outsize effects on learning gains for these students. Differences in teachers' climate effects across racial/ethnic groups are largest on topics aligned with cultural competency, school participation, and comfort with faculty. Lastly, we find that Black students assigned to Black teachers report better school climate than Black students assigned to other teachers.

We examine how different measures of teacher quality are related to students' long-run trajectories. Comparing teachers' "test-based" value-added to "nontest" value-added -- based on contributions to student absences and grades -- we find that test and nontest value-added have similar effects on the average quality of colleges that students attend. However, test-based teacher quality measures have more explanatory power for outcomes relevant for students at the top of the achievement distribution such as attending a more selective college, while nontest measures have more explanatory power for whether students graduate from high school and enroll in college at all.

Taking advanced courses in high school predicts a broad array of positive postsecondary and labor market outcomes. Yet students from historically disadvantaged groups and low-income backgrounds have long been underrepresented in these courses. To address this problem, more than 60 districts in Washington state implemented a policy that automatically enrolled all qualified high school students in advanced coursework. The policy relied on a simple behavioral nudge: It made advanced courses "opt out" rather than "opt in" for all qualified students. The districts implemented the policy in waves, beginning in the 2014-15 school year. In this descriptive paper, we examine enrollment patterns by comparing districts that adopted the policy at different times. We found that students in districts that implemented the policy between 2014-15 and 2016-17 were more likely to enroll in at least one advanced course in any subject relative to students in districts without the policy. This was the case for students who "qualified" for advanced courses based on their test scores and for students whose scores did not qualify them for advanced courses. We also found that the policy was associated with a higher probability of enrollment in advanced mathematics courses but only for qualified students. Qualified students across demographic groups experienced similar changes in the probability of advanced course enrollments. But among all students--regardless of qualified status--enrollments in advanced mathematics and advanced English language arts/social studies courses increased more for students from racial/ethnic groups underrepresented in advanced courses and for students who were eligible for free or reduced-price lunch (FRPL) than for non-underrepresented students and students not eligible for FRPL. These across the board increases in advanced course enrollment for students who were historically underrepresented in these courses suggests that districts may have looked beyond standardized assessment scores to identify students for automatic enrollment.

In this descriptive study, we use longitudinal student-level administrative records from 4 cohorts of high school graduates in Kentucky to examine the extent to which students persist and attain post-secondary credentials in the CTE fields of concentration they choose in high school. To our knowledge, this is the first paper to use student-level administrative data to examine how different fields of concentration in high school CTE are related to future postsecondary outcomes. We find that concentrating in a particular CTE field in high school is associated with both continuing on with that same field in college and obtaining a postsecondary credential in that field; this relationship is especially strong in health fields and especially for women in health. The secondary-postsecondary connection is the weakest among students concentrating in occupational fields in high school, who are also the most disadvantaged socioeconomically and academically before high school. Despite the existence of secondary-postsecondary pipelines of career interests, most students enroll and obtain credentials in fields that are "different" from the field of concentration in high school. In addition, relative to students with similar pre-high-school achievement as measured by grades and test scores, we find that CTE concentration in high school is strongly associated with being more likely to enroll in a two-year college and less likely to enroll in a four-year college.

What does it mean for students to be in a gifted program? While about 7% of students nationally participate in gifted programs, relatively little is known about the experiences of students in these programs or how they vary across districts. Combining administrative and survey data, we describe the structure of gifted programs across nearly 300 school districts in Washington State. Using covariate adjustments and student fixed effects, we find that participation in gifted programs increases access to advanced courses, high-achieving peers, smaller classrooms, and more qualified teachers. These effects are largely concentrated in larger urban and suburban school districts that frequently run large, self-contained gifted programs. Effects of participation are much smaller for small school districts, rural or town school districts, and districts with small gifted programs. While gifted participation changes the educational environment for the average student in the state, the median school district program effect is near zero across the measures of educational environments we consider. This divergence is driven by a pattern of large school districts, high-income school districts, and urban and suburban school districts having programs with significantly larger effects on learning environments. Finally, we find that gifted program effects are larger for some student subgroups, but this is entirely due to district treatment effect heterogeneity, not differential effects on subgroups within districts.

A number of school districts and states have implemented transition intervention programs designed to help high school students graduate ready for college. This study estimates the effectiveness of a transition program implemented statewide in Kentucky for high school seniors called Targeted Interventions (TI). Using 11 years of linked panel data, this study tracks the college progression of seven cohorts of students as they move from high school into college. Using a difference-in-regression discontinuity design, we estimate the program's impact on college credit attainment and transfer as well as the extent to which the program has helped reshape pathways through college. We find that the TI program significantly increased the likelihood that students would take at least 15 credits during the first term in college, a key measure that has been shown to be predictive of college completion. These early effects, however, do not translate into statistically significant impacts on the likelihood of transfers from a 2-year to a 4-year college, or the likelihood of earning enough credits to graduate from college. We discuss some possible explanations for why the TI program did not lead to observable improvements in college transfer or credit accumulation.

Prior work has documented a substantial penalty associated with taking the Partnership for Assessment of Readiness for College and Careers (PARCC) online relative to on paper (Backes & Cowan, 2019). However, this penalty does not necessarily make online tests less useful. For example, it could be the case that computer literacy skills are correlated with students' future ability to navigate high school coursework, and thus more predictive of later outcomes. Using a statewide implementation of PARCC in Massachusetts, we test the relative predictive validity of online and paper tests. We are unable to detect a difference between the two and in most cases can rule out even modest differences. Finally, we estimate mode effects for the new Massachusetts statewide assessment. In contrast to the first years of PARCC implementation, we find very small mode effects, showing that it is possible to implement online assessments at scale without large online penalties.

This study adds to the currently limited evidence base on the efficacy of interventions targeting non-college-ready high school students by examining the impact of Kentucky's Targeted Interventions (TI) program. We focus on interventions that students received under TI in the senior year of high school based on their 11th grade ACT test scores. Using difference-in-regression discontinuity and difference-in-difference designs with seven cohorts of 11th grade students, we find that, for an average per-student cost of about $600, TI significantly reduces the likelihood that students enroll in remedial course in both 2- and 4-year postsecondary institutions by 5-10 percentage points in math and 3-4 percentage points in English. These effects are similar among students who are eligible for free-or reduced-price lunch, Black and Hispanic students, students with remediation needs in multiple subjects, and students in lower-performing schools. Evidence also shows that TI increases the likelihood that students enroll in and pass college math before the end of the first year by four percentage points in 4-year universities. However, little evidence exists for TI affecting credit accumulation or persistence.

Nearly two dozen states now administer online exams. These tests have real consequences: their results feed into accountability systems, which have been used for more than a decade to hold schools and districts accountable for their students' learning. We examine the rollout of computer-based testing in Massachusetts over 2 years to investigate test mode effects. Crucial to the study design is the fact that the state administers the same exam (PARCC) in online and offline formats each year during the transitional period. We find mode effects of about 0.10 standard deviations in math and 0.25 standard deviations in English language arts (ELA). Our preferred estimates of the effects of online testing in the second year of administration suggest that mode effects for second-time test takers were about one third as large as the first year in math and about half as large in ELA. There is little evidence of systematic variation in mode effects by student demographic groups, although on ELA tests they are larger for students scoring at the bottom of the achievement distribution.

UTeach is a well-known, university-based program designed to increase the number of high-quality science, technology, engineering, and mathematics (STEM) teachers in the workforce. The UTeach program was originally developed by faculty at the University of Texas at Austin but has rapidly spread and is now available at 44 universities in 21 states; it is expected to produce more than 9,000 math and science teachers by 2020. Despite substantial investment and rapid program diffusion, there is little evidence to date about the effectiveness of UTeach graduates. Using administrative data from the state of Texas, we measure UTeach impacts on student test scores in math and science in middle schools and high schools. We find that students taught by UTeach teachers perform significantly better on end-of-grade tests in math and end-of-course tests in math and science by 5% to 12% of a standard deviation on the test, depending on grade and subject. The effect is larger for the founding site at the University of Texas at Austin than for replication UTeach sites, with estimated upper bounds of additional months of learning for students taught by UTeach Austin graduates of 4.0 months in high school math and 5.7 months in high school science. Controlling for the selectivity of the undergraduate institution appears to explain the differential between Austin and replication UTeach sites, but not the overall difference between UTeach and non-UTeach teachers. [Financial support was provided from the Institute of Education Sciences to Southwest Educational Development Corporation, an affiliate of American Institutes of Research.]

Public Impact's "Opportunity Culture" (OC) initiative provides a suite of models aimed at extending the reach of highly effective teachers and has partnered with school districts to implement these interventions in schools. Using administrative data from three partner school districts that collectively include 44 OC schools, we estimate the relationship between OC staffing models and student achievement in math and reading. We find that the bulk of exposed students received treatment under OC's multiclassroom leadership model, in which a master teacher with demonstrated effectiveness intensively leads and coaches a team of teachers, and that these students scored higher in math in all specifications. In reading, while most specifications find positive and significant learning gains for students taught by team teachers, the specification that performs best in our placebo tests--one that includes school-by-year fixed effects to account for overall improvement in treatment schools--does not find any impact. Results for other specifications are more mixed and are imprecisely estimated.

Policies that require the use of information about student achievement to evaluate teacher performance are becoming increasingly common across the United States, but there is some question as to how or whether to use student test-based teacher evaluations when student assessments change. We bring empirical evidence to bear on this issue. Specifically, we examine how estimates of teacher value-added are influenced by assessment changes across 12 test transitions in two subjects and five states. In all of the math transitions we study, value-added measures from test change years and stable regime years are broadly similar in terms of their statistical properties and informational content. This is also true for "some" of the reading transitions; we do find, however, some cases in which an assessment change in reading meaningfully alters value-added measures. Our study directly informs contemporary policy debates about how to evaluate teachers when new assessments are introduced and provides a general analytic framework for examining employee evaluation policies in the face of changing evaluation metrics. [This paper was published in "Economics of Education Review" v62 p48-65 2018.]

UTeach is a well-known, university-based program designed to increase the number of high-quality science, technology, engineering, and mathematics (STEM) teachers in the workforce. The UTeach program was originally developed by faculty at the University of Texas at Austin but has rapidly spread and is now available at 44 universities in 21 states; it is expected to produce more than 9,000 math and science teachers by 2020. Despite substantial investment and rapid program diffusion, there is little evidence to date about the effectiveness of UTeach graduates. Using administrative data from the state of Texas, we measure UTeach impacts on student test scores in math and science in middle schools and high schools. We find that students taught by UTeach teachers perform significantly better on end-of-grade tests in math and end-of-course tests in math and science by 5% to 12% of a standard deviation on the test, depending on grade and subject. The effect is larger for the founding site at the University of Texas at Austin than for replication UTeach sites, with estimated upper bounds of additional months of learning for students taught by UTeach Austin graduates of 4.0 months in high school math and 5.7 months in high school science. Controlling for the selectivity of the undergraduate institution appears to explain the differential between Austin and replication UTeach sites, but not the overall difference between UTeach and non-UTeach teachers.

Most public school teachers in the United States are enrolled in defined benefit (DB) pension plans. Using administrative micro data from four states, combined with national pension funding data, we show these plans have accumulated substantial unfunded liabilities -- effectively debt -- owing to previous plan operations. On average across 49 state plans, an amount that exceeds 10 percent of current teachers' earnings is being set aside to pay for previously-accrued pension liabilities. To the extent that the costs of the unfunded liabilities drag on teacher compensation, they may exacerbate problems of teacher recruitment and retention. We briefly discuss three policy changes that could end or reduce the accumulation of unfunded liabilities in educator pension plans: (1) transition teachers to defined-contribution retirement plans; (2) transition teachers to cash-balance retirement plans; and (3) tighten the link between funding and benefit formulas within the current defined-benefit structure.

Retaining effective teachers is a key policy priority nationwide, particularly in districts that serve large numbers of disadvantaged students. We investigate whether a change in the Miami region's placement strategy was accompanied by changes in teacher attrition and mobility decisions. Our results suggest that the increased concentration of TFA corps members in schools was associated with a reduction in TFA mobility across schools after the first year of service, but showed no association with the overall retention of corps members in the district after the two-year commitment. We also find that TFA corps members eventually retained beyond the two-year commitment performed substantially better in mathematics during their first two years of teaching: evidence of positive selection into post-commitment retention. [This paper was published in "Educational Evaluation and Policy Analysis" v38 n3 p495-516 2016 (EJ1108469).]

Using administrative longitudinal data from five states, we study how value-added measures of teacher performance are affected by changes in state standards and assessments. We first document the stability of teachers' value-added rankings during transitions to new standard and assessment regimes and compare our findings to stability during stable standard and assessment regimes. We also examine the predictive validity of value-added estimates during nontransition years over transition-year student achievement. In most cases we find that measures of teacher value added are similarly stable in transition years and nontransition years. Moreover, there is no evidence that the level of disadvantage of students taught disproportionately influences teacher rankings in transition years relative to stable years. In the states we study, student achievement in math can consistently be forecasted accurately--although not perfectly--using value-added estimates for teachers during stable standards and assessment regimes. There was somewhat less consistency in reading, because we find cases where test transitions significantly reduced forecasting accuracy.

We examine the extent to which clustering large numbers of Teach For America (TFA) corps members in a limited number of low-performing schools was accompanied by changes in teacher mobility decisions. Using longitudinal data from Miami-Dade spanning six school years, augmented with survey responses from TFA's own Alumni Survey for cohorts placed in the Miami region, we use Cox proportional hazards models and multinomial logit decision models in a modified difference-in-difference (DD) framework. Our results suggest that the increased concentration of TFA corps members in schools was associated with a reduction in TFA mobility across schools after the first year of service, but it did not affect the overall retention of corps members in the district after the two-year commitment. In addition, we find evidence suggesting non-TFA teachers in schools with a relatively high proportion of TFA corps members were significantly more likely to leave the district. We also find that TFA corps members retained beyond the two-year commitment performed substantially better in mathematics during their first two years of teaching: evidence of positive selection into postcommitment retention. Finally, we produce steady-state estimates of the minimum TFA effects necessary for the district to prefer hiring a TFA corps member relative to a non-TFA hire. TFA corps members in the district exceed this minimum value in both reading and mathematics.