184 results
Search Results
2. Four Years of Pandemic-Era Emergency Licenses: Retention and Effectiveness of Emergency-Licensed Massachusetts Teachers over Time. Working Paper No. 299-0424
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Ben Backes, James Cowan, Dan Goldhaber, and Roddy Theobald
- Abstract
Most states responded to the onset of the pandemic by temporarily granting teachers Emergency licenses. These licenses allowed teachers to work in classrooms without passing the typical licensure exams. Since then, several states have extended their use of Emergency licenses, raising questions about how these policies impact the composition of the teacher workforce and student outcomes. In this paper, we examine the result of these policies using data on multiple cohorts of Emergency licensed teachers (ELTs) who taught in Massachusetts between 2021 and 2023. We find that ELTs were slightly more likely to remain in the same school and in the teaching workforce than teachers from other entry routes. However, ELTs' students scored significantly lower on standardized tests in math and science than other students in the same school and same year. Our findings are at odds with earlier, more positive assessments of Emergency licensure in Massachusetts. Our updated results appear to be driven by more recent cohorts of ELTs, rather than the teachers who received Emergency licenses at the start of the pandemic. Overall, this study suggests policymakers should be cautious when drawing sweeping conclusions about the impacts of teacher licensure based solely on the earliest cohort of teachers who obtained pandemic-era Emergency licenses.
- Published
- 2024
3. College and Career Ready: How Well Does 8th Grade MAP Performance Predict Post-Secondary Educational Attainment? Working Paper No. 300-0524
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Darrin DeChane, Takako Nomi, and Michael Podgursky
- Abstract
Like most other states, Missouri uses assessments intended to measure whether students are on a pathway to "college and career readiness." The state longitudinal data system now has the capacity to directly test that claim. We make use of 8th-grade assessment (MAP) scores in Math, Science, and Communication Arts for roughly 260,000 first-time Missouri freshmen who began high school between Fall, 2009 and Fall, 2012. These students were tracked through high school and for five years following on-time high school graduation. We find a strong positive association between MAP performance scores in 8th grade Math, Science, and Communication Arts and post-secondary college attendance and degree completion. This is true overall and for White, Black, and Hispanic students disaggregated by gender. Proficiency on all three exams matters even more. Based on a logistic forecasting model, if all students who scored below Proficient on the 8th-grade MAP raised their scores to Proficient, the number earning post-secondary degrees would increase by roughly 50 percent. Black and Hispanic students earning post-secondary degrees would increase by roughly 150 and 75 percent, respectively. We conclude that 8th-grade MAP proficiency scores are highly informative about whether students are on a pathway to college and career readiness.
- Published
- 2024
4. ESSER Funding and School System Jobs: Evidence from Job Posting Data. Working Paper No. 297-0424
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Dan Goldhaber, Grace Falken, and Roddy Theobald
- Abstract
The Elementary and Secondary School Emergency Relief Fund (ESSER) was the largest onetime federal investment in K-12 schools in history, funneling almost $200 billion to states and school districts. We use novel data from Washington State to investigate the extent to which ESSER funding causally influenced spending on school personnel. We argue one cannot infer this directly from ESSER claims data because of the fungibility of school budgets. Thus, we rely on a more direct signal of district hiring decisions: public education job postings scraped from district hiring websites. To address endogeneity concerns, our preferred approach employs an instrumental variables strategy that exploits a formula mechanism used to determine Title I funding for 2020-21 (and thus ESSER allocations in 2022) based on the number of Title I formula-eligible children. We find strong, arguably causal, evidence that public school hiring increased in response to the availability of ESSER funding. Specifically, we estimate that each $1,000 in ESSER allocations caused districts to seek to hire $206 in additional staff, disproportionately teachers. These estimates suggest that roughly 12,000 new staff (including 5,100 teachers) were hired in Washington because of ESSER. In the absence of new funding, school staffing budgets will likely need to contract substantially following the sunset of ESSER.
- Published
- 2024
5. Departmentalized Instruction and Elementary School Effectiveness. Working Paper No. 298-0424
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Ben Backes, James Cowan, and Dan Goldhaber
- Abstract
Departmentalized instruction, in which teachers specialize in one or more core subjects and instruct multiple groups of students in a day, has become increasingly prominent in elementary schools. Using 8 years of data from Massachusetts and a difference-in-differences design, we estimate the effects of departmentalization on student achievement. We find that departmentalization has positive effects in English language arts (ELA) and science and mixed evidence of positive effects in math. These positive effects are not driven by teacher productivity improvements: Consistent with prior findings on teacher specialization, teachers are less effective when specializing in math and no more effective in ELA than when teaching self-contained classrooms. Rather, consistent with the theoretical underpinnings for specialization, departmentalized schools tend to assign teachers to their stronger subjects.
- Published
- 2024
6. Shaping the STEM Teacher Workforce: What University Faculty Value about Teacher Applicants. Working Paper No. 295-0324
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Dan Goldhaber, Roddy Theobald, Amy Roth McDuffie, David Slavit, Jennifer Dechaine-Berkas, John M. Krieg, and Emma Dewil
- Abstract
Who ends up in the teacher workforce is greatly influenced by who is admitted into teacher education programs (TEPs). To better understand how the preferences of teacher education faculty might shape admissions of STEM teacher candidates, we surveyed faculty who teach content or methods courses to STEM teacher candidates across five universities. Faculty reported that they most value information collected from individual interviews with applicants and data on the number of STEM courses taken in college and their performance in these courses, and least value data on university admissions tests, high school GPA, and teacher licensure test scores. When we investigate faculty members' revealed preferences through a conjoint analysis, we find that faculty most value applicants who have worked with students from diverse backgrounds and applicants from a marginalized racial or ethnic community, and least value whether they received high grades in math and/or science courses. Finally, we find significant variation in these perceptions across respondents in different faculty roles, who teach different courses, and from different institutions: for example, Arts and Sciences faculty tend to value TEP applicants' performance in college STEM courses relatively more than STEM education faculty, while STEM education faculty tend to value applicants' race and ethnicity relatively more than Arts and Sciences faculty.
- Published
- 2024
7. Pandemic Learning Loss by Student Baseline Achievement: Extent and Sources of Heterogeneity. Working Paper No. 292-0224
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Ian Callen, Dan Goldhaber, Thomas J. Kane, Anna McDonald, Andrew McEachin, and Emily Morton
- Abstract
It is now well established that the COVID-19 pandemic had a devastating and unequal impact on student achievement. Test score declines were disproportionately large for historically marginalized students, exacerbating preexisting achievement gaps and threatening educational and economic inequality. In this paper, we use longitudinal student-level NWEA MAP Growth test data to estimate differences in test score declines for students at different points on the prepandemic test distribution. We also test the extent to which students' schools and districts accounted for these differences in declines. We find significant differences in learning loss by baseline achievement, with lower-achieving student's scores dropping 0.100 SD more in math and 0.113 SD more in reading than higher-achieving students' scores. We additionally show that the school a student attended accounts for about three-quarters of this widening gap in math achievement and about one-third in reading. The findings suggest school and district-level policies may have mattered more for learning loss than individual students' experiences within schools and districts. Such nuanced information regarding the variation in the pandemic's impacts on students is critical for policymakers and practitioners designing targeted academic interventions and for tracking disparities in academic recovery. [Additional funding for this report was provided by Kenneth C. Griffin.]
- Published
- 2024
8. Course Corrections? The Labor Market Returns to Correctional Education Credentials. Working Paper No. 294-0224
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), James Cowan, Dan Goldhaber, and Suvekshya Gautam
- Abstract
Correctional education is a prevalent form of rehabilitation programming for prisoners in the United States. There is limited evidence, however, about the labor market returns to credentials received while incarcerated. Using incarceration, educational, and labor market data in Washington State, we study the labor market returns to GEDs and short-term vocational certificates earned in prison. We identify the returns to credentials by a difference-indifferences design that compares changes in earnings and employment for incarcerated persons who earn a credential to those who enroll in a program but fail to complete a GED or certificate. We estimate that GEDs increase post-incarceration earnings by about $450 per quarter and that vocational certificates increase earnings by about $250 per quarter. Degree completers have higher hourly wages, are more likely to be employed, and work more hours following release. For vocational programs, earnings increases are driven by certificates in construction and manufacturing. [The research presented presented in this report uses confidential data from the Education Research and Data Center (ERDC) located within the Washington Office of Financial Management (OFM).]
- Published
- 2024
9. Misalignments between Student Teaching Placements and Initial Teaching Positions: Implications for the Early-Career Attrition of Special Education Teachers. Working Paper No. 293-0224
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Ben Backes, James Cowan, Dan Goldhaber, Zeyu Jin, and Roddy Theobald
- Abstract
Graduates of special education teacher education programs can teach in a range of special education settings, raising the potential that their training can occur in very different settings than where they find their first jobs. We follow 263 completers of Moderate Disabilities programs in Massachusetts from their field placements to their early-career teaching positions and study the characteristics of their field placements and the degree to which these are aligned with their early-career teaching positions. We also assess the degree to which alignment is associated with early-career teacher turnover. We found that many of these teachers student-taught in an inclusive setting but were hired into a self-contained special education setting and vice versa, and teachers who experienced this misalignment were more likely to leave the workforce early in their careers. Teachers who student taught with a supervising practitioner without a special education license were also more likely to leave early. Findings suggest that teachers training to educate students with learning disabilities should student teach in a setting that is aligned with where they are likely to be hired, and with a supervising practitioner who is trained in special education.
- Published
- 2024
10. Summer School as a Learning Loss Recovery Strategy after COVID-19: Evidence from Summer 2022. Working Paper No. 291-0823
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Callen, Ian, Carbonari, Maria V., DeArmond, Michael, Dewey, Daniel, Dizon-Ross, Elise, Goldhaber, Dan, Isaacs, Jazmin, Kane, Thomas J., Kuhfeld, Megan, McDonald, Anna, McEachin, Andrew, Morton, Emily, Muroga, Atsuko, and Staiger, Douglas O.
- Abstract
To make up for pandemic-related learning losses, many U.S. public school districts have increased enrollment in their summer school programs. We assess summer school as a strategy for COVID-19 learning recovery by tracking the academic progress of students who attended summer school in 2022 across eight districts serving 400,000 students. Based on students' spring to fall progress, we find a positive impact for summer school on math test achievement (0.03 standard deviation, SD), but not on reading tests. These effects are predominantly driven by students in upper elementary grades. To put the results into perspective, if we assume that these districts have losses similar to those present at the end of the 2022-23 school year (i.e., approximately -0.2 SD), we estimate summer programming closed approximately 2% to 3% of the districts' total learning losses in math, but none in reading. [This research received funding from Kenneth C. Griffin.]
- Published
- 2023
11. The Impact of a $10,000 Bonus on Special Education Teacher Shortages in Hawai'i. Working Paper No. 290-0823
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Roddy Theobald, Zeyu Xu, Allison Gilmour, Lisa Lachlan-Hache, Liz Bettini, and Nathan Jones
- Abstract
We study the impact of a bonus policy implemented by Hawai'i Public Schools starting in fall 2020 that raised the salaries of all special education teachers in the state by $10,000. We estimate that the introduction of this policy reduced the proportion of vacant special education teaching positions by 32%, or 1.2 percentage points, and the proportion of special education positions that were vacant or filled by an unlicensed teacher by 35%, or 4.0 percentage points. The bonus policy did not have significant impacts on special education teacher retention; instead, the impacts of the policy were driven almost entirely by an increase in the number of general education teachers in the state who moved into open special education teaching positions. The effects of the bonus policy were also largest in historically hard-to-staff schools in which all teachers also received "tiered school" bonuses of up to $8,000. Hawai'i therefore represents a unique but instructive case of how strategic financial incentives can help address special education teacher shortages.
- Published
- 2023
12. The Long and Winding Road: Mapping the College and Employment Pathways to Teacher Education Program Completion in Washington State. Working Paper No. 288-0723
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Goldhaber, Dan, Krieg, John, Liddle, Stephanie, and Theobald, Roddy
- Abstract
Nationally, more than 75% of individuals who are credentialed to teach are prepared in traditional college- or university-based teacher education programs (TEPs). But the college and employment pathways that prospective teachers take to TEP enrollment and completion have not been comprehensively examined. A better understanding of how credentialed individuals find their way into TEPs helps us understand the sources of new teacher supply early in the prospective teacher pipeline. With that in mind, we analyze pathways into and through TEPs using historical postsecondary and unemployment insurance data from Washington state. We find that the pathways are quite varied with around 40% of bachelor's-level TEP completers spending at least some time in community colleges and less than 40% enrolling and finishing at the same university directly after high school. Pathways to master's TEP completion are even more varied, with almost half of the completers having prior employment experience. For researchers, this varied landscape raises important questions about the relationship between pathways, candidate persistence, and eventual job performance. For policymakers, the results suggest that efforts to recruit the next generation of teachers need to look beyond the pool of students already enrolled at a 4-year university to include students at 2-year colleges or in the labor force who might be interested in entering a TEP.
- Published
- 2023
13. Attention to Equity in Teacher Education Admissions Processes. Working Paper No. 287-0623
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), McDuffie, Amy Roth, Slavit, David, Goldhaber, Dan, Theobald, Roddy, and Griggs, Nicole
- Abstract
This study investigated the underexplored topic of teacher preparation program admissions processes by interviewing faculty and analyzing program documents. We investigated how 31 K-12 "mathematics and science" teacher preparation programs (MSTPPs) and faculty attend to diversity, equity, inclusion, and social and racial justice (DEIJ). Specific foci included applicant recruitment and selection, components of applications (e.g., forms, essays, interviews), and how applicants' DEIJ-related information and orientations factor into admissions. We found that all MSTPPs participating in the study collected information related to DEIJ (e.g., applicants' ethnoracial backgrounds, citizenship), and all interviewed faculty expressed an interest in increasing the diversity of applicants and admitted students. Faculty expressed preferences for applicants who evidenced positive DEIJ orientations, such as recognizing social and ethnoracial injustices, but at the same time, differences were evident in how MSTPPs and faculty attended to DEIJ. Considerations, implication, and dilemmas for teacher preparation programs and faculty are discussed.
- Published
- 2023
14. The Relationship between Pandemic-Era Teacher Licensure Waivers and Teacher Demographics, Retention, and Effectiveness in New Jersey. Working Paper No. 286-0623
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Backes, Ben, and Goldhaber, Dan
- Abstract
The onset of the pandemic in spring 2020 substantially disrupted routes into teaching and offered a unique opportunity to study this process with different requirements for initial entry into the classroom. We examine the impacts of the Temporary Certificate of Eligibility (Temporary CE), which allowed teacher candidates in New Jersey to enter the workforce before completing assessment and performance requirements. Relative to the novice teacher workforce before the pandemic, Temporary CE teachers were substantially more diverse without any significant effects on teacher performance or student test scores. However, Temporary CE holders were less likely to remain in the same school or in the New Jersey teaching workforce between 2020-21 and 2021-22. Although Temporary CE holders disproportionately entered through alternate routes into teaching, these patterns hold for both traditional- and alternate-route entrants.
- Published
- 2023
15. Faculty Perspectives and Values toward Mathematics and Science Content Information Used in Teacher Preparation Admissions Processes. Working Paper No. 285-0623
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Slavit, David, McDuffie, Amy Roth, Griggs, Nicole, Goldhaber, Dan, and Theobald, Roddy
- Abstract
This qualitative study examines the information collected about applicants to mathematics or science teacher preparation programs (MSTPPs) and how university faculty perceive and value this information in admissions decisions. Based on document review and interviews with MSTPP faculty and admissions directors, we found that broad measures of mathematics and science content background (e.g., achievement test scores, past mathematics and science courses taken) were used more frequently than information on applicants' specific mathematics and science content knowledge and dispositions. In many cases, application components (such as interviews and personal essay statements) were perceived by faculty to be conducive to surfacing applicants' content knowledge and dispositions; however, they were not constructed or employed in a way that afforded the obtainment of this information. We highlight salient examples of MSTPPs' collection and use of information related to mathematics and science and discuss implications for TPP admissions processes.
- Published
- 2023
16. National Board Certification as a Signal of Cooperating Teacher Quality. Working Paper No. 284-0523
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Goldhaber, Dan, Krieg, John, Theobald, Roddy, and Falken, Grace
- Abstract
Prior research has connected characteristics of cooperating teachers who supervise student teaching to performance measures of the teacher candidates they host, suggesting more effective teachers may also be better mentors. The specific measures of cooperating teacher effectiveness considered in this prior literature (value added and performance evaluations), however, are infrequently observable to individuals responsible for student teaching placements. In this paper, we consider a more easily observed proxy for mentor effectiveness: National Board (NB) Certification. We find that NB teachers are considerably more likely to host candidates than other teachers, candidates supervised by NB teachers are slightly more likely to be hired within three years, and these candidates have slightly lower value added in English language arts than their peers, all else being equal. We find no significant relationship between cooperating teacher NB certification and candidates' later attrition and value added in math. We conclude that individuals and policies seeking to leverage student teaching placements to improve student and teacher outcomes may need to focus on less easily observable proxies of cooperating teacher quality than NB certification status.
- Published
- 2023
17. How to Measure a Teacher: The Influence of Test and Nontest Value-Added on Long-Run Student Outcomes. Working Paper No. 270-0423-2
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Backes, Ben, Cowan, James, Goldhaber, Dan, and Theobald, Roddy
- Abstract
This paper examines how different measures of teacher quality are related to students' long-run educational trajectories. We estimate teachers' "test-based" and "nontest" value-added (the latter based on contributions to student absences, suspensions, grade progression, and grades) and assess how these predict various student postsecondary outcomes. We find that both types of value-added have positive effects on student outcomes. Test-based teacher quality measures have more explanatory power for outcomes relevant for students at the top of the achievement distribution, such as attending a more selective college, while nontest measures have more explanatory power for whether students enroll in college at all.
- Published
- 2023
18. Does Regulating Entry Requirements Lead to More Effective Principals? Working Paper No. 213-0323-2
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Austin, Wes, Chen, Bingjie, Goldhaber, Dan, Hanushek, Eric, Holden, Kris, Koedel, Cory, Ladd, Helen, Luo, Jin, Parsons, Eric, Phelan, Gregory, Rivkin, Steven, Sass, Tim, and Turaeva, Mavzuna
- Abstract
Anecdotal evidence points to the importance of school principals, but the limited existing research has neither provided consistent results nor indicated any set of essential characteristics of effective principals. This paper exploits extensive student-level panel data across six states to investigate both variations in principal performance and the relationship between effectiveness and key certification factors. While principal effectiveness varies widely across states, there is little indication that regulation of the background and training of principals yields consistently effective performance. Having prior teaching or management experience is not related to our estimates of principal value-added.
- Published
- 2023
19. Persistent Teach for America Effects on Student Test and Non-Test Academic Outcomes. Working Paper No. 277-0123
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Backes, Ben, and Hansen, Michael
- Abstract
This paper examines the impact of Teach For America (TFA) on following-year student test and non-test outcomes in Miami-Dade County Public Schools. This paper measures the extent to which exposure to TFA is followed by improved student outcomes in the future. In particular, this paper measures days missed due to absences or suspensions, course grades in each core subject, and progression in math courses. We find that students taught by TFA math teachers go on to have higher grades in math courses in the following year and are less likely to miss school due to being absent or suspended. However, while students in TFA classrooms score higher on math and ELA assessments in a given year, these test score gains fade out by the following year.
- Published
- 2023
20. A Descriptive Portrait of the Paraeducator Workforce in Washington State. Working Paper No. 283-0423
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Theobald, Roddy, Kaler, Lindsey, Bettini, Elizabeth, and Jones, Nathan
- Abstract
We use over 25 years of longitudinal data from Washington state to provide a descriptive portrait of the paraeducator workforce in the state. Paraeducators are more racially and ethnically diverse than special education teachers, particularly in the last decade, and tend to be less experienced. They also have full-time salaries that are about half of the average special education teacher salary. Paraeducator-to-student ratios have decreased over time in the state, but they are higher in schools serving more students of color. Finally, and perhaps most importantly, paraeducator attrition rates from the state's public school workforce have increased dramatically over time; for example, the paraeducator attrition rate after the 2021-22 school year (23%) was over twice as high as the attrition rate after the 2008-09 school year (8%). These findings have implications for how policymakers and school leaders should approach decision-making related to the paraeducator workforce, as well as how researchers might approach further research with this group of educators.
- Published
- 2023
21. Could Shifting the Margin between Community College and University Enrollment Expand and Diversify University Degree Production in STEM Fields? Working Paper No. 244-0323-2
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Qian, Cheng, and Koedel, Cory
- Abstract
We examine the potential to expand and diversify the production of university STEM degrees by shifting the margin of initial enrollment between community colleges and 4-year universities. Our analysis is based on statewide administrative microdata from the Missouri Department of Higher Education and Workforce Development covering enrollees in all public postsecondary institutions statewide. We find that the potential for shifting the enrollment margin to expand degree production in STEM fields is modest, even at an upper bound, because most community college students are not academically prepared for bachelor's degree programs in STEM fields. We also find that shifting the enrollment margin is unlikely to improve racial/ethnic diversity among university STEM degree recipients. This is because community college students at the enrollment margin are less diverse than their peers who enter universities directly.
- Published
- 2023
22. Linkage between Fields of Focus in High School Career Technical Education and College Majors. Working Paper No. 269-0323-2
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Xu, Zeyu, and Backes, Ben
- Abstract
This study examines the extent to which students obtain postsecondary credentials in the career technical education (CTE) fields of focus they choose in high school. Using school fixed effects models, we find that focusing on a particular CTE field in high school is associated with an increased probability of enrolling and obtaining a postsecondary credential in that field. The secondary-postsecondary relationship varies across focus areas, and it is strongest in health (increase of 12.5 percentage points), which is disproportionately chosen by females. Across all fields of focus, however, most students enroll and obtain a postsecondary credential in fields that are different from what they focused on in high school.
- Published
- 2023
23. Effects of Large-Scale Early Math Interventions on Student Outcomes: Evidence from Kentucky's Math Achievement Fund. Working Paper No. 279-0323
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Xu, Zeyu, Ozek, Umut, Levin, Jesse, and Lee, Dong Hoon
- Abstract
Reading has been at the forefront of early-grade educational interventions, but addressing the educational needs of students in math early on is also critical given that early gaps in math skills widen further over the course of schooling. In this study, we examine the effects of Kentucky's Math Achievement Fund -- a unique state-level program that combines targeted interventions, peer-coaching, and close collaboration among teachers to improve math achievement in grades K-3 -- on student outcomes and the costs associated with this policy. We find significant positive effects of the program not only on math achievement, but also on test scores in reading and non-test outcomes including student attendance and disciplinary incidents. The benefits exist across racial/ethnic groups and students from different socioeconomic statuses, and they are slightly higher for racial minorities. These findings, along with the cost estimate of the program, suggest that this program could provide a cost-effective blueprint to address the educational needs of students in math in early grades.
- Published
- 2023
24. Academic Mobility in U.S. Public Schools: Evidence from Nearly 3 Million Students. Working Paper No. 227-0323-3
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Austin, Wes, Figlio, David, Goldhaber, Dan, Hanushek, Eric, Kilbride, Tara, Koedel, Cory, Lee, Jaeseok Sean, Luo, Jin, Ozek, Umut, Parsons, Eric, Rivkin, Steven, Sass, Tim, and Strunk, Katharine
- Abstract
We use administrative panel data from seven states covering nearly 3 million students to document and explore variation in "academic mobility," a term we use to describe the extent to which students' ranks in the distribution of academic performance change during their public schooling careers. On average, we show that student ranks are highly persistent during elementary and secondary education--that is, academic mobility is limited in U.S. schools as a whole. Still, there is non-negligible variation in the degree of upward mobility across some student subgroups as well as individual school districts. On average, districts that exhibit the greatest upward academic mobility serve more socioeconomically advantaged populations and have higher value-added to student achievement.
- Published
- 2023
25. What Do Teacher Job Postings Tell Us about School Hiring Needs and Equity? Working Paper No. 282-0323
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Falken, Grace, and Theobald, Roddy
- Abstract
Several decades of research using school administrative data show that teacher quality is inequitably distributed across schools. But these estimates may understate teacher-related inequities if they do not account for how teacher vacancies or late hires are distributed across schools. We investigate these hiring issues using data on a direct proxy of school hiring needs: teacher job postings collected from public school district websites. These data allow us to document how, over the course of the school year, hiring needs vary across districts, schools, and subject areas. We find that schools serving more students of color have greater hiring needs throughout the hiring cycle. We also find that hiring needs for special education and STEM positions are consistently higher than hiring needs for elementary positions. Schools with growing enrollments, as well as schools and subjects with higher prior attrition rates, also tend to have more job postings. Postings for schools in towns and rural areas tend to stay open longer than for schools in suburban and urban areas. Finally, we validate that job postings, which can be obtained quickly and inexpensively, are a good indicator of school and district needs in that they closely line up with eventual teacher hires.
- Published
- 2023
26. The Effects of Comprehensive Educator Evaluation and Pay Reform on Achievement. Working Paper No. 281-0323
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Hanushek, Eric, Luo, Jin, Morgan, Andrew, Nguyen, Minh, Ost, Ben, Rivkin, Steven, and Shakeel, Ayman
- Abstract
A fundamental question for education policy is whether outcomes-based accountability including comprehensive educator evaluations and a closer relationship between effectiveness and compensation improves the quality of instruction and raises achievement. We use synthetic control methods to study the comprehensive teacher and principal evaluation and compensation systems introduced in the Dallas Independent School District (Dallas ISD) in 2013 for principals and 2015 for teachers. Under this far-reaching reform, educator evaluations that are used to support teacher growth and determine salary depend on a combination of supervisor evaluations, student achievement, and student or family survey responses. The reform replaced salary scales based on experience and educational attainment with those based on evaluation scores, a radical departure from decades of rigid salary schedules. The synthetic control estimates reveal positive and significant effects of the reforms on math and reading achievement that increase over time. From 2015 through 2019, the average achievement for the synthetic control district fluctuates narrowly between -0.27 s.d. and -0.3 s.d., while the Dallas ISD average increases steadily from -0.28 s.d. in 2015 to -0.08 s.d. in 2019, the final year of the sample. Though the increase for reading is roughly half as large, it is also highly significant. [This research was supported by grants from the CALDER Research Network.]
- Published
- 2023
27. Attracting and Retaining Highly Effective Educators in Hard-to-Staff Schools. Working Paper No. 280-0323
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Morgan, Andrew, Nguyen, Minh, Hanushek, Eric, Ost, Ben, and Rivkin, Steven
- Abstract
Efforts to attract and retain effective educators in high-poverty public schools have had limited success. Dallas ISD addressed this challenge with information produced by its evaluation system to offer large, compensating differentials to highly effective teachers willing to work in its lowest-achievement schools. The Accelerating Campus Excellence (ACE) program resulted in immediate and sustained achievement increases. The improvements were dramatic, bringing average achievement in the previously lowest-performing schools close to the district average. When ACE stipends are largely eliminated, a substantial fraction of highly effective teachers leave, and test scores fall. This highlights the central importance of performance-based incentives.
- Published
- 2023
28. The Challenges of Implementing Academic COVID Recovery Interventions: Evidence from the Road to Recovery Project. Working Paper No. 275-1222
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Carbonari, Maria V., Davison, Miles, DeArmond, Michael, Dewey, Daniel, Dizon-Ross, Elise, Goldhaber, Dan, Hashim, Ayesha K., Kane, Thomas J., McEachin, Andrew, Morton, Emily, Patterson, Tyler, and Staiger, Douglas O.
- Abstract
In this paper we examine academic recovery in 12 mid- to large-sized school districts across 10 states during the 2021-22 school year. Our findings highlight the challenges that recovery efforts faced during the 2021-22 school year. Although, on average, math and reading test score gains during the school year reached the pace of pre-pandemic school years, they were not accelerated beyond that pace. This is not surprising given that we found that districts struggled to implement recovery programs at the scale they had planned. In the districts where we had detailed data on student participation in academic interventions, we found that recovery efforts often fell short of original expectations for program scale, intensity of treatment, and impact. Interviews with a subsample of district leaders revealed several implementation challenges, including difficulty engaging targeted students consistently across schools, issues with staffing and limitations to staff capacity, challenges with scheduling, and limited engagement of parents as partners in recovery initiatives. Our findings on the pace and trajectory of recovery and the challenges of implementing recovery initiatives raise important questions about the scale of district recovery efforts.
- Published
- 2022
29. How Did It Get This Way? Disentangling the Sources of Teacher Quality Gaps through Agent-Based Modeling. Working Paper No. 259-0223
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), Dan Goldhaber, Matt Kasman, Vanessa Quince, Roddy Theobald, and Malcolm Wolff
- Abstract
We use publicly available, longitudinal data from Washington state to study the extent to which three interrelated processes--teacher attrition from the state teaching workforce, teacher mobility between teaching positions, and teacher hiring for open positions--contribute to "teacher quality gaps" (TQGs) between students of color and other students in K-12 public schools. Specifically, we develop and implement an agent-based model simulation of decisions about attrition, mobility, and hiring to assess the extent to which each process contributes to observed TQGs. We find that eliminating inequities in teacher mobility and hiring across different schools would close TQGs within 5 years, while just eliminating inequities in teacher hiring would close gaps within 10 years. On the other hand, eliminating inequities in teacher attrition without addressing mobility and hiring does little to close gaps.
- Published
- 2023
30. CTE Teachers and Non-Test Outcomes for Students with and without Disabilities. Working Paper No. 278-0123
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Theobald, Roddy, Goldhaber, Dan, and Mallett Moore, Erica
- Abstract
We use data on high school students and teachers from Washington state to connect the observable characteristics of career and technical education (CTE) teachers to various non-test outcomes (absences, disciplinary incidents, grade point average, grade progression, and on-time graduation) of students with and without disabilities in their classrooms. We find that students participating in CTE tend to have better non-test outcomes when they are assigned to a CTE teacher from the state's Business and Industry pathway--designed for CTE teachers with 3 years of industry experience but no formal teacher preparation--relative to being assigned to a traditionally prepared CTE teacher. These results can inform efforts in Washington and across the country to develop and support similar alternative routes to CTE teacher licensure.
- Published
- 2023
31. School-Based Healthcare and Absenteeism: Evidence from Telemedicine. Working Paper No. 276-0123
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Komisarow, Sarah, and Hemelt, Steven W.
- Abstract
The prevalence of school-based healthcare has increased markedly over the past decade. We study a modern mode of school-based healthcare, telemedicine, that offers the potential to reach places and populations with historically low access to such care. School-based telemedicine clinics (SBTCs) provide students with access to healthcare during the regular school day through private videoconferencing with a healthcare provider. We exploit variation over time in SBTC openings across schools in three rural districts in North Carolina. We find that school-level SBTC access reduces the likelihood that a student is chronically absent by 2.5 percentage points (29 percent) and reduces the number of days absent by about 0.8 days (10 percent). Relatedly, access to an SBTC increases the likelihood of math and reading test-taking by between 1.8-2.0 percentage points (about 2 percent). Heterogeneity analyses suggest that these effects are driven by male students. Finally, we see suggestive evidence that SBTC access reduces violent or weapons-related disciplinary infractions among students but has little influence on other forms of misbehavior.
- Published
- 2023
32. Leveling Up: A Behavioral Nudge to Increase Enrollment in Advanced Coursework. Working Paper No. 271-1022
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Austin, Megan, Backes, Ben, Goldhaber, Dan, Li, Dory, and Streich, Francie
- Abstract
Taking advanced courses in high school predicts a broad array of positive postsecondary and labor market outcomes. Yet students from historically disadvantaged groups and low-income backgrounds have long been underrepresented in these courses. To address this problem, more than 60 districts in Washington state implemented a policy that automatically enrolled all qualified high school students in advanced coursework. The policy relied on a simple behavioral nudge: It made advanced courses "opt out" rather than "opt in" for all qualified students. The districts implemented the policy in waves, beginning in the 2014-15 school year. In this descriptive paper, we examine enrollment patterns by comparing districts that adopted the policy at different times. We found that students in districts that implemented the policy between 2014-15 and 2016-17 were more likely to enroll in at least one advanced course in any subject relative to students in districts without the policy. This was the case for students who "qualified" for advanced courses based on their test scores and for students whose scores did not qualify them for advanced courses. We also found that the policy was associated with a higher probability of enrollment in advanced mathematics courses but only for qualified students. Qualified students across demographic groups experienced similar changes in the probability of advanced course enrollments. But among all students--regardless of qualified status--enrollments in advanced mathematics and advanced English language arts/social studies courses increased more for students from racial/ethnic groups underrepresented in advanced courses and for students who were eligible for free or reduced-price lunch (FRPL) than for non-underrepresented students and students not eligible for FRPL. These across the board increases in advanced course enrollment for students who were historically underrepresented in these courses suggests that districts may have looked beyond standardized assessment scores to identify students for automatic enrollment.
- Published
- 2022
33. Summer School as a Learning Loss Recovery Strategy after COVID-19: Evidence from Summer 2022. Road to COVID Recovery Research Brief. CALDER Working Paper No. 291-0823
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research (AIR), NWEA, Harvard University, Center for Education Policy Research (CEPR), I. Callen, M. V. Carbonari, M. DeArmond, D. Dewey, E. Dizon-Ross, D. Goldhaber, J. Isaacs, T. J. Kane, M. Kuhfeld, A. McDonald, A. McEachin, E. Morton, A. Muroga, and D. O. Staiger
- Abstract
To make up for pandemic-related learning losses, many U.S. public school districts have increased enrollment in their summer school programs. We assess summer school as a strategy for COVID-19 learning recovery by tracking the academic progress of students who attended summer school in 2022 across eight districts serving 400,000 students. Based on students' spring to fall progress, we find a positive impact for summer school on math test achievement (0.03 standard deviation, SD), but not on reading tests. These effects are predominantly driven by students in upper elementary grades. To put the results into perspective, if we assume that these districts have losses similar to those present at the end of the 2022-23 school year (i.e., approximately -0.2 SD), we estimate summer programming closed approximately 2% to 3% of the districts' total learning losses in math, but none in reading.
- Published
- 2023
34. Teachers and School Climate: Effects on Student Outcomes and Academic Disparities. Working Paper No. 274-1022
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Backes, Ben, Cowan, James, Goldhaber, Dan, and Theobald, Roddy
- Abstract
Student-teacher relationships are at the core of student experiences in schools and, arguably, fundamental to influencing student outcomes. Using a statewide, student-level school climate survey from Massachusetts, we investigate teachers' contributions to school climate, which we refer to as climate value added (VA), and how it varies by student race/ethnicity. We first show that climate VA contributes to student learning: Teachers whose students report positive feelings about climate also contribute more to student test scores and to an aggregate of nontest student outcomes (student absences, suspensions, and grade progression). And teachers identified by students of color as contributing to better school climate have outsize effects on learning gains for these students. Differences in teachers' climate effects across racial/ethnic groups are largest on topics aligned with cultural competency, school participation, and comfort with faculty. Lastly, we find that Black students assigned to Black teachers report better school climate than Black students assigned to other teachers.
- Published
- 2022
35. Teachers and Students' Postsecondary Outcomes: Testing the Predictive Power of Test and Nontest Teacher Quality Measures. Working Paper No. 270-1022
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Backes, Ben, Cowan, James, Goldhaber, Dan, and Theobald, Roddy
- Abstract
We examine how different measures of teacher quality are related to students' long-run trajectories. Comparing teachers' "test-based" value-added to "nontest" value-added -- based on contributions to student absences and grades -- we find that test and nontest value-added have similar effects on the average quality of colleges that students attend. However, test-based teacher quality measures have more explanatory power for outcomes relevant for students at the top of the achievement distribution such as attending a more selective college, while nontest measures have more explanatory power for whether students graduate from high school and enroll in college at all.
- Published
- 2022
36. School District Job Postings and Staffing Challenges throughout the Second School Year during the COVID-19 Pandemic. Working Paper No. 273-1022
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Brown, Nate, Marcuson, Nathaniel, and Theobald, Roddy
- Abstract
We describe the extent and predictors of staffing challenges faced by school districts in Washington state throughout the 2021-22 school year using data collected from job posting websites for districts representing more than 98% of students in the state. These data suggest that school districts in the state faced considerable challenges filling paraeducator and, to a lesser extent, teaching positions at the beginning of the school year. When we focus specifically on teachers, we find that teacher staffing challenges were far more pronounced for special education positions and in schools serving more students of color, less pronounced for elementary positions, and highly correlated with teacher attrition from these types of positions after the prior school year. Accounting for these relationships, districts posted more teaching positions later in the school year when they had increasing student enrollments and received more Elementary and Secondary School Emergency Relief funds than nearby districts.
- Published
- 2022
37. How Well Do Professional Reference Ratings Predict Teacher Performance? Working Paper No. 272-1022
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Grout, Cyrus, and Wolff, Malcolm
- Abstract
Most research about how to improve the teacher workforce has focused on interventions designed to improve incumbent teachers, far less attention has been directed toward teacher hiring processes and whether districts can make better hiring decisions. Using data from Spokane Public Schools and Washington state, we describe the findings from a study analyzing measures of the predictive validity of teacher applicant quality measures obtained from professional references. We find that professional reference ratings of prospective teachers are significantly predictive of teacher quality as measured by inservice performance evaluations and teacher value added in math. These findings are driven by applicants with at least some teaching experience and vary by rater type (e.g., principal or university supervisor); the magnitude of the relationship between the ratings of applicants and teacher performance is much smaller and not statistically significant for applicants that do not have teaching experience. Overall, the evidence suggests that obtaining explicit ratings of teacher applicants from professional references is a low-cost way to contribute to the applicant information available to hiring officials and has potential for improving hiring outcomes.
- Published
- 2022
38. Using Predicted Academic Performance to Identify At-Risk Students in Public Schools. Working Paper No. 261-0922
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Fazlul, Ishtiaque, Koedel, Cory, and Parsons, Eric
- Abstract
Measures of student disadvantage--or risk--are critical components of equity-focused education policies. However, the risk measures used in contemporary policies have significant limitations, and despite continued advances in data infrastructure and analytic capacity, there has been little innovation in these measures for decades. We develop a new measure of student risk for use in education policies, which we call Predicted Academic Performance (PAP). PAP is a flexible, data-rich indicator that identifies students at risk of poor academic outcomes. It blends concepts from emerging "early warning" systems with principles of incentive design to balance the competing priorities of accurate risk measurement and suitability for policy use. PAP is more effective than common alternatives at identifying students who are at risk of poor academic outcomes and can be used to target resources toward these students--and students who belong to several other associated risk categories--more efficiently.
- Published
- 2022
39. Linkage between Fields of Concentration in High School Career-Technical Education and College Majors. Working Paper No. 269-0722
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Xu, Zeyu, and Backes, Ben
- Abstract
In this descriptive study, we use longitudinal student-level administrative records from 4 cohorts of high school graduates in Kentucky to examine the extent to which students persist and attain post-secondary credentials in the CTE fields of concentration they choose in high school. To our knowledge, this is the first paper to use student-level administrative data to examine how different fields of concentration in high school CTE are related to future postsecondary outcomes. We find that concentrating in a particular CTE field in high school is associated with both continuing on with that same field in college and obtaining a postsecondary credential in that field; this relationship is especially strong in health fields and especially for women in health. The secondary-postsecondary connection is the weakest among students concentrating in occupational fields in high school, who are also the most disadvantaged socioeconomically and academically before high school. Despite the existence of secondary-postsecondary pipelines of career interests, most students enroll and obtain credentials in fields that are "different" from the field of concentration in high school. In addition, relative to students with similar pre-high-school achievement as measured by grades and test scores, we find that CTE concentration in high school is strongly associated with being more likely to enroll in a two-year college and less likely to enroll in a four-year college.
- Published
- 2022
40. Are Effective Teachers for Students with Disabilities Effective Teachers for All? Working Paper No. 268-0622
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Wood, W. Jesse, Lai, Ijun, Filosa, Neil R., Imberman, Scott A., Jones, Nathan D., and Strunk, Katharine O.
- Abstract
The success of many students with disabilities (SWDs) depends on access to high-quality general education teachers. Yet, most measures of teacher value-added measures (VAM) fail to distinguish between a teacher's effectiveness in educating students with and without disabilities. We create two VAM measures: one focusing on teachers' effectiveness in improving outcomes for SWDs, and one for non-SWDs. We find top-performing teachers for non-SWDs often have relatively lower VAMs for SWDs, and that SWDs sort to teachers with lower scores in both VAMs. Overall, SWD-specific VAMs may be more suitable for identifying which teachers have a history of effectiveness with SWDs and could play a role in ensuring that students are being optimally assigned to these teachers.
- Published
- 2022
41. A Comprehensive Picture of Achievement across the COVID-19 Pandemic Years: Examining Variation in Test Levels and Growth across Districts, Schools, Grades, and Students. Working Paper No. 266-0522
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Kane, Thomas J., McEachin, Andrew, and Morton, Emily
- Abstract
In this paper, we use NWEA MAP test data to examine variation in students' achievement and growth during the pandemic across multiple dimensions. Consistent with prior evidence, we find that students' test scores in fall 2021, on average, were substantially below historic averages. Moreover, the average scores of students of color, students attending high poverty schools, and students in elementary school were more negatively impacted, and more so in math than reading. We present novel evidence on the distributions of test scores and growth in fall 2021 relative to pre-pandemic distributions, finding disproportionately larger declines for students with lower previous achievement levels across districts. However, between districts, there was considerable variation in the extent to which their fall 2021 achievement and growth distributions shifted from their historical distributions by subject, student subgroups, and baseline achievement levels. Therefore, accurately targeting students and choosing interventions for pandemic-related recovery will require careful assessment by districts of their students' achievement and growth in the 2021-22 school year (and into the future): assuming that students in a district reflect the national trends of achievement will often lead to incorrect conclusions about the degree to which they suffered pandemic-related learning losses and the amount of support they will need to recover. [This research received funding from the Kenneth C. Griffin Foundation.]
- Published
- 2022
42. The Consequences of Remote and Hybrid Instruction during the Pandemic. Working Paper No. 267-0522
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Kane, Thomas J., McEachin, Andrew, Morton, Emily, Patterson, Tyler, and Staiger, Douglas O.
- Abstract
Using testing data from 2.1 million students in 10,000 schools in 49 states (plus D.C.), we investigate the role of remote and hybrid instruction in widening gaps in achievement by race and school poverty. We find that remote instruction was a primary driver of widening achievement gaps. Math gaps did not widen in areas that remained in-person (although there was some widening in reading gaps in those areas). We estimate that high-poverty districts that went remote in 2020-21 will need to spend nearly all of their federal aid on academic recovery to help students recover from pandemic-related achievement losses.
- Published
- 2022
43. The Education and Earnings Returns to Postsecondary Technical Education: Evidence from Missouri. Working Paper No. 265-0422
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Cook, Maxwell J., Koedel, Cory, and Reda, Michael
- Abstract
We estimate the education and earnings returns to enrolling in technical two-year degree programs at community colleges in Missouri. A unique feature of the Missouri context is the presence of a highly-regarded, nationally-ranked technical college: State Technical College of Missouri (State Tech). Compared to enrolling in a non-technical community college program, we find that enrolling in a technical program at State Tech greatly increases students' likelihoods of graduation and earnings. In contrast, there is no evidence that technical education programs at other Missouri community colleges increase graduation rates, and our estimates of the earnings impacts of these other programs are much smaller than for State Tech. Our findings exemplify the importance of institutional differences in driving the efficacy of technical education and suggest great potential for high-quality programs to improve student outcomes.
- Published
- 2022
44. How Much Do Early Teachers Matter? Working Paper No. 264-0422
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Jin, Zeyu, and Startz, Richard
- Abstract
We present new estimates of the importance of teachers in early grades for later grade outcomes, but unlike the existing literature that examines teacher "fade-out," we directly compare the contribution of early-grade teachers to later year outcomes against the contributions of later year teachers to the same later year outcomes. Where the prior literature finds that much of the contribution of early teachers fades away, we find that the contributions of early-year teachers remain important in later grades. The difference in contributions to eighth-grade outcomes between an effective and ineffective fourth-grade teacher is about half the difference among eighth-grade teachers. The effect on eighth-grade outcomes of replacing a fourth-grade teacher who is below the 5th percentile with a median teacher is about half the underrepresented minority (URM)/non-URM achievement gap. Our results reinforce earlier conclusions in the literature that teachers in all grades are important for student achievement.
- Published
- 2022
45. Out of the Gate, but Not Necessarily Teaching: A Descriptive Portrait of Early-Career Earnings for Those Who Are Credentialed to Teach. Working Paper No. 263-0422
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Krieg, John, Liddle, Stephanie, and Theobald, Roddy
- Abstract
Prior work on teacher candidates in Washington State has shown that about two thirds of individuals who trained to become teachers between 2005 and 2015 and received a teaching credential did not enter the state's public teaching workforce immediately after graduation, while about one third never entered a public teaching job in the state at all. In this analysis, we link data on these teacher candidates to unemployment insurance data in the state to provide a descriptive portrait of the future earnings and wages of these individuals inside and outside of public schools. Candidates who initially became public school teachers earned considerably more, on average, than candidates who were initially employed either in other education positions or in other sectors of the state's workforce. These differences persisted at least 10 years into the average career and across transitions into and out of teaching. There is therefore little evidence that teacher candidates who did not become teachers were lured into other professions by higher compensation. Instead, the patterns are consistent with demand-side constraints on teacher hiring during this time period that resulted in individuals who wanted to become teachers taking positions that offered lower wages but could lead to future teaching positions.
- Published
- 2022
46. Should I Stay or Should I Go Now? An Analysis of Pension Structure and Retirement Timing. Working Paper No. 262-0322
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Goldhaber, Dan, Grout, Cyrus, Holden, Kristian, and McGee, Josh
- Abstract
Over the last two decades, twenty-two states have moved away from traditional defined benefit (DB) pension systems and toward pension plan structures like the defined contribution (DC) plans now prevalent in the private sector. Others are considering such a reform as it is seen as a means of limiting future pension funding risk. It is important to understand the implications of such reforms for end-of-career exit patterns and workforce composition. Empirical evidence on the relationship between pension plan structure and retirement timing is currently limited, primarily because, most state pension reforms are so new that few employees enrolled in those alternative plans have reached retirement age. An exception, and the subject of our analysis, is the teacher retirement system in Washington State, which introduced a hybrid DB-DC plan in 1996 and allowed employees in its traditional DB plan to transfer into the new plan. Our analysis focuses on a years-of-service threshold, the crossing of which grants employees early retirement eligibility and, in many cases, a large upward shift in retirement wealth. The financial implications of crossing this threshold are far greater under the state's traditional DB plan than under the hybrid plan. We find that employees are responsive to crossing the yearsof-service threshold, but we fail to find significant evidence that the propensity to exit the workforce varies according to plan enrollment.
- Published
- 2022
47. A New Framework for Identifying At-Risk Students in Public Schools. Working Paper No. 261-0122
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Fazlul, Ishtiaque, Koedel, Cory, and Parsons, Eric
- Abstract
We develop a new framework for identifying at-risk students in public schools. Our framework has two fundamental advantages over "status quo" systems: (1) it is based on a clear definition of what it means for a student to be at risk and (2) it leverages states' rich administrative data systems to produce more informative risk measures. Our framework is more effective than common alternatives at identifying students who are at risk of low academic performance and we use policy simulations to show that it can be used to target resources toward these students more efficiently. It also offers several other benefits relative to "status quo" systems. We provide an alternative approach to risk measurement that states can use to inform funding, accountability, and other policies, rather than continuing to rely on broad categories tied to the nebulous concept of "disadvantage."
- Published
- 2022
48. Learning-Mode Choice, Student Engagement, and Achievement Growth during the COVID-19 Pandemic. Working Paper No. 260-0122
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Darling-Aduana, Jennifer, Woodyard, Henry T., Sass, Tim R., and Barry, Sarah S.
- Abstract
The COVID-19 pandemic initially resulted in an unanticipated and near-universal shift from in-person to virtual instruction in spring 2020. During the 2020-21 school year, schools began to re-open and families were faced with decisions regarding the instructional mode for their children. We leverage administrative, survey, and virtual-learning data to examine the determinants of family learning-mode choice and the effects of virtual education on student engagement and academic achievement. Family preference for virtual (versus face-to-face) instruction was most highly associated with school-level infection rates and appeared relatively uniform within schools. We find that students who were assigned a higher proportion of instructional days in virtual mode experienced higher rates of attendance, but also negative student achievement growth compared to students who were assigned a higher proportion of instructional days in face-to-face mode. Students belonging to marginalized groups experienced more positive associations with attendance but were also more likely to experience lower student achievement growth when assigned a greater proportion of instructional days in virtual mode. Insights from this study can be used to better understand family preference as well as to target and refine virtual learning in a post-COVID-19 society.
- Published
- 2022
49. Career Readiness in Public High Schools: An Exploratory Analysis of of Industry Recognized Credentials. Working Paper No. 257-0921
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research, Eagan, Joshua, and Koedel, Cory
- Abstract
We use statewide administrative data from Missouri to document the prevalence of Industry Recognized Credential (IRC) programs in public high schools and understand the characteristics of students who complete IRCs. We show that 9 percent of Missouri students complete an IRC during their senior year of high school. IRC completers have lower achievement and are more likely to be disadvantaged along several measurable dimensions relative to their peers who complete analog college-ready programs, on average. Noting these average relationships, there is substantial heterogeneity among individual IRCs in terms of the types of students served: some IRCs attract students with high test scores who mostly go on to attend college, whereas others serve low-scoring students who mostly forego college. There is strong gender segregation across individual IRCs that aligns with gender segregation across occupations in the labor market.
- Published
- 2021
50. The Effects of Middle School Remediation on Postsecondary Success: Regression Discontinuity Evidence from Florida. Working Paper No. 258-0921
- Author
-
National Center for Analysis of Longitudinal Data in Education Research (CALDER) at American Institutes for Research and Özek, Umut
- Abstract
High school graduation rates in the United States are at an all-time high, yet many of these graduates are deemed not ready for postsecondary coursework when they enter college. This study examines the short-, medium-, and long-term effects of remedial courses in middle school using a regression discontinuity design. While the short-term test score benefits of taking a remedial course in English language arts in middle school fade quickly, I find significant positive effects on the likelihood of taking college credit-bearing courses in high school, college enrollment, enrolling in more selective colleges, persistence in college, and degree attainment.
- Published
- 2021
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.