32,888 results on '"Outcome measures"'
Search Results
2. Charter School Expansion, Catholic School Enrollment, & the Equity Implications of School Choice. EdWorkingPaper No. 24-1027
- Author
-
Annenberg Institute for School Reform at Brown University, Shaun M. Dougherty, Andrew Miller, and Yerin Yoon
- Abstract
Catholic schools have seen more than a 30% decline in enrollment over the past 20 years. While some of the decline in enrollment may have been spurred by secular trends or the Church abuse scandal, the increase in schools of choice, principally public charter schools, may explain at least some of this decline. In this paper we estimate the effect of the opening of charter schools in proximity to Catholic schools across the entire U.S. We find that the opening of a nearby charter school has a negative impact on Catholic school enrollment and increases the likelihood that the school will close. We also find that charter openings induce greater racial isolation. Findings are especially pronounced in K8 schools, rather than high schools.
- Published
- 2024
3. Technology-Focused Multitasking Self-Efficacy and Performance: Whether You Think You Can or Think You Can't -- You Can't
- Author
-
Peter E. Doolittle, Krista P. Wojdak, C. Edward Watson, Dawn N. Adams, and Gina Mariano
- Abstract
Multitasking has been demonstrated to negatively impact performance across a wide range of tasks, including in the classroom, yet students continue to multitask. This study examined the relationship between college students' perceptions and performance of technology-based multitasking. Technology-based multitasking and self-efficacy data were collected and analyzed from 265 undergraduate students. Students engaged in a technology-based multitasking perceptions survey, a video + survey multitasking task or a video-only non-multitasking task, and a technology-based self-efficacy survey. An analysis of student perceptions indicated that students understood that different tasks required different levels of mental effort to complete successfully and that multitasking across high-mental effort tasks required greater effort than multitasking across low-mental effort tasks. In addition, students in the video + survey multitasking group significantly underperformed students in the video-only non-multitasking group. Finally, the relationship between technology-based multitasking and self-efficacy was addressed in a correlational analysis between student technology-based multitasking scores and technology-based self-efficacy scores, yielding no significant relationship. The study findings indicate that most students have an understanding and awareness of multitasking, but ultimately, whether they believed they could multitask or not, multitasking significantly impeded performance.
- Published
- 2024
4. Some College, No Credential: A 2024 Snapshot for the Nation and the States. Fifth in the Series 'Some College, No Credential'
- Author
-
National Student Clearinghouse Research Center, B. Berg, J. Causey, J. Cohen, M. Ibrahim, M. Holsapple, and D. Shapiro
- Abstract
The fall 2023 and spring 2024 undergraduate enrollment increases, marking the first growth since the COVID-19 pandemic, show signs of a post-pandemic turnaround for higher education. However, a significant share of current undergraduates will eventually disengage from college before earning a degree or other credential. They will join tens of millions of other adult Americans who are Some College, No Credential (SCNC). The SCNC population has been consistently rising over time. Re-engaging those who stop out remains a persistent challenge and a priority for the forty states that have set ambitious postsecondary attainment goals. This report aims to provide timely insights into the SCNC population, offering state leaders and policymakers accurate data on its current status, along with tracking progress and outcome measures for SCNC students. The first section of this report describes who makes up the SCNC population and how it has changed since the last report. In this section, the authors pay particular attention to Recent Stopouts, who joined the SCNC population after being stopped out between January 2021 and July 2022. In the second section, the authors report on SCNC re-enrollment in the 2022-23 academic year as well as first-year credential earning for re-enrollees. The authors also provide new updates on continued enrollment and second-year credential earning for SCNC re-enrollees in the 2021-22 academic year, whom were first reported on last year.
- Published
- 2024
5. Impact Evaluation of Flashlight360 in Mountain View Public Schools: Year 2
- Author
-
Johns Hopkins University, Center for Research and Reform in Education (CRRE), Michael A. Cook, and Steven M. Ross
- Abstract
This study examined the effectiveness of Flashlight360 by continuing a retrospective, mixed-methods quasi-experimental design of ELLs in Grades 1-12 during the 2023-24 school year in a large western state school district. Outcome measures included composite, speaking, and writing achievement gains on the WIDA ACCESS assessment administered to students in schools that implemented Flashlight360, relative to those of students in schools that did not implement the program. Impact analyses showed significant positive impacts of Flashlight360 on WIDA ACCESS composite score and proficiency levels, both for two-year and one-year student participants. Additional analyses showed significant positive impacts of Flashlight360 on WIDA ACCESS Speaking and Writing subscale scores for one-year students, as well as directionally positive impacts for two-year students. Digital usage variables were not significantly associated with WIDA ACCESS scores or proficiency levels.
- Published
- 2024
6. Data-Informed Communication: How Measurement-Based Care Can Optimize Child Psychotherapy
- Author
-
Elizabeth H. Connors, Amber W. Childs, Susan Douglas, and Amanda Jensen-Doss
- Abstract
Measurement-based care (MBC) research and practice, including clinical workflows and systems to support MBC, are grounded in adult-serving mental health systems. MBC research evidence is building in child and adolescent services, but MBC practice is inherently more complex due to identified client age, the family system and the need to involve multiple reporters. This paper seeks to address a gap in the literature by providing practical guidance for youth-serving clinicians implementing MBC with children and their families. We focus on MBC as a data-informed, client-centered communication process, and present three key strategies to enhance usual care child and adolescent psychotherapy via developmentally-appropriate MBC. These strategies include (1) go beyond standardized measures; (2) lean into discrepancies; and (3) get curious together. Case-based examples drawn from various child-serving settings illustrate these key strategies of MBC in child psychotherapy.
- Published
- 2025
- Full Text
- View/download PDF
7. Pandemic Impact and Recovery in Hawaii: A Descriptive Case Study
- Author
-
National Center for the Improvement of Educational Assessment, Inc. (NCIEA), Damian Betebenner, and Jeri Thompson
- Abstract
This study explores the effects of COVID-19 on academic growth and achievement in Hawaii schools, and strategies that school leaders used in the recovery from the pandemic. The calculations in this report can support states as they investigate the impact of COVID on students and schools and their recovery from the pandemic. The Center for Assessment examined COVID's impact on student test scores, with some schools experiencing high impact and others a far lower impact. The Center also studied rates of student learning, and characterized some schools as "high recovery" because students were on track to catch up to where they would have been had the pandemic not occurred. Other studied schools were categorized as "low recovery" because students were significantly off-track to catch up to where they would have been pre-COVID. Using a case study design, the authors interviewed school leaders at more than a dozen Hawaii schools to gain insight into programs, strategies and structures that influenced a school's degree of recovery. They did not find any correlation between those supports and whether schools later experienced high or low recovery. A fuller understanding of schools' recovery from COVID's impacts would require a deeper understanding of the relationships among leaders and staff, educators, students and the community, and the leadership qualities that supported high recovery where it occurred.
- Published
- 2024
8. A Protocol to Assess Contextual Factors during Program Impact Evaluation: A Case Study of a STEM Gender Equity Intervention in Higher Education
- Author
-
Suzanne Nobrega, Kasper Edwards, Mazen El Ghaziri, Lauren Giacobbe, Serena Rice, and Laura Punnett
- Abstract
Program evaluations that lack experimental design often fail to produce evidence of impact because there is no available control group. Theory-based evaluations can generate evidence of a program's causal effects if evaluators collect evidence along the theorized causal chain and identify possible competing causes. However, few methods are available for assessing competing causes in the program environment. Effect Modifier Assessment (EMA) is a method previously used in smaller-scale studies to assess possible competing causes of observed changes following an intervention. In our case study of a university gender equity intervention, EMA generated useful evidence of competing causes to augment program evaluation. Top-down administrative culture, poor experiences with hiring and promotion, and workload were identified as impeding forces that might have reduced program benefits. The EMA addresses a methodological gap in theory-based evaluation and might be useful in a variety of program settings.
- Published
- 2024
- Full Text
- View/download PDF
9. The Long Arc of Learning: Perspectives and Innovations from 20 Years of U.S. National Professional Development Program Projects
- Author
-
Annela Teemant, Brandon J. Sherman, and Serena Tyra
- Abstract
U.S. National Professional Development (NPD) grants can afford a longitudinal understanding of how teachers learn to support English learners. When NPD projects are completed successively and successfully, they can provide an even greater longitudinal arc of understanding. This article chronicles the designs and lessons learned across five NPD grants between 2002 and 2023. Each grant represents a snapshot in time, presenting a set of assumptions from the field, programmatic innovations, and insights from research outcomes. From highlighting the difference between incremental and radical pedagogical change and what it takes to move beyond individual teacher change to systemic change benefiting multilingual learners, the article outlines the succession of aspirations (capacity building, sustainability, and scalability), experiences, changing conditions, and data points framing lessons learned and new cycles of praxis. This article offers implications for theory, practice, and research. It stands as an argument for adapting, innovating, and moving beyond the status quo to inspire more innovation in teacher preparation for multilingual learners.
- Published
- 2024
- Full Text
- View/download PDF
10. Recommendations for the Use of Experimental Designs in Management Education Research
- Author
-
Donald R. Bacon
- Abstract
Hamdani et al. recently provided guidance for prospective authors on a wide range of issues encountered in quantitative research papers submitted for review at the "Journal of Management Education." Building on their insights, this essay focuses on experimental designs and provides more specific guidance and recommendations for conducting valid and powerful research. I review the types of experimental designs, statistical tests, and measures that are commonly used in the management education literature and thus provide some sense of the state of practice to date while including specific examples of effective research and analytical techniques. As will be shown, methodological weaknesses exist even in published papers, and so the guidance should be useful to new and experienced authors alike.
- Published
- 2024
- Full Text
- View/download PDF
11. Culturally Responsive Student Outcome Measures
- Author
-
Region 19 Comprehensive Center (R19CC) and Melly Wilson
- Abstract
Culturally Responsive Education (CRE) refers to a comprehensive ecosystem of "pedagogy, curriculum, theories, attitudes, practices and instructional materials that center students' culture, identities and contexts throughout education systems" (Peoples, 2019). In the context of these simultaneous and complementary efforts, culturally responsive measures help ensure that what students are taught and assessed on align to learning outcomes in step with their local contexts and daily experiences, and which treat these experiences as valid and powerful sources of knowledge. This brief from the Region 19 Comprehensive Center provides an overview of CRE and provides examples of culturally responsive measures.
- Published
- 2024
12. Is It Germane to Sustain Higher Education Research in the Post-COVID-19 Era?
- Author
-
Oluwayemi IbukunOluwa Odularu
- Abstract
The COVID-19 pandemic has severely impacted developing countries, causing educational and economic crises globally. This study explores the necessity of maintaining research in Higher Education (HE) amidst the pandemic's disruptions. It questions whether Higher Education Institutions (HEIs) can sustain research post-COVID-19 while balancing essential functions to avoid risks. Despite extensive studies on HEIs' research sustainability post-pandemic, there is a notable gap in understanding the precise strategies needed to balance essential functions, address risks, and foster resilience amid uncertainties. To bridge this gap, the study highlights the importance of reassessing research priorities and methods in the changing HE landscape. A systematic literature review was conducted, gathering relevant literature from various databases. The study employed an exclusion and inclusion design for research selection. It points out that maintaining HE research post-pandemic has not been sufficiently investigated, leaving a critical gap in understanding research practices. The conceptual model, serving as the study's theoretical foundation, offers an organized means of evaluating the need for HE research considering the pandemic's global economic impacts. This study underscores the importance of multi-stage educational research in the post-COVID-19 era, given the interconnectedness of HEIs. It advocates for a flexible and dynamic research environment and suggests comprehensive approaches to anticipate and meet emerging trends in higher education. The study emphasizes that future research should focus on mitigating post-pandemic challenges and preparing for shifts in HE, promoting resilience and creativity in the field.
- Published
- 2024
13. Building a Stronger Case for Independent Reading at School
- Author
-
Adriana G. Bus, Yi Shang, and Kathleen Roskos
- Abstract
The effectiveness of incorporating independent reading practice in schools has long been a subject of uncertainty. To shed light on this ongoing debate, this meta-analysis seeks to investigate the impact of in-school independent reading on three crucial measures--attitudes toward reading, word recognition, and comprehension--focusing on K-10 students. The analysis encompasses (quasi-)experimental studies conducted between 1970 and 2020, examining a total of 7,493 students across 47 studies. Because most studies contain more than one outcome measure or effect size, we used a meta-analytic model with a three-level structure. The findings reveal a statistically significant overall effect size (Hedges' g = 0.08). Specifically, the effect sizes are more pronounced when considering word recognition (i.e., word attack, word identification, decoding, and fluency; Hedges' g = 0.21) and students' reading attitude (Hedges' g = 0.18) as outcome measures. However, the effect size for comprehension--the most commonly assessed outcome measure--was approximately zero (Hedges' g = -0.014).
- Published
- 2024
14. Empowering Teachers' Learning into Action to Enhance Active Learning in the Classroom
- Author
-
Chalermchai Pondongnok and Phrakhrusutheejariyawattana
- Abstract
This research is a Research and Development (R&D) study aimed at developing educational innovation entitled "Online Self-Training Program to Empower Teachers' Learning into Action to Enhance Active Learning in the Classroom", and implemented in schools. The online self-training program consists of 2 projects (1) a Development project for teacher learning which includes 7 self-training modules, and (2) the implementation of an online self-training program project which includes 1 self-training module to be used as a teaching guideline. The research consists of 4 steps. The final step was an experimental study. The results of the first project found that 12 participating teachers achieved post-test scores that met the standard of 90/90. The average post-test score was statistically significantly higher than the average pre-test score. Additionally, results from the second project found that, according to students' perception scores, the average post-test score was statistically significantly higher than the average pre-test score among 500 students. The results confirm that the "Online Self-Training Program to Empower Teachers' Learning into Action to Enhance Active Learning in the Classroom," is an effective educational innovation for teachers. Therefore, it can be disseminated for the benefit of teachers in schools on a broader scale in the future. Additionally, results from the second project found that, according to students' perception scores, the average post-test score was statistically significantly higher than the average pre-test score among 500 students. The results confirm that the "Online Self-Training Program to Empower Teachers' Learning into Action to Enhance Active Learning in the Classroom" is an effective education innovation for teachers. Therefore, it can be disseminated for the benefit of teachers in schools on a broader scale in the future.
- Published
- 2024
15. A Beacon, a Barometer, and a Bridge: Imagining More Equitable, Student-Centered State Standards and Assessments in Minnesota
- Author
-
Education Evolving and Lars Esdal
- Abstract
To get the equitable, student-centered education system that is wanted and needed--one which honors each unique student, and prepares them for the changing 21st century world--we need to rethink not only the design of learning, but also the what and how of assessment. Assessments are used by people in many different roles and in many different ways. This paper focuses on statewide assessments, and in particular the Minnesota Comprehensive Assessments (MCAs). Statewide assessments are developed based on state academic standards, which are state-adopted statements about what students should know and be able to do, across subjects and grade levels. Because assessments and standards are so inextricably linked, this paper's focus also includes standards. This paper's purpose is to explore how statewide assessments and academic standards could better align with, and help push the state toward more equitable and student-centered learning. This paper asks: given the reality that statewide assessments are both required and influential, how can we make them as helpful as they can be? Even more specifically, how can they best support and push education to be more equitable and student-centered? This paper builds on a prior Education Evolving report, "Defining and Measuring Student-Centered Outcomes", which lays out a foundational argument and framework. This paper goes a step further, with concrete recommendations for Minnesota's system of statewide assessments and academic standards.
- Published
- 2024
16. Reconsidering the Direct vs. Indirect Evidence Dichotomy
- Author
-
Kevin Whiteacre
- Abstract
High quality student outcome measures provide the foundation for effective learning assessment. These outcomes can be organized into different categories, such as skills or habits of mind, and evidence types, such as direct or indirect. Prevailing models of assessment, however, focus only on the distinction between direct and indirect evidence without incorporating the outcome categories. Such a binary model of evidence can be limiting, privileges measures of skills and knowledge over habits of mind and values, and risks excluding validated psychometric tools as a source of measurement. An argument is made for a new 2x2 outcome matrix which incorporates outcome category and evidence type as a possible alternative to the dominant direct vs. indirect dichotomy.
- Published
- 2024
17. Transforming Assessments of Clinician Knowledge: A Randomized Controlled Trial Comparing Traditional Standardized and Longitudinal Assessment Modalities
- Author
-
Shahid A. Choudhry, Timothy J. Muckle, Christopher J. Gill, Rajat Chadha, Magnus Urosev, Matt Ferris, and John C. Preston
- Abstract
The National Board of Certification and Recertification for Nurse Anesthetists (NBCRNA) conducted a one-year research study comparing performance on the traditional continued professional certification assessment, administered at a test center or online with remote proctoring, to a longitudinal assessment that required answering quarterly questions online on demand. A randomized controlled trial of 1,000 certified registered nurse anesthetists (500 randomly assigned to the traditional assessment group and longitudinal assessment group) aimed to 1) compare assessment performance between groups, 2) compare perceptions and user experience between groups; and 3) describe participant feedback about usability of the longitudinal assessment platform. The mean scaled score for the traditional assessment group exceeded that of the longitudinal assessment group when scoring the first responses; however, upon scoring the longitudinal assessment group's most recent responses on repeat questions previously answered incorrectly, the mean scaled score was higher than the traditional assessment group. Both groups were satisfied with their experience, with slightly higher feedback ratings for the longitudinal assessment group who also found the platform easy to use and navigate. Overall results suggest the longitudinal assessment is a feasible, acceptable, and usable format to assess specialized knowledge for continued healthcare professional certification.
- Published
- 2024
18. Use of an Education and Coaching Intervention to Promote Occupational Balance in Graduate Occupational Therapy Students
- Author
-
Linda M. Rini and Ingrid Provident
- Abstract
This small-scale pilot study was developed to examine the perceived occupational balance of graduate occupational therapy students and implement an education and coaching intervention to promote occupational balance for those who have difficulty achieving and maintaining it. Although literature provides many examples of interventions to facilitate stress relief in graduate students, this is the first to address the promotion of occupational balance in this effort, which has been identified as a student-reported need. A sequential explanatory mixed-methods approach was used to obtain quantitative and qualitative data on occupational therapy students' satisfaction with their balance of activity in all areas of occupation. The impact of that balance on stress levels and occupational satisfaction was examined utilizing an investigator developed scaled survey and The Canadian Occupational Performance Measure. Participants (N=22) were MSOT and OTD students from all academic years of their program. A six-week group education program was implemented. One additional 30-minute individual coaching session was held virtually with each student and the primary investigator to target individual goals. Survey data collected before the start of the educational series and again at its conclusion indicate an aggregate decrease in students' perceived stress (-0.85); an increase in perceived occupational performance (mean +1.26); and an increase in perceived occupational satisfaction (mean +2.10). The desired outcome of the intervention was to provide students with strategies to increase lifestyle balance to help manage some of the stresses of graduate academia, and ultimately increase students' health and wellness to promote retention and successful completion of graduate education.
- Published
- 2024
19. Exploring Missing Learning Phenomenon in Preschool Settings during COVID-19 Pandemic: Teachers' Perspectives
- Author
-
Nurul Hijja Mazlan, Wardatul Hayat Adnan, Suffian Hadi Ayub, and Mohd Zaidi Zeki
- Abstract
Purpose--This study aims to explore the missing learning phenomenon due to school closures during the COVID-19 pandemic in preschool settings from teachers' perspectives in Selangor, Malaysia. Related studies have shown that missing learning phenomena from different settings leads to delayed literacy development and raises the risk of dropping out among children. There is a lack of in-depth documentation on the missing learning phenomenon among preschoolers exploring the socioecology of preschool settings in a local context. Methodology--This research employed a case study approach. In-depth interviews were conducted with six preschool teachers from Selangor, Malaysia, using an inductive approach for a holistic understanding of the missing learning phenomenon during the COVID-19 pandemic. The data were analyzed using Computer Assisted Qualitative Data Analysis Software (CAQDAS), NVivo version 12 software, which mapped the findings to understand further the ecosystem behind the preschoolers' absence of learning during the COVID-19 pandemic. Findings--Three major themes were revealed from the data: the missing learning demographic, socioecological factors, and mitigation plans. Several sub-themes (the compensative learning solutions, the demographic of impacted people, the delayed progress, teachers' readiness to facilitate online learning, engagement towards online learning, revised syllabus, personalized learning, and parental involvement) are classified under the respective major themes. Several main categories also emerged from the themes: lack of experiences and technology-pedagogical knowledge, unavailable online modules, low readiness to utilize online learning, unsupportive family climate, and accessibility. Learning intervention and online engagement with pupils during the pandemic are crucial in ensuring a successful continuous education. Significance--There is also a need for comprehensive remote instructional modules that consider socioecological actors -- parents and home climate; in the future and the enhanced instructional technology competency among preschool teachers.
- Published
- 2024
20. Literary Discussions in the Modern Classroom: Online and In-Person Implementation Strategies
- Author
-
Albert Carter, DeSuan Dixon, and Xia Li
- Abstract
Literary discussions are widely utilized in education, yet their profound impact on students' comprehension requires in-depth exploration. This paper delves into the influence of literary discussions on student comprehension and examines how these discussions can enhance students' understanding and analytical skills. Through literature reviews and case analyses, this study investigates teaching strategies, student engagement levels, classroom ambiance, and other factors involved in literary discussions, revealing the potential mechanisms through which literary discussions influence student comprehension. The paper explores variations in the application of literary discussions across different types of literary works (novels, poetry, drama, etc.) and their relationship with students' creative thinking. Finally, the paper provides recommendations to assist educators in effectively utilizing literary discussions to enhance students' comprehension skills. Students must have the opportunity to discuss literature in ways that provoke deep thought and meaning from each work they encounter. Therefore, English Language Arts teachers and instructors must be creative in finding unique ways in which they encourage their students to experience and respond to literature. This paper discusses a variety of strategies to implement in virtual and in-person classrooms, such as Socratic seminar, Teacher-led as a facilitator, Teacher-led as a promoter of diverse perspectives, Using student-generated discussion questions whole class, Using student-generated discussion questions in small groups, Using Close-ended questions, Using Open-ended questions, Inquiry-based, Making real-world connections to the literature, Literature Circles. These literary discussion strategies can be used for both fiction and nonfiction literature.
- Published
- 2024
21. Measures of Economic Disadvantage Explain Outcomes Differently across Geographies
- Author
-
Robin Clausen
- Abstract
Alternative poverty measures have been proposed in response to the emerging insufficiencies of the National School Lunch Program (NSLP) eligibility data. The analysis presented here involves seven poverty measures. Using outcome measures as a yardstick, we can assess how poverty measures explain these outcomes and note variations between geographical locales (assessing predictive validity). An analysis of 2019 data from Montana revealed that no poverty measure emerges as consistently meeting or exceeding the results found with the NSLP on the state level. Results are mixed based on locale (size) and distance from an urban centre, and within school communities.
- Published
- 2024
22. Measuring Two Constructs of Afterschool Activity Participation: Breadth and Intensity
- Author
-
Jose R. Palma, Martin Van Boekel, and Ashley S. Hufnagle
- Abstract
The benefits of afterschool activity participation for youth development are well-documented. An interesting question dominating this field is whether there is a threshold at which point participating in too many activities (breadth) and spending too much time in those activities (intensity) is negatively associated with desirable outcomes. Using 9th grade student data (N=115,731) from three administrations of a state-wide school survey, we explore whether students' breadth and intensity of afterschool participation is associated with GPA and perceived family and community support. Findings corroborate prior research in demonstrating the association between breadth and intensity. Importantly, we extend the discussion, with three important observations. First, a linear model is insufficient for modeling these complex associations with outcomes. Second, there is a threshold at which too much participation has a negative impact in these outcomes. Third, variations in activities, time windows and indices have small or no influence in the association with outcomes.
- Published
- 2024
23. Effectiveness of French Phonological Components Analysis in Individuals with Chronic Aphasia
- Author
-
Michèle Masson-Trottier, Karine Marcotte, Elizabeth Rochon, Carol Leonard, and Ana Inés Ansaldo
- Abstract
Background: Over 50% of individuals with aphasia face ongoing word-finding issues. Studies have found phonologically oriented therapy helpful for English speakers, but this has not yet been studied in French. It is essential to assess the effectiveness of such a therapy in French, considering the distinct linguistic typologies between both languages, which may impact the outcomes of phonologically oriented interventions. Aim: This paper evaluates the effectiveness of French Phonological Component Analysis (Fr-PCA) on communication skills of individuals with chronic aphasia and the impact of individual factors on treatment success. Methods & Procedures: Eighteen individuals with chronic aphasia received 15 h of Fr-PCA therapy over 5 weeks. Naming accuracy for treated and untreated words was measured before and after therapy, as well as at 3- and 6-month follow-ups. Secondary outcome measures included standardized tests measuring within-level generalization (object and action naming) and across-level generalization (repetition, verbal fluency, oral comprehension, communication effectiveness reported by a frequent communication partner). Outcomes & Results: Fr-PCA led to improved accuracy for treated (17 participants out of 18) and untreated words (9 participants out of 18), with gains maintained at 6-month follow-up (7 participants out of 10 for treated and 6 participants out of 10 for untreated), and generalization to communication effectiveness reported by a frequent communication partner (11 participants out of 16). Age, apraxia of speech severity and initial anomia severity impacted therapy gains. Conclusions & Implications: Though more research is needed, results suggest Fr-PCA benefits French individuals living with aphasia. Identifying individual factors influencing therapy gains could enable clinicians to improve therapy tailoring.
- Published
- 2024
- Full Text
- View/download PDF
24. Micro-Analyses Reveal Increased Parent-Child Positive Affect in Children with Poorer Adaptive Functioning Receiving the ESDM
- Author
-
Yana Sinai-Gavrilov, Tali Gev, Ilanit Gordon, Irit Mor-Snir, Giacomo Vivanti, and Ofer Golan
- Abstract
Synchronous positive affect (SPA) is a key element of parent-child interaction quality which is related to favorable developmental outcomes. Children with autism spectrum disorder (ASD) and their parents tend to show less SPA compared to other populations. The current study explored changes in SPA made by parents and their children with ASD following the Preschool-Based Early Start Denver Model (PB-ESDM) intervention. Thirty children receiving PB-ESDM and 23 receiving treatment-as-usual (TAU) were assessed pre- and post- intervention using microanalysis of video-recorded parent-child interactions, in which SPA was quantified. Results showed a significant increase in SPA among children receiving PB-ESDM who had lower pre-treatment adaptive functioning. These findings suggest that SPA may serve as a sensitive treatment outcome measure for children with poorer adaptive functioning, who often struggle to show significant changes on standardized measures. The study's modest sample and non-randomized design are noted as limitations.
- Published
- 2024
- Full Text
- View/download PDF
25. Understanding Engagement as a Catalyst for Leadership Learning
- Author
-
Kamrie Risku and Courtney Holder
- Abstract
This article provides an overview of the theoretical foundations of leadership engagement. The authors synthesize research informing leadership engagement practice and research in college environments. They highlight evidence-based instructional strategies and high-impact practices for effective leadership engagement for college students, including considerations for identity-conscious leadership engagement. The article concludes with reflections on how leadership educators and scholars may continue to evolve practice and research for deeper leadership engagement opportunities.
- Published
- 2024
- Full Text
- View/download PDF
26. Do Social Programs Help Some Beneficiaries More than Others? Evaluating the Potential for Comparison Group Designs to Yield Low-Bias Estimates of Differential Impact
- Author
-
Andrew P. Jaciw
- Abstract
In the current socio-political climate, there is an extra urgency to evaluate whether program impacts are distributed fairly across important student groups in education. Both experimental and quasi-experimental designs (QEDs) can contribute to answering this question. This work demonstrates that QEDs that compare outcomes across higher-level implementation units, such as schools, are especially well-suited to contributing evidence on differential program effects across student groups. Such designs, by differencing away site-level (macro) effects, on average produce estimates of the differential impact that are closer to experimental benchmark results than are estimates of average impact based on the same design. This work argues for the importance of routine evaluation of moderated impacts, describes the differencing procedure, and empirically tests the methodology with seven impact evaluations in education. The hope is to encourage broader use of this design type to more-efficiently develop the evidence base for differential program effects, particularly for underserved students.
- Published
- 2024
- Full Text
- View/download PDF
27. Parent's Use of Naturalistic Instruction upon Receiving Technology-Enhanced Performance-Based Feedback
- Author
-
Christan Grygas Coogle, Emil Majetich, Sloan O. Storie, and Clarissa Bunch Wade
- Abstract
We used a multiple baseline across strategies design to determine the effect of technology-enhanced performance-based feedback on parent's use of preventive strategies to address children's challenging behaviors for two parent--child dyads. A father, mother, and each of their young children participated. We also measured associated child outcomes and parent's perceptions of the technology-enhanced performance-based feedback intervention. We observed a functional relation between our intervention and parent practice. Although variable, desired child behaviors increased, and challenging behaviors decreased. Finally, parents indicated that they perceived the intervention to be socially valid.
- Published
- 2024
- Full Text
- View/download PDF
28. Implementation Drivers of Data-Based Instruction for Students with Intensive Learning Needs: A Systematic Review
- Author
-
Seohyeon Choi, Emma Shanahan, Bess Casey-Wilke, Jechun An, and LeAnne Johnson
- Abstract
Despite decades of research efforts, data-based instruction (DBI) for students with intensive intervention needs are not being widely used in practice as anticipated, and many educators have difficulties in implementing it. This systematic review aimed to examine what kinds of implementation drivers and strategies have been used to support educators implementing DBI and what kinds of implementation outcomes researchers have measured. Eighteen studies were synthesized using the Implementation Drivers framework and Implementation Outcomes taxonomy and were quality appraised. We found that the majority of studies primarily used competency drivers to increase teachers' DBI expertise, while a limited number of studies focused on organizational and leadership drivers. Acceptability and fidelity were frequently assessed as implementation outcomes. We discussed the implications of the findings, including the need for researchers to incorporate implementation drivers and outcomes at diverse levels to best support educators' implementation of DBI, as well as the limitations of this review, such as the limited generalizability of the findings.
- Published
- 2024
- Full Text
- View/download PDF
29. Using Bayesian Meta-Analysis to Explore the Components of Early Literacy Interventions. Appendices. WWC 2023-008
- Author
-
National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES), What Works Clearinghouse (WWC) and Mathematica
- Abstract
The appendices accompany the full report "Using Bayesian Meta-Analysis to Explore the Components of Early Literacy Interventions. WWC 2023-008," (ED630495), which pilots a new taxonomy developed by early literacy experts and intervention developers as part of a larger effort to develop standard nomenclature for the components of literacy interventions. The What Works Clearinghouse (WWC) uses Bayesian meta-analysis--a statistical method to systematically summarize evidence across multiple studies--to estimate the associations between intervention components and intervention impacts. Twenty-nine studies of 25 early literacy interventions that were previously reviewed by the WWC and met the WWC's rigorous research standards were included in the analysis. The following apprendices are presented: (1) Components of Early Literacy Interventions; (2) Data from the What Works Clearinghouse's Database of Reviewed Studies; (3) The Bayesian Meta-Analytic Model; (4) Additional Results; and (5) Component Coding Protocol.
- Published
- 2023
30. 2021-2023 Interagency Autism Coordinating Committee Strategic Plan for Autism Research, Services, and Policy
- Author
-
US Department of Health and Human Services, Interagency Autism Coordinating Committee and National Institute of Mental Health (NIMH) (DHHS/NIH), Office of National Autism Coordination (ONAC)
- Abstract
The Interagency Autism Coordinating Committee (IACC) is a federal advisory committee that advises the Secretary of Health and Human Services (HHS) on issues related to autism spectrum disorder (ASD). It was established by the "Children's Health Act of 2000" (Public Law 106-310), reconstituted under the Combating Autism Act of 2006 (CAA; Public Law 109-416), and was most recently renewed under the "Autism Collaboration, Accountability, Research, Education, and Support (CARES) Act of 2019" (Public Law 116-60). One of the statutory responsibilities of the IACC under the CAA and subsequent authorizations is the development of a strategic plan for autism, to be updated annually. The "Autism CARES Act of 2019" requires that the strategic plan address the "conduct of, and support for, autism spectrum disorder research, including as practicable for services and supports." With each update of its "Strategic Plan," the IACC re-evaluates the needs of the autism community and the best ways to achieve progress. The "2021-2023 IACC Strategic Plan for Autism Research, Services, and Policy" summarizes current understanding of autism-relevant topics and addresses current gaps and opportunities in autism research, services and supports, and policy. As in previous years, the "IACC Strategic Plan" is organized around seven general topic areas that are represented in the Plan as community-focused Questions. Each question is assigned a chapter in the "Strategic Plan" that provides an Aspirational Goal, or long-term vision for the question; a description of the state of the field; the needs and opportunities in research, services, and policy; and three broad Objectives. In this edition of the "IACC Strategic Plan," the Objectives from the "2016-2017 IACC Strategic Plan" have been updated and renamed as "Recommendations." The 24 total updated Recommendations in this "Strategic Plan," including the new equity Recommendation and the Budget Recommendation, address critical gaps and potential opportunities for advancement that were identified by the IACC. The IACC's goal during the development of this "Plan" is to present a collective voice detailing the current status and future goals of autism research, services, and policy. [For the "Interagency Autism Coordinating Committee Strategic Plan for Autism Spectrum Disorder, 2018-2019 Update," see ED608308.]
- Published
- 2023
31. First Year Implementation of Exact Path Leads to Sizable Growth in NWEA MAP Reading Scores
- Author
-
Weiling Li, Aaron Butler, Catherine Oberle, Anabil Munshi, and Amy J. Dray
- Abstract
Edmentum offers a personalized learning platform called Exact Path. This quasi-experimental study, designed to meet ESSA Tier 2 evidence and What Works Clearinghouse standards with reservations, aimed to assess the efficacy of Exact Path in a district from the Midwestern United States. The goal was to provide specific recommendations to educators within the district and inform the broader community of policymakers and practitioners about the potential benefits of personalized learning for enhancing student academic achievement. The study found that the use of Exact Path was positively related to Reading achievement in NWEA MAP tests, after controlling for students' prior test scores and their socioeconomic status. These findings suggest that Exact Path could be an effective tool for improving student success in this district and potentially other similar contexts. Therefore, these results may have important implications for educators, policymakers, and researchers interested in improving student outcomes through personalized learning.
- Published
- 2023
32. Beyond Test Scores: Broader Academic Consequences of the COVID-19 Pandemic on American Students. Report from a Consensus Panel
- Author
-
Arizona State University (ASU), Center on Reinventing Public Education (CRPE), Morgan Polikof, Isabel Clay, and Daniel Silver
- Abstract
Recent state and national achievement exam results, as well as academic progress reports, have underscored how the COVID-19 pandemic and related school closures had a large, negative impact on students' reading and math development. While a great deal is known about the test-based academic impacts of the pandemic such as test scores that provide valuable evidence, there are a range of non-test measures like attendance, engagement in school, student retention, course failure rates, degree completion, and enrollment in subsequent levels of education that also yield important insights about students' educational well-being. These measures matter in their own right and in how they affect longer-term outcomes like employment, earnings, and adult well-being. This consensus panel report reviewed the best available evidence to understand how the pandemic affected non-tested academic areas, and it offers recommendations for shaping a policy response.
- Published
- 2023
33. The Effectiveness and Impact of Post-Observation Feedback Sessions in an In-Service Training Program
- Author
-
Derya Ilgin Yasar and Nurdan Gürbüz
- Abstract
An essential component of any training activity is observations, and in almost any teacher education or professional development context, observations are followed by feedback sessions aimed at improving teaching practices. Nevertheless, whether these sessions accomplish this aim is an issue of concern as it is highly related to how effective it is perceived to be. This study aims to explore how effective post-observation feedback sessions are perceived by the observed instructors, what factors make feedback effective, and whether feedback has any impact on their practices. Data were collected qualitatively by conducting semi-structured interviews with the instructors and Professional Development Unit (PDU) members. The results showed that the feedback was considered effective by the instructors, and it impacted their teaching practices positively, while helping them with their adaptation to their new institution. The results also shed light on the factors that made feedback effective from the instructors' and the PDU members' perspectives.
- Published
- 2023
34. Proficiency with Number Concepts and Operations: Replicating the Efficacy of a First-Grade Mathematics Intervention
- Author
-
Christian T. Doabler, Ben Clarke, Jessica E. Turtura, Marah Sutherland, Jenna A. Gersib, Taylor Lesner, Madison Cook, Georgia L. Kimmel, Keith Smolkowski, and Derek Kosty
- Abstract
Conceptual replications are part and parcel of education science. Methodologically rigorous conceptual replication studies permit researchers to test and strengthen the generalizability of a study's initial findings. The current conceptual replication sought to replicate the efficacy of a small-group, first-grade mathematics intervention with 240 first-grade students with mathematics difficulties in a new geographical region. Participating students were randomized into one of three conditions: (a) 2:1 mathematics intervention group, (b) 5:1 mathematics intervention group, or (c) business-as-usual instruction. Relative to the original study, findings from the replication varied. When comparing the treatment groups to the control, results suggested positive effects on all outcome measures, including a follow-up assessment administered one year later. However, differences between the two treatment groups based on group size were not found in the mathematics outcome measures. Both groups also received commensurate levels of observed instructional interactions. Implications for unpacking contextual differences between original research and their replications as well as using future research to explore the quantity and quality of instructional interactions as ways to explain variation in findings of group size are discussed.
- Published
- 2024
- Full Text
- View/download PDF
35. Expectations and Experiences of a Dance Programme for Autistic Children: A Qualitative Study of Parents, Teachers and Therapists
- Author
-
Ali Golding, Zoe Ambrose, Joanne Lara, Christina Malamateniou, and Dido Green
- Abstract
This study explores the expectations of dance therapists/practitioners and parents and teachers of autistic children engaging in a developmental dance programme. Information gathered will support development of an evaluation tool aligned with the International Classification of Functioning Disability and Health (ICF) Core Sets for autism spectrum disorders (ASD). A qualitative study included a convenience cohort of teachers (n = 6), parents (n = 2) of children with ASD and therapists (n = 3). Three role specific focus groups were undertaken considering potential benefits and challenges of the programme. Content and thematic analysis was undertaken using NVivo12. Findings reflected four positive themes relating to behaviour, skills, social interaction and environmental supports. Therapists, teachers and parents focused differently on stereotypical and restricted behaviours, environmental supports and habits and routines respectively. These themes also emerged as challenges (to implement/achieve); with parents identifying more emotional and behavioural restrictions. A fourth challenge theme of transferability of skills emerged from teachers and therapists. Items mapped against 28 ICF Core Sets (across the lifespan) and six to ICF categories, with creativity and imagination mismatched. Findings highlight need for a specific outcome measure for dance and/or movement programmes for autistic individuals that captures meaningful functions across ICF domains for differing stakeholders.
- Published
- 2024
- Full Text
- View/download PDF
36. School-Based Organizational Skills Training for Students in Grades 3 to 5: A Cluster Randomized Trial
- Author
-
Jenelle Nissley-Tsiopinis, Thomas J. Power, Phylicia F. Fleming, Katie L. Tremont, Bridget Poznanski, Shannon Ryan, Jaclyn Cacia, Theresa Egan, Cristin Montalbano, Alex Holdaway, Ami Patel, Richard Gallagher, Howard Abikoff, A. Russell Localio, and Jennifer A. Mautone
- Abstract
Objective: Research has demonstrated the effectiveness of interventions to reduce organizational skills deficits and homework problems, including the clinic-based Organizational Skills Training (OST-C) program (Abikoff et al., 2013). In this study, OST-C was adapted for schools as a small-group (Tier 2) intervention delivered by school partners (OST-T2). Method: The study was conducted in 22 schools serving students from diverse backgrounds. Students (n = 186; 122 male) in grades 3-5, ages 8-12 (M = 9.7 years; SD = 0.88) with organizational skills deficits referred by teachers were enrolled. Schools were randomly assigned to OST-T2 or treatment-as-usual with waitlist (TAU/WL). OST-T2 consisted of sixteen 35-minute child sessions, two caregiver, and two teacher consultations. Outcomes were evaluated with longitudinal mixed effects modeling at post-treatment, 5-month and 12-month follow-up using caregiver and teacher reports of organizational skills, homework, and academic performance. Results: OST-T2 resulted in reductions in organizational skills deficits on caregiver and teacher report (ps < 0.001) at post-treatment and 5-month follow-up (effect sizes [ES], Cohen's d = 0.96,1.20). Findings also revealed a reduction in caregiver-reported homework problems at post-treatment and 5-month follow-up (ps < 0.001, ES = 0.60, 0.72), and an improvement in teacher-rated homework at post-treatment (p = 0.007, ES = 0.64). Effects were attenuated at 12-month follow-up. The effects of OST-T2 on academic measures were not significant. Conclusions: Findings provide evidence for the immediate and short-term effectiveness of OST-T2 delivered by school professionals. [This paper will be published in the "Journal of Consulting and Clinical Psychology."]
- Published
- 2024
37. Pilot Randomized Trial of a Caregiver-Mediated Naturalistic Developmental Behavioral Intervention in Part C Early Intervention
- Author
-
Melanie Pellecchia, Brooke Ingersoll, Steven C. Marcus, Keiran Rump, Ming Xie, Jeannette Newman, Lisa Zeigler, Samantha Crabbe, Diondra Straiton, Elena Carranco Chávez, and David S. Mandell
- Abstract
Few studies examine the effectiveness of community-based early interventions in unselected samples of autistic children, especially those from minoritized backgrounds. These types of studies require attention to strategies for recruitment, retention, data collection, and support for community providers beyond those used in university-based trials. We conducted a pilot trial of Project ImPACT, a promising caregiver-mediated naturalistic developmental behavioral intervention, in partnership with the early intervention system in a poor, large city. We assessed recruitment and retention strategies, training protocol, and measurement battery. We recruited representative provider and family samples, and had good measure completion among retained participants. Retention varied by study arm, providers had relatively poor fidelity to the intervention despite substantial support, and our measures did not appear sensitive to change. Lessons learned include the need for (a) a ramp-up training period prior to starting the study, (b) intensive implementation supports, and (c) additional strategies for family retention.
- Published
- 2024
- Full Text
- View/download PDF
38. Re-examining the Relation between Social Validity and Treatment Integrity in Ci3T Models
- Author
-
Katie Scarlett Lane Pelton, Kathleen Lynne Lane, Wendy Peia Oakes, Mark Matthew Buckman, Nathan Allen Lane, Grant E. Allen, D. Betsy McCoach, David James Royer, and Eric Alan Common
- Abstract
Educators across the United States have designed and implemented Comprehensive, Integrated, Three-tiered (Ci3T) models to meet K-12 students' academic, behavioral, and social and emotional well-being needs. As part of implementation efforts, educators collect and use social validity and treatment integrity data to capture faculty and staff views of the plan's goals, procedures, and outcomes and the degree to which the plan is implemented as designed (e.g., procedures for teaching, reinforcing, and monitoring). In this study, we re-examined the relation between social validity and treatment integrity utilizing hierarchical linear modeling with extant data from a research partnership across 27 schools in five midwestern districts. Findings suggested an educator's fall and spring social validity score on the Primary Intervention Rating Scale (PIRS) predicted their treatment integrity scores on the Ci3T Treatment Integrity: Teacher Self-Report (CI3T TI: TSR) in the same timepoint. Schoolwide average fall PIRS scores also statistically significantly predicted spring Ci3T TI: TSR scores. Results suggested schoolwide context is important for sustained implementation of Tier 1 procedures during the first year. Findings demonstrate the complex nature of implementing a schoolwide plan, involving each individual's behavior while also relying on others to facilitate implementation. We discuss limitations and future directions.
- Published
- 2024
- Full Text
- View/download PDF
39. Learning Support Zones: Former Students' Experience and Perceived Impact on Home and Work Environment
- Author
-
Cassar, Elise and Abela, Angela
- Abstract
This study explored how past students who attended the Learning Support Zone (LSZ) in Maltese secondary schools perceived their attendance at the LSZ and its impact on their home and work environments. In-depth interviews were conducted with eleven adults who attended the LSZ when they were in secondary school. Thematic analysis was used to elicit a set of themes. The findings highlight the multiple struggles that students with social, emotional and behavioural difficulties (SEBD) face. The narratives highlight the positive impact of the LSZ and its staff, but the families of these students were hardly involved. Social skills, independent living skills, and emotional literacy taught at the LSZ are believed to have helped these youths enhance their motivation and perceived self-worth and deal with adversities more effectively both at home and at work. The key recommendations of the study are the re-evaluation of inclusive policies within schools, consideration of the perspective of the students, better understanding, and monitoring of students with SEBD within schools, and more active involvement of all relevant stakeholders, especially families.
- Published
- 2023
40. Study Review Protocol. Version 5.0
- Author
-
National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES), What Works Clearinghouse (WWC)
- Abstract
The What Works Clearinghouse (WWC) Study Review Protocol accompanies the "WWC Procedures and Standards Handbook, Version 5.0," and guides reviews of studies by the WWC. The WWC uses this protocol to review all studies, including those cited as evidence for U.S. Department of Education grant competitions, studies that were funded by the Department, and studies identified for systematic reviews of evidence based on a search of the research literature in a particular topic area. As articulated in the "Handbook," when the Study Review Protocol is used to review studies for systematic reviews, an accompanying topic area synthesis protocol will provide criteria for the literature search; guidance on how to identify and prioritize relevant studies for review and inclusion in evidence synthesis products; and guidance on intervention, sample, and outcome eligibility criteria for the synthesis. [For "What Works Clearinghouse: Procedures and Standards Handbook, Version 5.0. WWC 2022008," see ED621928.]
- Published
- 2023
41. Charting the Murky Waters of Motivational Climate Measurement: Past Approaches and Future Directions
- Author
-
Cole D. Johnson, So Yeon Lee, Rachael Diamant, and Kristy A. Robinson
- Abstract
Research on classroom motivational climates and microclimates--students' shared and idiosyncratic perceptions of motivational classroom features--demonstrates their importance for fostering adaptive motivational and achievement-related outcomes. However, a lack of coherent theoretical guidance about the nature of students' classroom climate perceptions has yielded numerous conceptualizations and measurement approaches for these processes. Further, although existing theories and conceptualizations vary in the specific motivational climate features they propose, considerable conceptual overlap exists among them. Working toward conceptual clarity, theoretical integration, and guidance for measurement, we performed a systematic review to identify prominent measurement trends in motivational climate research. Results revealed teacher autonomy support and classroom goal structures as the most frequently measured classroom climate qualities. We observed a wide variety of validity evidence for the measures; in particular, a low incidence of studies assessed the factor structure and considered the multilevel nature of climate data, with most treating climate perceptions as student-level phenomena. In addition to providing a much-needed guide of existing measurement practices, this systematic review lays a foundation for the continued theoretical advancement of motivational climate. We call for more rigorous reporting of validity evidence, rationales for measure selection, and the underlying assumptions guiding measure selection when conducting classroom climate research, as well as focused development of instruments targeting less-frequently measured climate constructs.
- Published
- 2024
- Full Text
- View/download PDF
42. A Literature Review on the Effects of Exergames on Executive Function in Youth
- Author
-
Cassondra M. Eng, Rachel M. Flynn, Erik D. Thiessen, and Anna V. Fisher
- Abstract
Exergames (video games that promote cognitive and physical activity simultaneously) benefit executive function (EF) in elderly populations. It has been suggested that exergames may induce larger effects than cognitive or exercise training alone, but few reviews have synthesized the causal factors of exergames on EF from experimental research with youth. This review investigates (a) the various types of exergames and associated comparison conditions; (b) the EF outcome assessments commonly utilized in exergame research with youth; (c) the efficacy of exergames by evaluating experimental studies that compared exergaming to cognitive, exercise, and passive control conditions inclusive of effect sizes; and (d) the potential mechanisms underlying the changes in EF induced from exergames. Eligible outcome data were available from 607 participants across 10 studies, with the age of participants ranging from 4 to 21 (M[subscript age] = 10.46). The findings indicate that exergames improve aspects of EF from both acute and chronic studies. Despite the high variability of exergame contexts, dosages, populations, and outcome assessments, improvements in EF comparing exergaming to passive control conditions were exhibited across all studies. While there is evidence of exergaming demonstrating advantages over passive control conditions, evidence is mixed when comparing exergaming to sedentary cognitive and exercise comparison conditions. Potential sources of these mixed results and future directions to address current gaps in the field are identified. As video game and technology use grows exponentially and concerns of childhood sedentary behavior and play deprivation increase, evidence-based practices that promote both physical and cognitive activity are needed. [This is the online first version of an article published in "Technology, Mind, and Behavior" 2023 (ISSN 2689-0208).]
- Published
- 2023
- Full Text
- View/download PDF
43. 2023-2024 Florida Adult Education Assessment Technical Assistance Paper
- Author
-
Florida Department of Education, Division of Career and Adult Education and Kevin O’Farrell
- Abstract
This technical assistance paper provides policy and guidance to individuals with test administration responsibilities in adult education programs. The Florida assessment policies and guidelines presented in this technical assistance paper are appropriate for state and federal reporting. Therefore, guidance and procedures regarding the selection and use of appropriate student assessment are included. The following important information for adult education programs is provided: (1) Definition of key terms and acronyms; (2) Selection of appropriate assessments by student and program type; (3) Appropriate student placement into program and instructional level; (4) Verification of student learning gains, EFL, and/or program completion; (5) Accommodation for students with disabilities and other special needs; (6) Assessment procedures for Distance Education; and (7) Training for all staff who administer the standardized assessments.
- Published
- 2023
44. The Impact of Service-Learning on Occupational Therapy Doctoral Students
- Author
-
Valdes, Kristin, Rider, John, Leach, Christen, and Manalang, Katie Capistran
- Abstract
The aim of this study was to determine how participation in a community service project impacts entry-level OT doctoral (OTD) students at different time points in their education. This study employed a mixed-method, prospective cohort design. The Community Service Attitudes Scale (CSAS) is an instrument to measure college students' attitudes about community service. Open-ended questions were asked after participation in the experience in addition to the CSAS to gather a deeper reflection of the S-L experience. A total of 62 OTD students participated in the study. There was no statistically significant difference between the CSAS scores between the OTD first-year and third-year students. Students reported that they gained knowledge regarding occupational justice and community-based interventions, how to establish a therapeutic relationship, and the impact of occupation-based interventions when asked what they learned from the experience. Through the participation in a S-L experience, the students gained knowledge regarding occupational justice and community-based interventions, how to establish a therapeutic relationship, and an awareness of the impact of occupation-based interventions on clients. S-L enables OT educators to provide opportunities for students to gain critical skills that will translate into clinical practice.
- Published
- 2023
45. Effects of EMI-CLIL on Secondary-Level Students' English Learning: A Multilevel Meta-Analysis
- Author
-
Lee, Jang Ho, Lee, Hansol, and Lo, Yuen Yi
- Abstract
This meta-analysis synthesized the effects of the English medium instruction and content and language integrated learning (EMI-CLIL) approach on secondary-level students' English learning. The dataset included 44 samples (N = 7,434) from 38 primary studies. The results revealed EMI-CLIL's overall effectiveness for the development of English competence compared to the mainstream condition in the short term (d = 0.73, SE = 0.06, 95% CI [0.61, 0.86]) and longer term (d = 1.01, SE = 0.06, 95% CI [0.88, 1.15]). Additionally, we found that EMI-CLIL's overall effectiveness was influenced by several moderator variables. Its effectiveness was significantly: (1) higher for learners whose first language (L1) was linguistically related to English; (2) lower for primary studies which confirmed the homogeneity of the EMI-CLIL and comparison groups; (3) lower when studies targeted the productive (rather than receptive or overall) dimension of English learning; and (4) higher when outcome measures focused on vocabulary. Implications for pedagogy and future research are discussed.
- Published
- 2023
46. Longitudinal Study of Georgia's Pre-K Program. Final Report: Pre-K through 4th Grade
- Author
-
University of North Carolina at Chapel Hill, FPG Child Development Institute, Soliday Hong, S., Zadrozny, S., Walker, J., Love, E. N. G., Osborne, J. D., Owen, J. L., and Peinser-Feinberg, E.
- Abstract
The purpose of this evaluation study was to examine children's longitudinal academic and social outcomes associated with attendance in Georgia's Pre-K Program and to examine the quality of the classrooms attended. This report covers pre-k to 4th grade outcomes collected between the 2013-2014 and 2018-2019 school years as well as a sub-study comparing 3rd and 4th grade outcomes of children who attended Georgia's Pre-K Program with children who did not attend any pre-k program. The primary evaluation questions include: (1) What are the longitudinal outcomes through 4th grade for children who attended Georgia's Pre-K Program?; (2) What factors predict better longitudinal outcomes for children?; (3) What is the quality of children's instructional experiences from pre-k through 4th grade?; and (4) Are there differential long-term outcomes for children with and without Georgia's Pre-K experience? [For the summary report, see ED630838.]
- Published
- 2023
47. 'I Have a Few Questions': Reframing Assessment Practice as Asking and Answering Questions That Matter
- Author
-
Finney, Sara J.
- Abstract
Student affairs educators are asked fundamental questions about programming and its effectiveness. Stakeholders (e.g., students, parents, accreditors) ask what programming (e.g., activities, strategies, curriculum) is offered, "why" it is offered, and "who" benefits in terms of learning and development (e.g., Carpenter, 2001; US Department of Education, 2006). Given these questions are typical and expected, I illustrate how outcomes assessment can be represented as a process of answering common and pertinent questions that matter in higher education. In turn, the assessment process is presented as a valued activity to student affairs educators, not something novel or an add-on. Moreover, a question-answering approach has been shown to be less controlling than direct appeals (Walton & Wilson, 2018), prompting subsequent task engagement (Wood et al., 2016). Therefore, processing assessment-related questions should prompt engagement in outcomes assessment.
- Published
- 2023
48. An AI Generated Test of Pragmatic Competence and Connected Speech
- Author
-
Stefan O'Grady
- Abstract
Language testing is witnessing increasing interest in the potential for AI to support test development and validation. To date, published research involving AI in language testing has typically been conducted in the context of high-stakes proficiency tests and the potential for this technology to support local language testing is under-researched. The current study seeks to address this gap by reporting on the piloting of an AI generated language test in the context of a university in the UK. The focus of the paper was selected to explore two key areas in the work of J.D. Brown, namely pragmatics and connected speech. In the study, international students with English as a second language completed an AI generated test of pragmatics created from a transcript of spontaneous interaction, and a test-taking strategy questionnaire. Results demonstrated that the test did not provide a sufficiently reliable measurement of test takers' pragmatic competence, although reliability estimates did improve with the removal of problematic items. Implications for language test development involving AI are discussed.
- Published
- 2023
49. E-Learning Performance Assessment Model Proposal for E-Learning Academies
- Author
-
Yahya Yilmaz and Mutlu Tahsin Üstündag
- Abstract
Corporates provide e-learning systems to their employees to improve their knowledge and competences needed in job descriptions. This study aims to propose a model that measures and analyzes real user data in e-learning system to measure the targeted personal development and learning level of employees of corporates with elearning academies according to different criteria, compare the success level, and evaluate the effect of training on job performance. Employees' training activities, departments, positions, assessment and survey results, and other related data are recorded in the e-learning system and collected from the e-learning system, LMS (Learning Management System), by data mining method. The document also reviews the System Approach, Kirkpatrick's Four Levels of Training Evaluation Model, Balanced Scorecard, KPI (Key Performance Index), and OKR (Objectives and Key Results). In order to make a performance assessment in the model, data collected from e-learning systems is used, and the academy enters its own target data into the model. The results are associated with the corporate's KPI and OKR targets in the model. Model output is visualized for management review. The results declare that the model helps the academy have a holistic perspective for training activities associated with corporate target, a realistic review of effects of training on job performance, and possible opportunities and plans for future development of the trainings. [This article includes an extended summary in Turkish.]
- Published
- 2023
50. In Need of a Research Base: Evidence-Based Reading Interventions for Elementary Students with Overlapping EBD and LD
- Author
-
Burke, Mack D., Boon, Richard T., Bowman-Perrott, Lisa, and Hatton, Heather
- Abstract
Students with or at-risk of emotional/behavioral disorders (EBD) often have reading difficulties and/or undiagnosed learning disabilities (LD). Reading challenges among this group of children and youth often exacerbate associated emotional and/or behavioral problems. This systematic review and quantitative synthesis yielded seven studies focused on improving the reading outcomes of students with or at-risk of EBD at the elementary school level. Summarized are participant and reading intervention characteristics across the seven studies. Effect sizes were calculated for each study, and results are reported for both academic and behavioral outcome measures. Implications for research and practice are discussed.
- Published
- 2023
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.