Search

This study investigated the teaching experiences of three school personnel at a public high school during the 2020–2021 school year as they implemented a unique science, technology, engineering, arts, and math (STEAM) unit with in-person and virtual students in their engineering classes during the Covid-19 pandemic. A research team interviewed two teachers and one administrator at the school to better understand the nuances of pre-college engineering during a pandemic year and how changes in school and district policy affected the instructional delivery of STEAM projects. Narrative analytic methods were utilized to understand each participant’s experience and an inductive content thematic approach was used to develop the findings. The participants described varied experiences navigating instruction during the pandemic, particularly when adapting hands-on STEAM projects for virtual or hybrid teaching. All three participants thought deeply about how to best meet the needs of students while attempting to support equitable instruction. The findings of this study indicate that pre-college engineering in the pandemic was challenging for the participants, but not impossible, and that this setting was an appropriate context for STEAM projects that provided students with a mechanism for collaboration and engagement.

The GoSTEAM program promotes authentic integration of the arts into PreK-12 computer science, engineering, and invention instruction. STEM and arts teachers come together to form STEAM Innovation Teams in collaboration with university-based coaches and creative Innovators-in-Residence. Starting with a STEAM professional development summer institute and continuing throughout the year, the teams come together to design and implement novel STEAM lessons and initiatives in their schools that integrate learning goals from both the STEM and the art disciplines. This type of transdisciplinary collaboration between colleagues from vastly different fields is new to most teachers and presents unique challenges. A primary goal of the GoSTEAM professional development is therefore to create safe, interdisciplinary spaces where meaningful, cross-disciplinary collaborations can occur. In 2019, this was accomplished through an intensive, 120-hour face-to-face summer professional institute that incorporated many community building activities and collaborative planning sessions. In 2020, due to the COVID-19 pandemic, the summer institute changed to an online format and faced the challenge of providing teachers with a personally meaningful STEAM experience during a summer of crisis. Results show that the 2020 institute successfully supported the teachers, energized them, and provided them with tools to augment their virtual instruction. This paper describes the program adaptations due to COVID-19.

Advanced Manufacturing and Prototyping Integrated to Unlock Potential (AMP-IT-UP) is a National Science Foundation (NSF) funded K-12 Math & Science Partnership (MSP) project with a goal of promoting math, science, and engineering learning through STEM integration-focused curricula. As part of this project, curriculum writers developed one-week modules providing instruction on a set of STEM practices within the context of the appropriate grade-level content. These STEM practices are Experimental Design, Data Visualization, and Data-Driven Decision Making; the emphasis of each of these practices is, respectively, the collection of data, the representation of data, and the use of data to support complex decision-making. Nine of these one-week modules were created in the science domain, one focused on each practice at grade levels 6, 7, and 8. A parallel set of nine modules in the math domain were also created. In this paper, we will focus on our assessment of the implementation of these modules across four middle schools. We will present our methodology for assessing this complex instructional effort. Data sources included online implementation surveys, teachers’ on-line posts, as well as classroom observations. Findings were triangulated across these multiple data sources to provide detailed insights into curriculum functioning and teacher experiences. We will also provide some results from pre-post assessments of student learning, which were written for a subset of the science modules. Overall, the results indicate positive teacher experiences as well as significant increases in student learning in some modules. Findings from these data sources were used by curriculum developers to inform later iterations of the modules.

Evidence-centered design (ECD) is an assessment framework tailored to provide structure and rigor to the assessment development process, and also to generate evidence of assessment validity by tightly coupling assessment tasks with focal knowledge, skills, and abilities (FKSAs). This framework is particularly well-suited to FKSAs that are complex and multi-part (Mislevy and Haertel, 2006), as is the case with much of the focal content within the computer science (CS) domain. This paper presents an applied case of ECD used to guide assessment development in the context of a redesigned introductory CS curriculum. In order to measure student learning of CS skills and content taught through the curriculum, knowledge assessments were written and piloted. The use of ECD provided an organizational framework for assessment development efforts, offering assessment developers a clear set of steps with accompanying documentation and decision points, as well as providing robust validity evidence for the assessment. The description of an application of ECD for assessment development within the context of an introductory CS course illustrates its utility and effectiveness, and also provides a guide for researchers carrying out related work.

Engineering and integrated STEM experiences are being promoted at the K-12 level to increase interest and retention in STEM and to reinforce learning of mathematics and science content. However, research is still emerging regarding best practices for curriculum development, student impacts, and transfer of knowledge across disciplines. The purpose of this study is to investigate the impact of middle school engineering curriculum on students‘ academic achievement in science and mathematics and also on non-cognitive skills such as student engagement and self-efficacy in academics. Specifically, the Engineering Design Process (EDP) conceptual model is used as a framework for the engineering curriculum, which is also grounded in Problem-Based Learning (PBL) practices while integrating science practices and foundational mathematics. Participants include 6th-8th grade students at four public middle schools in Georgia. The research results show that students who have taken at least two engineering courses show statistically significant gains on state-level standardized science and mathematics tests over those students who were never enrolled in these courses. Further, the results show a statistically significant increase in cognitive and behavioral engagement in STEM and science interest. The results of this study support the idea that enabling students to practice their science and mathematics skills and knowledge within the context of interesting and engaging middle school engineering classes can significantly benefit both their engagement in STEM and their academic achievement.

The present study compared the effectiveness of a self-affirmation and a role model guest lecture intervention on reducing students’ perceptions of science-related social identity threat. Participants included 67 Latino high school students enrolled in a college preparation program. Students were randomly assigned either to a self-affirmation intervention or a self-affirmation control task, and the role model intervention was open to all students, with some choosing to participate. Results from an ANCOVA found the combination of both interventions had an identity threat reducing effect of moderate magnitude on perceptions of identity threat, and planned contrasts found statistically significant differences in perceptions of identity threat between students who received both interventions and no intervention, and between students who received both interventions and the self-affirmation task alone. Our research suggests that using multiple and combined interventions might provide an important advantage in order to reduce perceptions of identity threat in Latino students.

This paper illustrates the use of simulation-based performance assessment (PA) methodology in a recent study of eighth-grade students’ understanding of physical science concepts. A set of four simulation-based PA tasks were iteratively developed to assess student understanding of an array of physical science concepts, including net force, acceleration, velocity, and inertia. Illustrative examples drawn from the administration of these simulation-based PA tasks to a sample of eighth-grade students (n = 74) highlight the potential of simulation-based tasks for revealing conceptual understanding of science concepts and for informing curriculum development within the context of design-based implementation research. The paper also describes a variety of challenges encountered over the course of the development, administration, and analysis of the PA data that may be informative for researchers and educators as they consider implementing simulation-based PAs.

Performance assessment (PA) has been increasingly advocated as a method for measuring students’ conceptual understanding of scientific phenomena. In this study, we describe preliminary findings of a simulation- based PA utilized to measure 8th grade students’ understanding of physical science concepts taught via an experimental problem-based curriculum, SLIDER (Science Learning Integrating Design Engineering and Robotics). In SLIDER, students use LEGO robotics to complete a series of investigations and engineering design challenges designed to deepen their understanding of key force and motion concepts (net force, acceleration, friction, balanced forces, and inertia). The simulation-based performance assessment consisted of 4 tasks in which students engaged with video simulations illustrating physical science concepts aligned to the SLIDER curriculum. The performance assessment was administered to a stratified sample of 8th grade students (N=24) in one school prior to and following implementation of the SLIDER curriculum. In addition to providing an illustration of the use of simulation- based performance assessment in the context of design-based implementation research (DBIR), the results of the study indicate preliminary evidence of student learning over the course of curriculum implementation.

With the inclusion of engineering disciplinary core ideas (DCIs), the Next Generation Science Standards (NGSS) position engineering as a new priority in K–12 science classrooms. This paper reports findings from the implementation of SLIDER, a problem-based learning 8th grade physical science curriculum that integrates engineering and physical science core ideas. As a culminating engineering design challenge, the SLIDER curriculum asks students to apply their understanding of energy, motion, and forces to design an automatic braking system for a robotic truck. The paper describes the curriculum and synthesizes findings from an array of data sources including student design interviews, written design recommendations, engineering notebooks, pre- and post-assessments, and teacher interviews to address two research questions: (1) To what extent and in what ways do students participating in the SLIDER curriculum engage in NGSS engineering DCIs: defining problems, developing solutions, and optimizing solutions? (2) To what extent and in what ways do students draw upon their understanding of science concepts as they engage in engineering design? Findings indicate variations in the degree to which students participating in the SLIDER curriculum engaged across the three NGSS engineering DCIs, with students generally demonstrating competency with regard to identifying and delimiting the engineering problem (ETS1.A) and, to varying degrees, developing solutions (ETS1.B) but experiencing more challenges engaging in the optimization of design solutions (ETS1.C). Findings also illustrate the degree to which students were able to apply their knowledge of relevant physical science core ideas (e.g., friction, force) as they developed and communicated their solutions. Implications of the findings for instruction, curriculum development, and assessment are discussed.

The purpose of this study is to thoroughly describe a program designed to strengthen the pipeline of Latino students into post-secondary science, technology, engineering, and mathematics (STEM) education, and present evaluation data to assess multiyear effectiveness. The program includes a suite of interventions aimed at students and families, and was implemented in a low-income school cluster with a high Latino population in metro Atlanta. Our intervention includes a high school and middle school mentoring program, STEM-focused extracurricular activities (summer camps, research and community service opportunities), and college and STEM career-focused community events for families. Results suggest that GoSTEM has a positive impact on students and families with respect to college and career awareness. The mentoring program components also increase students’ college readiness and self-regulatory skills at the high school level. The ex¬tracurricular programs support this effort by increasing students’ STEM-related content knowledge and learning, and their understanding about STEM careers for both high school and middle school students. Lessons learned are also presented to help guide other practitioners of Latino outreach programs.

The objective of robotics competitions, such as FIRST LEGO® League (FLL®), is to create a tournament that promotes high-level engineering and academic engagement in students by providing the most rewarding experience possible for the largest group of students. To increase the number of students age 9-14 successfully participating in FLL® from public schools, and to concurrently increase the diversity of the pool of student participants, the Georgia FLL® organizers have implemented a number of interventions. These interventions can be grouped into A) Centralized policy decisions that impact how the program is run at the state level; B) Outreach activities that provide low-income teams with training and supplies; C) Promotion of LEGO® Mindstorm use within the actual school curriculum; and D) Partnerships with school systems to promote after-school FLL® robotics clubs. This chapter reviews these efforts and their effect on tournament diversity.