Search

Background: Despite the prevalence and potential of K-12 engineering outreach programs, the moment-to-moment dynamics of outreach educators' facilitation of engineering learning experiences are understudied. There is a need to identify outreach educators' teaching moves and to explore the implications of these moves. Purpose/Hypothesis: We offer a preliminary framework for characterizing engineering outreach educators' teaching moves in relation to principles of ambitious instruction. This study describes outreach educators' teaching moves and identifies learning opportunities afforded by these moves. Design/Method: Through discourse analysis of video recordings of a university-led engineering outreach program, we identified teaching moves of novice engineering outreach educators in interaction with elementary student design teams. We considered 18 outreach educators' teaching moves through a lens of ambitious instruction. Results: In small group interactions, outreach educators used ambitious, conservative, and inclusive teaching moves. These novice educators utilized talk moves that centered students' ideas and agency. Ambitious moves included two novel teaching moves: design check-ins and revoicing tangible manifestations of students' ideas. Ambitious moves offered students opportunities to engage in engineering design. Conservative moves provided opportunities for students to make technical and affective progress, and to experience engineering norms. Conclusions: Our work is formative in describing engineering outreach educators' teaching moves and points to outreach educators' capability in using ambitious moves. Ambitious engineering instruction may be a useful framework for designing engineering outreach to support students' participation and progress in engineering design. Additionally, conservative teaching moves, typically considered constraining, may support productive student affect and engagement in engineering design.

Professional development opportunities for museum educators are often short-term experiences that are void of reflections to support one's professional growth and practices within a collaborative environment. Video clubs may serve as an effective approach to supporting the professional growth and practices of educators in museum settings. Video clubs are composed of a group of educators engaged in video-based reflections around their work and interactions with others. In collaboration with six museums, we considered how video clubs, developed and implemented to promote professional growth and learning in school learning environments, would translate to a museum learning environment with a specific focus on interactions of failure experiences in STEAM-related making programs. In this paper, we highlight benefits, challenges, learnings, and recommendations as a way to support museums interested in establishing and implementing reflective practices within video recording and video sharing.

Background: Capturing measures of students' attitudes toward science has long been a focus within the field of science education. The resulting interest has led to the development of many instruments over the years. There is considerable disagreement about how attitudes should be measured, and especially whether students' attitudes toward science can or should be measured unidimensionally, or whether separate attitude dimensions or subscales should be considered. When it is agreed upon that the attitudes toward science construct should be measured along separate subscales, there is no consensus about which subscales should be used. Methods: A streamlined version of the modified Attitudes Towards Science Inventory (mATSI), a widely used science measurement instrument, was validated for a more diverse sample as compared to the original study (Weinburgh and Steele in Journal of Women and Minorities in Science and Engineering 6:87-94, 2000). The analytical approach used factor analyses and longitudinal measurement invariance. The study used a sample of 2016 self-reported responses from 6 and 7th grade students. The factor analysis elucidated the factor structure of students' attitudes toward science, and some modifications were made in accordance with the results. Measurement invariance analysis was used to confirm the stability of the measure. Results: Our results support that the subscales, "anxiety toward science" and "value and enjoyment of science," are two factors and stable over time. Conclusions: Our results suggest that our proposed modified factor structure for students' attitudes toward science is reliable, valid, and appropriate for use in longitudinal studies. This study and its resulting streamlined mATSI survey could be of value to those interested in studying student engagement and measuring middle-school students' attitudes toward science.

To remedy the disparity between sexes in science, technology, engineering, and mathematics (STEM) fields, it is important to understand the factors critical to initiating and maintaining STEM interest. To this end, we created and administered a survey to almost 8,000 individuals in and outside of STEM fields. Our results shed light on the various factors that are critical for sparking STEM interest and persisting in STEM fields for each sex as well as the differences in movement in and out of STEM pathways for each. These results reveal that although there is no singular pathway into STEM fields, self-driven interest is a large factor in persistence, especially for males, and females rely more heavily on support from others.

Interactive learning environments with body-centric technologies lie at the intersection of the design of embodied learning activities and multimodal learning analytics. Sensing technologies can generate large amounts of fine-grained data automatically captured from student movements. Researchers can use these fine-grained data to create a high-resolution picture of the activity that takes place during these student-computer interactions and explore whether the sequence of movements has an effect on learning. We present a use-case modelling of temporal data in an interactive learning environment with hand gestures, and discuss some validity threats if temporal dependencies are not accounted for. In particular, we assess how, if ignored, the temporal dependencies in the measurement of hand gestures might affect the goodness of fit of the statistical model and would affect the measurement of the similarity between elicited and enacted movement. Our findings show that accounting for temporality is crucial for finding a meaningful fit to the data. In using temporal analytics, we are able to create a high-resolution picture of how sensorimotor coordination correlates with learning gains in our learning system.

Purpose: This study aims to understand how graduate students in a maker education course discuss beliefs about making and implement these beliefs as pedagogy in their curricular designs. Design/methodology/approach: Interview transcripts from seven students were analyzed thematically for conceptions of making and learning. Lesson plans were also coded for elements of making, and the authors compared students' articulated ideas about making with the practical implementation of making in their designs. Findings: Students reflected on the nature of making and the possible benefits and tensions surrounding the use of making for learning. Multiple students discussed benefits for their future learning and careers. Comparisons between interview and lesson plans highlight both successful alignments and key gaps in the application of making principles, including struggles that students encountered when translating their beliefs about making into real-world pedagogy. Research limitations/implications: Given the limited sample size, future research should explore the extent to which educators in other contexts encounter similar or different obstacles in their development of maker-focused pedagogies. Practical implications: Findings can be used to inform future maker education courses to better support students in successfully translating core principles of making from general beliefs into effective and practical pedagogical strategies. Originality/value: Despite widespread interest in combining making with educational spaces, much remains to be understood about the strategies that educators use to integrate elements of making into their pedagogy. This study contributes discussions of the benefits and tensions that maker educators may encounter when blending tenets of making with the needs of formal education.

The purpose of this exploratory study is to propose a pedagogical nexus for maker educators that is specific to making and tinkering in K–12 formal learning environments. The intent is to document the pedagogical approaches of practising teachers as they gain experience with making practices and principles. Based on the analysis of interview data from 24 self-identified maker educators, participants created opportunities and provided instructional support to engage students in making through the use of five approaches: Tool/Technique-Focused Making, Curriculum-Focused Making, Inquiry-Focused Making, Application-Focused Making and Interest-Focused Making. While differences in terms of the goal of the making activity existed within each approach, there were also commonalities across the approaches such as student outcomes and means of assessment. The authors discuss implications for the use of these pedagogical approaches of making and possibilities for future research. [ABSTRACT FROM AUTHOR]

Background: Despite the increasing number of science, technology, engineering, and mathematics (STEM) jobs available, concern continues to grow over the low number of students who choose to study and enter STEM fields. Research suggests that children begin to identify their interests and career aspirations related to STEM as early as elementary school when they begin to shape their personal identities and start making decisions about who they "are" and "could be" in the future, their role identities (e.g., scientist, engineer). Existing surveys that assess identity target high school or post-secondary students, with less work on elementary and middle school students. This paper describes the development and validation of survey instruments to assess engineering identity in elementary students and its adaptation to a more general STEM context. Results: The role identity survey in engineering (RIS-E) was developed across four phases of pilot testing where it was administered to 634 students in third-sixth grade enrolled in classrooms in the West, Midwest, and Northeastern United States. Exploratory modeling approaches and scale reliability were used to narrow down items, while confirmatory factor analyses (CFA) and item response theory (IRT) approaches were used to examine item performance. The final survey contained four scales that assess aspects of one's identity (competence, interest, self-recognition, and recognition by others), all of which demonstrated strong psychometric properties. The RIS-E was then adapted to assess STEM identity (RIS-STEM), and it was administered to 678 fourth-fifth grade students enrolled in classrooms in the Southwestern United States. CFA and IRT analyses provided support for use of the RIS-STEM in a more general STEM context. Conclusions: The RIS-E and RIS-STEM appear to produce reliable scores that measure aspects of identity (engineering and STEM) in elementary students. Suggestions are made for future studies to examine how the RIS-E and RIS-STEM function across diverse student populations and the impact on one's identity as a result of curricula or programs designed to encourage and support identity development in youth, especially in engineering and STEM.

Undergraduate research experiences in science, technology, engineering, and mathematics fields are championed for promoting students' personal and professional development. Mentorship is an integral part of undergraduate research, as effective mentorship maximizes the benefits undergraduates realize from participating in research. Yet almost no research examines instances in which mentoring is less effective or even problematic, even though prior research on mentoring in workplace settings suggests negative mentoring experiences are common. Here, we report the results of a qualitative study to define and characterize negative mentoring experiences of undergraduate life science researchers. Undergraduate researchers in our study reported seven major ways they experienced negative mentoring: absenteeism, abuse of power, interpersonal mismatch, lack of career support, lack of psychosocial support, misaligned expectations, and unequal treatment. They described some of these experiences as the result of absence of positive mentoring behavior and others as actively harmful behavior, both of which they perceive as detrimental to their psychosocial and career development. Our results are useful to mentors for reflecting on ways their behaviors might be perceived as harmful or unhelpful. These findings can also serve as a foundation for future research aimed at examining the prevalence and impact of negative mentoring experiences in undergraduate research.

A lot of attention has been given to the role failure plays in learning and innovation. Yet, we know little about the conditions necessary for the experience to result in positive outcomes. In this study, we sought to answer three research questions: (1) What is the relationship among attend, interpret, and respond when experiencing failures within making-related activities? (2) How does youths' and educators' noticing of failure within making-related activities differ by tasks? (3) How does youths' and educators' noticing of failures within making-related activities differ by context? To address these questions, we used data collected from youths participating in making experiences in three different contexts: schools, a science museum, and an afterschool program run by science museum educators. Analysis of approximately 90 h of video revealed differences in how youths and educators attended, interpreted and responded to failures that suggest differences in the sophistication of their response. Educational implications from these findings support less direct oversight by educators and increased use of techniques to have the youth demonstrate positive troubleshooting behaviors.

Given the centrality of data visualizations in communicating scientific information, increased emphasis has been placed on the development of students' graph literacy--the ability to generate and interpret data representations--to foster understanding of domain-specific knowledge and the successful navigation of everyday life. Despite prior literature that identifies student difficulties and methods to improve graphing competencies, there is little understanding as to how learners develop these skills. To gain a better resolution of the cognitive basis by which individuals "see" graphs, this study uses eye tracking (ET) to compare the strategies of non-science undergraduates (n = 9), early (n = 7) and advanced (n = 8) biology undergraduates, graduate students (n = 6), and science faculty (n = 6) in making sense of data displays. Results highlight variation in how individuals direct their attention (i.e., fixations and visual search patterns) when completing graph-based tasks as a function of science expertise. As research on the transition from novice to expert is crucially important in understanding how we might design curricula that help novices move toward more expert-like performance, this study has implications for the advancement of new strategies to aid the teaching and learning of data analysis skills.

The focus of this research was to investigate how students learn to do fieldwork through observation. This study addressed the following questions: (1) Can mobile eye-tracking devices provide a robust source of data to investigate the observations and workflow of novice students while participating in a field exercise? If so, what are the strengths and limitations of mobile eye tracking? (2) If these devices offer a unique source of data to investigate student work, what findings might be helpful for improving field instruction? To address these questions, we used mobile eye-tracking devices in a pilot study to collect video from students completing mapping exercises during a geology field course. Data were collected from six students participating in two different parts of an exercise where they were asked to create geological maps of an area based on their field observations. From this study, we learned that conducting eye-tracking research in field conditions is technically demanding and operationally difficult. We found that most of our analysis was based on reviewing the scene video and did not require the eye-tracking information. In reviewing the scene videos, substantive features of students' observational practices were exposed. We found that students struggle with foundational mapping practices, miss opportunities to collect key data, and are often distracted or disengaged during direct instruction. We observed instances of swarm behavior where students tend to group around outcrops even when nominally working independently. We also noted key differences in student behavior working individually compared with group mapping. We believe these findings provide data for geoscience educators to consider when thinking about ways in which to develop the observational skills of their students and to design appropriate field course instruction.

Misconceptions are the "the old, the bad, and the ugly" prior knowledge, ideas or conceptions that the learners have that hinder their further learning in science. Several types of misconceptions that undergraduate students hold about reaction coordinate diagrams (from here on we use the term "reaction coordinate diagrams" and "energy diagrams" interchangeably) are described herein. The rationale of 223 students were coded based on their responses to a multiple-choice question on the topic, and interviews (n = 10) were used to delve deeper into the students' knowledge structures. The results of the open coding of the rationale and the interviews were used in developing an instrument which was administered to 57 students. In this paper, we present the assessment instrument and the alternate conceptions that students have regarding energy diagrams that have not been reported in the literature yet. Implications for instructional approaches particular to the energy diagram topic are discussed.

This study investigated the interaction between students' academic background (high school grades, standardized exams, and enrollment in advanced high school courses) and how much autonomy they reported having in high school science through labs and projects. The objective was to see if students who reported experiencing more or less self-directed projects and labs performed differently in college science when prior academic background was taken into account. To provide a more solid foundation for the conclusions, the same analysis was performed on three different data sets in biology, chemistry, and physics. The authors found that autonomous learning activities in high school science interact with high school mathematics grades to produce a significant association with college science grades. (Contains 3 tables and 1 figure.)

Using a national survey of more than 7,000 students from 128 different college introductory science courses, the authors compared students who experienced Block scheduling and Traditional scheduling in high school. (Contains 1 table and 2 figures.)

National calls in science, technology, engineering, and technology education reform efforts have advanced the wide-scale engagement of students in undergraduate research for the preparation of a workforce and citizenry able to attend to the challenges of the 21st century. Awareness of the potential benefits and costs of these experiences has led to an emerging literature base outlining gains in participants' cognitive, affective, and conative domains to support the impact of undergraduate research for students of all backgrounds; however, the majority of this work has relied on self-report data limiting inferences to the causal effects on student learning. As part of a larger project on apprentice-like undergraduate research experiences (UREs) in the physical sciences, the present exploratory study complemented indirect self-report data with direct performance data to assess the development of chemistry students' scientific thinking skills over a research experience. Performance data were collected using the Performance assessment of Undergraduate Research Experiences (PURE) instrument, a validated tool designed to assess changes in chemistry students' analytical and data driven decision-making skills through open-response tasks situated in real-world problems from primary literature. Twenty-four summer research students in chemistry (46% women; 50% 1st/2nd year students; 42% first time URE participant) from seven colleges and universities provided baseline and post-intervention performance data. Differences in pre/post-response task correctness provided a direct measure of individual changes in student competencies. Early study findings indicate the positive contributions of UREs to student's competencies in the areas of problem-solving, experimental design and the use of research techniques, data analysis and the interpretation of results, and the evaluation of primary literature. Survey data were also collected on students' self-skill ratings to allow comparisons between perceived and demonstrated competencies, which were found to be weakly correlated. This work begins to offer direct evidence to the effect of UREs on student learning progressions as well as the potential use of performance test data in evaluating the success of research training interventions designed to improve scientific thinking skills.

Engaging students in class is paramount if they are to gain a deep understanding of class content. Student engagement is manifested by attention to the various components of instruction. However, there is little research at the tertiary level focusing on what aspects of instruction are related to changes in student attention during class. To address this gap, we collected multiple streams of data that provide a measure of student attention during instruction. We had students in an organic chemistry course who wear hats with a camera mounted on the brim, to provide a record of student gaze (i.e. looking at the board, notes, and friends). We also had students who use electronic pens that allowed us to record what information students transferred into their notes (pencasts). Based on our initial results, we believe the data provided by the point-of-view cameras and electronic pens hold great promise for using these technologies as viable research tools in educational settings to address various research questions.

Understanding how geologists conduct fieldwork through analysis of problem solving has significant potential impact on field instruction methods within geology and other science fields. Recent work has highlighted many aspects of fieldwork, but the problem solving behaviors displayed by geologists during fieldwork and the associated cognitive processes remain poorly understood. We present research showing how geology students initiate and develop geologic models as part of the problem solving process. We qualitatively analyzed field notes and interview data from 36 undergraduate geoscientists engaged in field exams during a 6-week advanced field camp. Eight cognitive approaches grouped in two broad categories emerged from the data that show how students develop geologic models. Students employ both single and multiple model approaches with varying degrees of success and frequency. The success of any given approach appears to be dependent on the level of students' geologic situation awareness. The development of multiple geologic models leads to a higher rate of success in general, because of the inherent flexibility to accommodate newly collected data. Instructors should continue to teach a multiple model approach until students have the proper geologic skills to ensure a high level of situation awareness and exhibit expert characteristics in the field. Furthermore, students should be instructed to eliminate weaker models as they progress throughout each mapping assignment.

In the STEM fields, adequate proficiency in reading and interpreting graphs is widely held as a central element for scientific literacy given the importance of data visualizations to succinctly present complex information. Although prior research espouses methods to improve graphing proficiencies, there is little understanding about when and how students develop these skills during the course of their education. To address this gap in the research, we sought to create an assessment tool to measure differences in these abilities across groups with varied levels of experience in science, technology, engineering, and mathematics. This study presents results from a data visualization literacy assessment we created to begin to understand the development of expertise in this domain.

Previous research has established the importance of early interest in STEM as a key factor in persistence. Our current research builds on this foundation and extends it to add more detail to understanding the types of experiences that trigger and maintain interest in science, technology, engineering, and mathematics (STEM). Using survey data from nearly 8,000 individuals, we are able to address the "When?," "What?," and "Who?" of those first experiences. Additionally, our data provide information on the types of experiences that maintained interest (or not) beyond the triggering event. Through purposeful sampling, our data include those who ended up in STEM fields and those who did not, which allows us to make important comparisons across these groups. Overall, our findings indicate that individuals who complete STEM degrees have quite varied histories and that the triggering of their interest happened across a wide age spectrum. Similarly, in terms of who was involved or what their triggering experience was, the general results support the notion that there are many pathways to STEM with no clear preferential pathway.

Professional development opportunities for museum educators are often short-term experiences that are void of reflections to support one's professional growth and practices within a collaborative environment. Video clubs may serve as an effective approach to supporting the professional growth and practices of educators in museum settings. Video clubs are composed of a group of educators engaged in video-based reflections around their work and interactions with others. In collaboration with six museums, we considered how video clubs, developed and implemented to promote professional growth and learning in school learning environments, would translate to a museum learning environment with a specific focus on interactions of failure experiences in STEAM-related making programs. In this paper, we highlight benefits, challenges, learnings, and recommendations as a way to support museums interested in establishing and implementing reflective practices within video recording and video sharing. [ABSTRACT FROM AUTHOR]

The loss of talented women from the science, technology, engineering, and mathematics (STEM) pipeline has been widely recognized within science education as a pressing issue, particularly in the physical sciences. To provide a gender-based perspective of a popular educational device, the present study evaluated undergraduate research experiences (UREs) from a longitudinal perspective in respect to participation, learning enhancements, and contribution to the pursuit of a postgraduate education. Data from practicing scientists and graduate students indicated that women were more likely to participate in these research programs than their male counterparts. Of those who had participated (n = 1829), similar patterns in conferred gains for men and women were reported; however, gender-based variations were observed within items associated with self-efficacy, science interest, and the practice of authentic research. Women were found to identify UREs as a primary reason for entering graduate school at a significantly higher rate than their male counterparts. Results of this study suggest the long-term efficacy of UREs as a gateway for women interested in STEM careers and provide support in justifying research programs and initiatives for women in traditionally male-dominated fields. (Contains 2 tables and 2 figures.)

For more than half a century concerns about the ability of American students to compete in a global workplace focused policymakers' attention on improving school performance generally, and student achievement in science, technology, engineering, and mathematics (STEM) specifically. In its most recent form--No Child Left Behind--there is evidence this focus led to a repurposing of instructional time to dedicate more attention to tested subjects. While this meant a narrowing of the curriculum to focus on English and mathematics at the elementary level, the effects on high school curricula have been less clear and generally absent from the research literature. In this study, we sought to explore the relationship between school improvement efforts and student achievement in science and thus explore the intersection of school reform and STEM policies. We used school-level data on state standardized test scores in English and math to identify schools as either improving or declining over three consecutive years. We then compared the science achievement of students from these schools as measured by the ACT Science exams. Our findings from three consecutive cohorts, including thousands of high school students who attended 12th grade in 2008, 2009, and 2010 indicate that students attending improving schools identified by state administered standardized tests generally performed no better on a widely administered college entrance exam with tests in science, math and English. In 2010, students from schools identified as improving in English scored nearly one-half of a point lower than their peers from declining schools on both the ACT Science and Math exams. We discuss various interpretations and implications of these results and suggest areas for future research. (Contains 2 figures, 5 tables, and 2 notes.)

Even with the history of debate over the merits of homework, there are significant gaps in the research record regarding its benefit to students. The focus of this study is on the association between time spent on homework and academic performance in science and math by assessing survey and transcript data from two nationally representative samples of high school students collected in 1990 and 2002. Using multiple linear regressions and controlling for students' background, motivation, and prior achievement, we investigated how much variance in science and math course grades and achievement test scores could be explained by time spent on homework in those classes. The results indicate that there is no consistent significant relationship between time spent on homework and grades, but a consistently positive significant relationship between homework and performance on standardized exams. (Contains 7 tables and 3 footnotes.)

Undergraduate research experiences (UREs) have been endorsed as a powerful instructional tool in higher education; however, relatively little is known about the long-term effects of participation in these programs. The purpose of this study was to investigate the educational enhancements of URE participation from the perspective of practicing scientists in chemistry and physics. Data used in this analysis are from a national mixed-methods study, which sought to investigate the transition from graduate student to practicing scientist. Respondents (n = 4,300) provided extensive data regarding their demographic and educational backgrounds, motivations, research, and professional experiences. Initial findings indicate UREs afford students a multitude of long-term enhancements, with the largest being exposure to genuine research, building of confidence to conduct research, and development of laboratory techniques. Although research type was found to have a limited effect on reported outcomes, the findings of this study support the value of UREs structured in collaborative student-mentor models that are based on the individual. (Contains 2 tables and 1 figure.)

As the global economic crisis continues, sustaining the United States' position as a leader in research and development is a top concern of policy makers. Looking to increase the number of students pursuing degrees in STEM (science, technology, engineering, and mathematics), calls for improved mathematics and science education abound. We completed a two-part analysis to assess the school-based factors related to students choosing to complete a major in STEM. The results indicate that the majority of students who concentrate in STEM make that choice during high school, and that choice is related to a growing interest in mathematics and science rather than enrollment or achievement. These results indicate that the current policy focus on advanced-level course taking and achievement as measures to increase the flow of students into STEM may be misguided. (Contains 10 tables and 3 footnotes.)

Laboratory experiences play a substantial role in most high school science courses, and many teachers believe the number of labs they offer is a measure of the quality of their curriculum. While some teachers believe labs are meant to confirm concepts taught during lectures, others feel labs should address students' everyday beliefs about the world. Still other teachers emphasize learning of the scientific method and laboratory techniques. Accordingly, many articles offer advice on "effective" pedagogical practices.

This paper examines the experiences reported by scientists and graduate students regarding the experiences that first engaged them in science. The interviews analysed for this paper come from Project Crossover, a mixed-methods study of the transition from graduate student to PhD scientist in the fields of chemistry and physics. This analysis involved review of 116 interviews collected from graduate students and scientists and focused on the timing, source, and nature of their earliest interest in science. The majority (65%) of participants reported that their interest in science began before middle school. Females were more likely to report that their interest was sparked by school-related activities, while most males recounted self-initiated activities. Our findings indicate that current policy efforts (which focus on high school science reform) to increase the numbers of students studying in the science fields, may be misguided. (Contains 1 table, 2 figures and 2 notes.)