Search

Open Learner Models are used in modern e-learning to show system users the content of their learner models. This approach is known to prompt reflection, facilitate planning and navigation. Open Learner Models may show different levels of detail of the underlying learner model, and may structure the information differently. However, a trade-off exists between useful information and the complexity of the information. This paper investigates whether offering richer information is assessed positively by learners and results in more effective support for learning tasks. An interview pre-study revealed which information within the complex learner model is of interest. A controlled user study examined six alternative visualisation prototypes of varying complexity and resulted in the implementation of one of the designs. A second controlled study involved students interacting with variations of the visualisation while searching for suitable learning material, and revealed the value of the design alternative and its variations. The work contributes to developing complex open learner models by stressing the need to balance complexity and support. It also suggests that the expressiveness of open learner models can be improved with visual elements that strategically summarise the complex information being displayed in detail.

Peer-reviewing is a recommended instructional technique to encourage good writing. Peer reviewers, however, may fail to identify key elements of an essay, such as thesis and conclusion statements, especially in high school writing. Our system identifies thesis and conclusion statements, or their absence, in students' essays in order to scaffold reviewer reflection. We showed that computational linguistics and interactive machine learning have the potential to facilitate peer-review processes. © 2014 Springer International Publishing Switzerland.

What are the advantages and disadvantages of spatially stacked (i.e., when information sources are presented side-by-side) versus distributed (i.e., when information sources are sitting on top of one another with only the top source fully visible) organizations of information? We introduce a new theoretical decomposition of these advantages and disadvantages (information internalization, information access, and information externalization costs), along with a new analytic technique for measuring each theoretical aspects using eye tracking. Thirty-eight scientists-in-training solved a complex data interpretation problem using either a distributed or a stacked display. Display format influenced all 3 factors, but in opposing ways: stacked displays increase internalization and externalization costs but decrease information access costs. The framework reveals trade-offs among the 3 factors that can be precisely characterized to guide interface user design and optimization. © 2014 American Psychological Association.

Understanding the features of science learning experiences that organize and motivate children at early ages can help educators and researchers find ways to ignite interest to support future passion and learning in the sciences at a time when children's motivation is declining. Using a sample of 252 fifth- and sixth-grade students, we systematically explore differences in children's motivations toward science experiences across context (formal, informal, neutral), manner of interaction (consuming new knowledge, analyzing, action), and topic (e.g., biology, earth science, physics). Motivations toward science were most influenced by topic. Responses were generally consistent across context and manner of interaction. Implications for science education, as well as measurement and assessment methodology, are discussed. © 2013 Wiley Periodicals, Inc.

Objective: This work investigated the impact of uncertainty representation on performance in a complex authentic visualization task, submarine localization. Background: Because passive sonar does not provide unique course, speed, and range information on a contact, the submarine operates under significant uncertainty. There are many algorithms designed to address this problem, but all are subject to uncertainty. The extent of this solution uncertainty can be expressed in several ways, including a table of locations (course, speed, range) or a graphical area of uncertainty. Method: To test the hypothesis that the representation of uncertainty that more closely matches the experts' preferred representation of the problem would better support performance, even for the nonexpert., performance data were collected using displays that were either stripped of the spatial or the tabular representation. Results: Performance was more accurate when uncertainty was displayed spatially. This effect was only significant for the nonexperts for whom the spatial displays supported almost expert-like performance. This effect appears to be due to reduced mental effort. Conclusion: These results suggest that when the representation of uncertainty for this spatial task better matches the expert's preferred representation of the problem even a nonexpert can show expert-like performance. Application: These results could apply to any domain where performance requires working with highly uncertain information. Copyright © 2013, Human Factors and Ergonomics Society.

Analogical reasoning has been hypothesized to critically depend upon working memory through correlational data [1], but less work has tested this relationship through experimental manipulation [2]. An opportunity for examining the connection between working memory and analogical reasoning has emerged from the growing, although somewhat controversial, body of literature suggests complex working memory training can sometimes lead to working memory improvements that transfer to novel working memory tasks. This study investigated whether working memory improvements, if replicated, would increase analogical reasoning ability. We assessed participants' performance on verbal and visual analogy tasks after a complex working memory training program incorporating verbal and spatial tasks [3,4]. Participants' improvements on the working memory training tasks transferred to other short-term and working memory tasks, supporting the possibility of broad effects of working memory training. However, we found no effects on analogical reasoning. We propose several possible explanations for the lack of an impact of working memory improvements on analogical reasoning.

A large-scale online teacher resource exchange is studied to examine the ways in which metadata influence teachers' selection of resources. A hierarchical linear modeling approach was used to tease apart the simultaneous effects of resource features and author features. From a decision heuristics theoretical perspective, teachers appear to rely on complex heuristics that integrate many dimensions when determining whether to download a resource. Most surprisingly, numbers of ratings more strongly predict downloads than do mean rating levels, such that multiple negative ratings appear to attract more downloads than do few positive ratings. Implications for system design are discussed. © 2013 Association for Educational Communications and Technology.

Prior studies of mind wandering find the default network active during mind wandering, but these studies have yielded mixed results concerning the role of cognitive control brain regions during mind wandering. Mind wandering often interferes with reading comprehension, and prior neuroimaging studies of discourse comprehension and strategic reading comprehension have shown that there are at least two networks of brain regions that support strategic discourse comprehension: a domain-general control network and a network of regions supporting coherence-building comprehension processes. The present study was designed to further examine the neural correlates of mind wandering by examining mind wandering during strategic reading comprehension. Participants provided ratings of mind wandering frequency that were used to investigate interactions between the strategy being performed and brain regions whose activation was modulated by wind wandering. The results support prior findings showing that cognitive control regions are at times more active during mind wandering than during a task with low control demands, such as rereading. This result provides an initial examination of the neural correlates of mind wandering during discourse comprehension and shows that the processes being engaged by the primary task need to be considered when studying mind wandering. The results also replicate, in a different learning domain, prior findings of key brain areas associated with different reading strategies. © 2013 Elsevier B.V. All rights reserved.

Computer science proficiency continues to grow in importance, while the number of students entering computer science-related fields declines. Many rich programming environments have been created to motivate student interest and expertise in computer science. In the current study, we investigated whether a recently created environment, Robot Virtual Worlds (RVWs), can be used to teach computer science principles within a robotics context by examining its use in high-school classrooms. We also investigated whether the lack of physicality in these environments impacts student learning by comparing classrooms that used either virtual or physical robots for the RVW curriculum. Results suggest that the RVW environment leads to significant gains in computer science knowledge, that virtual robots lead to faster learning, and that physical robots may have some influence on algorithmic thinking. We discuss the implications of physicality in these programming environments for learning computer science. © 2013 Taylor & Francis.

Over the past 20 years, there has been much research on how people learn from case comparisons. This work has implemented comparison activities in a variety of different ways across a wide range of laboratory and classroom contexts. In an effort to assess the overall effectiveness of case comparisons across this diversity of implementation and contexts and to explore what variables might moderate learning outcomes, we conducted a meta-analysis of 57 experiments with 336 tests. Random effects analyses of the 336 tests revealed that case comparison activities commonly led to greater learning outcomes than other forms of case study including sequential, single case, and nonanalogous, as well as traditional instruction and control (d = .50), 95% CI [.44, .56]. Of 15 potential moderators, four variables were found to reliably moderate the effectiveness of case comparisons: the objective of the comparison, the presentation of a principle, the content, and the lag between the comparison and testing. Asking learners to find similarities between cases, providing principles after the comparisons, using perceptual content, and testing learners immediately are all associated with greater learning.We conclude with a discussion of the theoretical and practical implications of these results for cognitive theory and classroom practice. © Division 15, American Psychological Association.

Combining innovation and efficiency is ideal in many organizational settings. Adaptive expertise represents a cognitive explanation of how individuals and teams can learn to achieve simultaneous innovation and efficiency. In 2004, scientists led twin rovers on Mars in the search for historical water. The science team experienced a remarkable increase in efficiency, adapting with flexibility to unexpected events and dynamic, dwindling resources. After discussing the conceptual differences between adaptive expertise and related team learning and innovation concepts, we examine longitudinal behavioral data on novelty, routine and adaptive expertise. Sequential time series ARIMA analyses reveal that novelty fluctuated randomly, but both routine and adaptive expertise significantly increased over time. In addition, novelty, routine expertise, and adaptive expertise did not significantly predict each other directly or at a lag, suggesting that these are indeed three distinct constructs. Implications for theory and research on efficiency and innovation are discussed. © 2013 John Wiley & Sons, Ltd.

Creative teamwork in multidisciplinary teams is a topic of interest to cognitive psychologists on the one hand, and to both social and organizational psychologists on the other. However, the interconnections between cognitive and social layers have been rarely explored. Drawing on mental models and dissonance theories, the current study takes a central variable studied by cognitive psychologists-analogy-and examines its relationship to a central variable examined by social psychologists-conflict. In an observational, field study, over 11. h of audio-video data from conversations of the Mars Exploration Rover scientists were coded for different types of analogy and micro-conflicts that reveal the character of underlying psychological mechanisms. Two different types of time-lagged logistic models applied to these data revealed asymmetric patterns of associations between analogy and conflict. Within-domain analogies, but not within-discipline or outside-discipline analogies, preceded science and work process conflicts, suggesting that in multidisciplinary teams, representational gaps in very close domains will be more likely to spark conflict. But analogies also occurred in reaction to conflict: Process and negative conflicts, but not task conflicts, preceded within-discipline analogies, but not to within-domain or outside-discipline analogies. This study demonstrates ways in which cognition can be bidirectionally tied to social processes and discourse. © 2012 Elsevier B.V.

While the purposes of design and science are often different, they share some key practices and processes. Design-based science learning, which combines the processes of engineering design with scientific inquiry, is one attempt to engage students in scientific reasoning via solving practical problems. Although research suggests that engaging students in design-based science learning can be effective for learning both science process and content, more research is needed to understand how to overcome what Vattam and Kolodner (Pragmatics and Cognition 16:406-437, 2008) called "the design-science gap." This study, therefore, takes a first step at systematically delving into this issue of bridging the design-science gap by examining the problem-solving strategies that students are using when they solve a prototypical design task. Videotaped performance assessments of high and low performing teams were analyzed in depth. Results suggest that students use both science reasoning strategies (e.g., control of variables) and design-focused strategies (e.g., adaptive growth). However, the strategies commonly associated with success in science (e.g., control of variables) did not necessarily lead to success in design. In addition, while both science reasoning strategies and design-focused strategies led to content learning, the content learned was different. © 2012 Springer Science+Business Media B.V.

The use of peer assessment to evaluate students' writing is one recommended method that makes writing assignments possible in large content classes (i. e., more than 75 students). However, many instructors and students worry about whether students of all ability levels are capable of helping their peers. We examine how ability pairing (e. g., high-ability student with high-ability student versus high-ability student with low-ability student) changes key characteristics of feedback to determine which pairings are likely to benefit students most. A web-based reciprocal peer-review system was used to facilitate the peer review of students' writing of two papers. Over 1,100 comments given to writers from their peers were coded for several relevant categories: type of feedback, type of criticism, focus of problem, focus of solution, and implementation. Overall, creating peer-review groups such that students receive feedback from someone of a dissimilar ability appeared to be most beneficial. High-ability writers received similar kinds of feedback from high-ability versus low-ability peers. By contrast, the low-ability writers received more comments that identified problems focusing on substance issues from high-ability reviewers. In addition, the low-ability writers implemented a higher percentage of the comments from the high-ability reviewers. © 2012 Springer Science+Business Media B.V.

Peer review is a family of instructional techniques. Historically, these have been employed in writing and many other educational domains. Modern computer technologies facilitate the use of peer review, which is especially relevant to educational settings where it is not practical to administer peer review manually. The use of computer support for peer review has shed light on many important scientific questions, some of which we summarize. These findings set the context for the papers in this special issue, which demonstrate how computer support for peer review enables research on peer review itself and on its pedagogical significance. © Earli.

Research in the psychology of science has typically fallen into separate, isolated subfields within psychology. This chapter examines two models that tie together social and cognitive psychological variables important in the development of innovation in multidisciplinary science teams, separately considering convergent versus divergent creative processes. The models are theoretically examined from the perspective of explicit and implicit elements. The chapter then draws on a recent study examining the moment-by-moment interplay of conflict (a social variable) and analogy (a cognitive variable) in a real-world multidisciplinary science team to examine the empirical nature of connections between social and cognitive models. While both conflict and analogies can be implicit and explicit simultaneously, the significant connections between these two variables seem to be mainly implicit, drawing on underlying knowledge structures and differences.

Complex problem solving in naturalistic environments is fraught with uncertainty, which has significant impacts on problem-solving behavior. Thus, theories of human problem solving should include accounts of the cognitive strategies people bring to bear to deal with uncertainty during problem solving. In this article, we present evidence that analogy is one such strategy. Using statistical analyses of the temporal dynamics between analogy and expressed uncertainty in the naturalistic problem-solving conversations among scientists on the Mars Rover Mission, we show that spikes in expressed uncertainty reliably predict analogy use (Study 1) and that expressed uncertainty reduces to baseline levels following analogy use (Study 2). In addition, in Study 3, we show with qualitative analyses that this relationship between uncertainty and analogy is not due to miscommunication-related uncertainty but, rather, is primarily concentrated on substantive problem-solving issues. Finally, we discuss a hypothesis about how analogy might serve as an uncertainty reduction strategy in naturalistic complex problem solving. © 2012 Psychonomic Society, Inc.

Spatial arrangement of information can have large effects on problem solving. Although such effects have been observed in various domains (e.g.; instruction and interface designs), little is known about the cognitive processing mechanisms underlying these effects, nor its applicability to complex visual problem solving. In three experiments, we showed that the impact of spatial arrangement of information on problem solving time can be surprisingly large for complex real world tasks. It was also found that the effect can be caused by large increases in slow, external information searches (Experiment 1), that the spatial arrangement itself is the critical factor and the effect is domain-general (Experiment 2a), and that the underlying mechanism can involve micro-strategy selection for information encoding in a response to differing information access cost (Experiment 2b). Overall, these studies show a large slowdown effect (i.e.; approximately 30%) that stacking information produces over spatially distributed information, and multiple paths by which this effect can be produced. © 2012 Elsevier Ltd All rights reserved.

The internal representation of numbers generated during calculation has received little attention. Much of the mathematics learning literature focuses on symbolic retrieval of math facts; in contrast, we critically test the hypothesis that internally generated numbers are represented analogically, using an approximate number system. In an fMRI study, the spontaneous processing of arithmetical expressions was tested. Participants passively viewed a sequence of double-digit addition expressions that summed to the same number. Adaptation was found in number-related regions in a fronto-parietal network. Following adaptation, arrays of dots were introduced, differing in their numerical distance from the sum of the addition expressions. Activation in voxels that showed adaptation to a repeated sum was also sensitive to the distance of the dot quantity from the sum. We conclude that participants exhibited adaptation to an internally generated number, that adapted representations were analogic in nature, and that these analogic representations may undergird arithmetic calculation. © 2012 Elsevier Ltd.

As the use of project-based learning becomes more frequent in the K-12 science classroom, and in chemistry classrooms in particular, teachers have begun to identify practical questions about implementation that should be addressed empirically. One such question concerns whether there is an ideal group size that fosters individual student achievement. The current project was designed to assess how group size might impact student chemistry content learning in a project-based learning environment, and how well students are prepared to transfer this new knowledge to other relevant areas. The results indicated that particular conditions (e. g. advanced classrooms) interact with group size (a seemingly superficial feature) to differentially influence the depth and level of student learning related to the unit and student's ability to transfer his/her knowledge outside of the context of a project-based learning unit. © 2011 Springer Science+Business Media, LLC.

Understanding the best way to present information has been an issue of interest to many researchers. Regardless of the content of the information, purely physical elements such as spatial organization may also influence performance. Across two studies with 111 undergraduates (78 in Study 1 and 33 in Study 2), we compared spatially distributed (i.e. when information sources are presented side-by-side) against stacked displays (i.e. when information sources are sitting on top of one another with only the top source fully visible). A distributed display time advantage was consistently observed. As potential explanations, a memory strategy selection hypothesis was examined along with other procedural alternative explanations. © 2011 John Wiley & Sons, Ltd.

Engineers use various physical tools (e.g., computers, smart boards, notes, and prototypes) to support their design work. To understand cognitive processes underlying the innovative design process and to reveal the characteristics of innovation-supporting environments, we examined the pattern of tool use in 43 interdisciplinary engineering design teams enrolled in a full-semester product realization course. Teams worked all semester on a single project, with each team being assigned a different industry-sponsored project. Group meetings were video-recorded. Team success was measured in terms of meeting client requirements, and groups were divided into high, medium, and low success. Successful teams (i.e., high and medium success groups) were found to use a smart board and physical prototypes consistently more often throughout the design process, whereas unsuccessful teams (i.e., low success group) used a computer, laptop, and paper notes more often. Particularly, late adoption of physical prototypes was a key characteristic of unsuccessful teams. © 2012 American Society of Mechanical Engineers.

We investigate students' negative perceptions about an online peer assessment system for undergraduate writing across the disciplines. Specifically, we consider the nature of students' resistance to peer assessment; what factors influence that resistance; and how students' perceptions impact their revision work. We do this work by first examining findings from an end-of-course survey administered to 250 students in ten courses across six universities using an online peer assessment system called SWoRD for their writing assignments. Those findings indicate that students have the most positive perceptions of SWoRD in those courses where an instructor graded their work in addition to peers (as opposed to peer-only grading). We then move to an in-depth examination of perceptions and revision work among 84 students using SWoRD and no instructor grading for assessment of writing in one university class. Findings from that study indicate that students sometimes regard peer assessment as unfair and often believe that peers are unqualified to review and assess students' work. Furthermore, students' perceptions about the fairness of peer assessment drop significantly following students' experience in doing peer assessment. Students' fairness perceptions-and drops in those perceptions-are most significantly associated with their perceptions about the extent to which peers' feedback is useful and positive. However, students' perceptions appear to be unrelated to the extent of their revision work. This research fills a considerable gap in the literature regarding the origin of students' negative perceptions about peer assessment, as well as how perceptions influence performance. © 2010 Springer Science+Business Media B.V.

An empirically sensitive formulation of the norms of transformative criticism must recognize that even public and shared standards of evaluation can be implemented in ways that unintentionally perpetuate and reproduce forms of social bias that are epistemically detrimental. Helen Longino's theory can explain and redress such social bias by treating peer evaluations as hypotheses based on data and by requiring a kind of perspectival diversity that bears, not on the content of the community's knowledge claims, but on the beliefs and norms of the culture of the knowledge community itself. To illustrate how socializing cognition can bias evaluations, we focus on peer-review practices, with some discussion of peer-review practices in philosophy. Data include responses to surveys by editors from general philosophy journals, as well as analyses of reviews and editorial decisions for the 2007 Cognitive Science Society Conference. © by Hypatia, Inc.

Neuroimaging studies of text comprehension conducted thus far have shed little light on the brain mechanisms underlying strategic learning from text. Thus, the present study was designed to answer the question of what brain areas are active during performance of complex reading strategies. Reading comprehension strategies are designed to improve a reader's comprehension of a text. For example, self-explanation is a complex reading strategy that enhances existing comprehension processes. It was hypothesized that reading strategies would involve areas of the brain that are normally involved in reading comprehension along with areas that are involved in strategic control processes because the readers are intentionally using a complex reading strategy. Subjects were asked to reread, paraphrase, and self-explain three different texts in a block design fMRI study. Activation was found in both executive control and comprehension areas, and furthermore, learning from text was associated with activation in the anterior prefrontal cortex (aPFC). The authors speculate that the aPFC may play a role in coordinating the internal and external modes of thought that are necessary for integrating new knowledge from texts with prior knowledge. © 2011 Elsevier Inc.

Learning requires applying limited working memory and attentional resources to intrinsic, germane, and extraneous aspects of the learning task. To reduce the especially undesirable extraneous load aspects of learning environments, cognitive load theorists suggest that spatially integrated learning materials should be used instead of spatially separated materials, thereby reducing the split-attention effect (Sweller & Chandler, 1994). Recent work, however, has suggested a new distinction between two common formats of spatially separated displays: spatially distributed versus spatially stacked (Jang & Schunn, 2010). Moreover, a distinction between instructions and learning task materials has rarely been made. Across two studies with 106 college students (56 in Study 1 and 50 in Study 2), we compared spatially distributed (multiple sources of information are placed side by side) versus spatially stacked (only one at the top is visible) instructions, without changing the learning task materials, on both task performance and learning. With materials more typical of practice, Study 1 showed that the distributed-display instructions led learners to more efficient learning; learners finished the task faster and scored higher in the overall learning test. With materials more tightly controlled for spatial format per se, Study 2 replicated the effect and found that the benefit of the distributed instructions appeared to be associated with changes in cognitive load. Implications for educational practice are discussed. © 2011 American Psychological Association.

Participation is an important factor in team success. We propose a new metric of participation equality that provides an unbiased estimate across groups of different sizes and across those that change size over time. Using 11 h of transcribed utterances from informal, fluid, colocated workgroup meetings, we compared the associations of this metric with coded equality of participation and standard deviation. While coded participation and our metric had similar patterns of findings, standard deviation had a somewhat different pattern, suggesting that it might lead to incorrect assessments with fluid teams. Exploratory analyses suggest that, as compared with mixed-age/status groups, groups of younger faculty had more equal participation and that the presence of negative affect words was associated with more dominated participation. Future research can take advantage of this new metric to further theory on team processes in both face-to-face and distributed settings. © 2011 Psychonomic Society, Inc.

In undergraduate natural science courses, two types of evaluators are commonly used to assess student writing: graduate-student teaching assistants (TAs) or peers. The current study examines how well these approaches to evaluation support student writing. These differences between the two possible evaluators are likely to affect multiple aspects of the writing process: first draft quality, amount and types of feedback provided, amount and types of revisions, and final draft quality. Therefore, we examined how these aspects of the writing process were affected when undergraduate students wrote papers to be evaluated by a group of peers versus their TA. Several interesting results were found. First, the quality of the students' first draft was greater when they were writing for their peers than when writing for their TA. In terms of feedback, students provided longer comments, and they also focused more on the prose than the TAs. Finally, more revisions were made if the students received feedback from their peers-especially prose revisions. Despite all of the benefits seen with peers as evaluators, there was only a moderate difference in final draft quality. This result indicates that while peer-review is helpful, there continues to be a need for research regarding how to enhance the benefits.

Epistemic uncertainty is a huge area of scholarship. It has captured the minds of scholars in psychology and many domain-specific studies of reasoning and problem solving. What does it mean to resolve uncertainty? This chapter explores the idea that resolution of uncertainty in complex science and engineering fields frequently ends with approximations rather than precise answers. The chapter begins by examining language to motivate the core distinction between uncertainty and approximation. Then, the chapter explores whether the distinction can be defended empirically in reliable and valid coding of speech and gesture data in multiple science and engineering domains. Novice/Expert changes in uncertainty and approximation levels are also explored. Finally, three examinations of temporal patterns of co-occurrence with uncertainty and approximation are presented in multiple problem-solving domains to provide an overall model of uncertainty being transformed to approximation through spatial reasoning and mental simulations. © 2010, Elsevier Inc. All rights reserved.

The psychology of science typically lacks integration between cognitive and social variables. We present a new framework of team innovation in multidisciplinary science and engineering groups that ties factors from both literatures together. We focus on the effects of a particularly challenging social factor, knowledge diversity, which has a history of mixed effects on creativity, most likely because those effects are mediated and moderated by cognitive and additional social variables. In addition, we highlight the distinction between team innovative processes that are primarily divergent versus convergent; we propose that the social and cognitive implications are different for each, providing a possible explanation for knowledge diversity's mixed results on team outcomes. Social variables mapped out include formal roles, communication norms, sufficient participation and information sharing, and task conflict; cognitive variables include analogy, information search, and evaluation. This framework provides a roadmap for research that aims to harness the power of multidisciplinary teams. © 2009 Cognitive Science Society, Inc.

With only two to five slots of visual working memory (VWM), humans are able to quickly solve complex visual problems to near optimal solutions. To explain the paradox between tightly constrained VWM and impressively complex human visual problem-solving ability, we propose several principles for dynamic VWM allocation. In particular, we propose that complex visual information is represented in a temporal manner using only a few slots of VWM that include global and local visual chunks. We built a model of human traveling salesman problem solving based on these principles of VWM allocation and tested the model with eye-movement data. Exactly as the model predicted, human eye movements during traveling salesman problem solving have precise quantitative regularities with regard to both the general statistical pattern of attentional fixations and how they vary across individuals with different VWM capacities. Even though VWM capacity is very limited, eye movements dynamically allocate VWM resources to both local and global information, enabling attention to fine details without loss of the big picture. Copyright © 2009 Cognitive Science Society, Inc. All rights reserved.

This paper describes a rigorous summer research experience and curriculum development opportunity for teachers, supported by professional development and classroom support, culminating with a citywide student design competition. The goal of this Research Experience for Teachers program was to bring real world innovative design into several urban, high school classrooms. The 8-week summer program comprised an engineering component and a learning science component. The goal of the engineering component was to provide an authentic research experience. Teams of 2-3 teachers were paired with a researcher in a school of engineering to further ongoing research of a product realization project. The goal of the learning science component was to scaffold teachers to develop a design-based immersion unit that they would implement in their science classrooms. Teams were organized by their content areas and provided professional development at a learning research center around relevant curriculum development strategies. This paper presents results related to common sets of knowledge and skills that teachers learned from both engineering design and learning science from the cohorts of teachers over the last three years. Findings include documentation of implementation success, changes of teachers' and students' beliefs about engineering and increases in student interest in engineering careers. © 2009 TEMPUS Publicatìons.

In order to include more writing assignments in large classrooms, some instructors have been utilizing peer review. However, many instructors are hesitant to use peer review because they are uncertain of whether students are capable of providing reliable and valid ratings and comments. Previous research has shown that students are in fact capable of rating their peers papers reliably and with the same accuracy as instructors. On the other hand, relatively little research has focused on the quality of students' comments. This study is a first in-depth analysis of students' comments in comparison with a writing instructor's and a content instructor's comments. Over 1400 comment segments, which were provided by undergraduates, a writing instructor, and a content instructor, were coded for the presence of 29 different feedback features. Overall, our results support the use of peer review: students' comments seem to be fairly similar to instructors' comments. Based on the main differences between students and the two types of instructors, we draw implications for training students and instructors on providing feedback. Specifically, students should be trained to focus on content issues, while content instructors should be encouraged to provide more solutions and explanations.

Random cues may be both beneficial and harmful to creativity. Theories of analogical transfer and association assume that cues are helpful in generating new ideas. However, theories of path-of-least-resistance, fixation, and unconscious plagiarism say that cues can lead you into traps. Empirical research partly supports both theories. So what is a practitioner to do in selecting random cues for enhancing creativity? It is suggested that the answer is found in looking at the relationship between cues and the creative cognitive processes and their functions, and how this leads to creative outcome originality and usefulness. Two processes are examined: analogical transfer and mental simulation. It is recommended that random between-domain cues be used to increase between domain analogizing primarily with instruction to make connections, leading to product originality Random within-domain cues should be used to increase within-domain analogizing. Due to property transfer, close analogies may have a negative impact on the originality of the outcome in problem-solving instances, but a positive impact on usefulness in problemidentifying and problem-solving instances. Random end-user cues will lead to greater amounts of end-user simulations of usability and user preferences, and thus to higher levels of product usefulness.

The focus of this research was an evaluation of the impact of teacher professional development (PD) on student achievement during implementation of a reform curriculum. The PD consisted of five four-hour workshop sessions distributed over the time teachers were implementing the reform curriculum in their classrooms. The research was conducted in a mid-size, urban school district over the span of two years. Three groups of teachers were contrasted: teachers who continued to use the established curriculum (N = 5), teachers who implemented the reform curriculum without participating in the PD sessions (N = 5), and teachers who implemented the reform curriculum while participating in the PD sessions (N = 13). Teachers who participated in the PD had approximately a one standard deviation advantage in their students' achievement over those who did not. We collected evidence of particular features of the PD that explained the differences in student achievement. The features included: distributing the workshops throughout the implementation; engaging teachers in an active learning process situated in the curriculum; and facilitating a collaborative community of teacher professionals. This study led us to believe that not only are the individual features of the PD important, but the combination of all three together is particularly powerful. © 2009, Taylor & Francis Group, LLC.

This study examines the use of engineering design to facilitate science reasoning in high-needs, urban classrooms. The Design for Science unit utilizes scaffolds consistent with reform science instruction to assist students in constructing a design solution to satisfy a need from their everyday lives. This provides a meaningful context in which students could reason scientifically. Eighth grade students from two urban schools participated in the unit. Both schools contained large percentages of racial/ethnic minority and economically disadvantaged students. Students demonstrated statistically significant improvement on a paper-and-pencil, multiple-choice pre and post assessment. The results compare favorably with both a high-quality inquiry science unit and a traditional textbook curriculum. Implications for the use of design-based curricula as a viable alternative for teaching science reasoning in high-needs, urban settings are discussed. © 2009 Springer Science+Business Media, LLC.

Although providing feedback is commonly practiced in education, there is no general agreement regarding what type of feedback is most helpful and why it is helpful. This study examined the relationship between various types of feedback, potential internal mediators, and the likelihood of implementing feedback. Five main predictions were developed from the feedback literature in writing, specifically regarding feedback features (summarization, identifying problems, providing solutions, localization, explanations, scope, praise, and mitigating language) as they relate to potential causal mediators of problem or solution understanding and problem or solution agreement, leading to the final outcome of feedback implementation. To empirically test the proposed feedback model, 1,073 feedback segments from writing assessed by peers was analyzed. Feedback was collected using SWoRD, an online peer review system. Each segment was coded for each of the feedback features, implementation, agreement, and understanding. The correlations between the feedback features, levels of mediating variables, and implementation rates revealed several significant relationships. Understanding was the only significant mediator of implementation. Several feedback features were associated with understanding: including solutions, a summary of the performance, and the location of the problem were associated with increased understanding; and explanations of problems were associated with decreased understanding. Implications of these results are discussed. © 2008 Springer Science+Business Media B.V.

We conducted two in vivo studies to explore how scientists respond to anomalies. Based on prior research, we identify three candidate strategies: mental simulation, mental manipulation of an image, and comparison between images. In Study 1, we compared experts in basic and applied domains (physics and meteorology). We found that the basic scientists used mental simulation to resolve an anomaly, whereas applied science practitioners mentally manipulated the image. In Study 2, we compared novice and expert meteorologists. We found that unlike experts, novices used comparison to address anomalies. We discuss the nature of expertise in the two kinds of science, the relationship between the type of science and the task performed, and the relationship of the strategies investigated to scientific creativity. © 2009 Cognitive Science Society, Inc.

Although theories of mental simulations have used different formulations of the premises of 'thought experiments', they can be fitted under a minimalist hypothesis stating that mental simulations are run under situations of uncertainty to turn that uncertainty into approximate answers. Three basic assumptions of mental simulations were tested by using naturalistic data from engineering design. Results from the design protocols showed (1) initial representations in mental simulation had higher than base-rate uncertainty, (2) uncertainty in mental simulations were lowered after simulation runs, (3) resulting representations had more approximations than base-rate or initial representations. Further, the reference to external representational systems (sketches and prototypes) was examined. It was found that prototypes had fewer technical/functional simulations compared to sketches or unsupported cognition. Although prototypes were associated with more approximation than unsupported cognition, the different external representation categories did not differ in information uncertainty. The results support the minimalist hypothesis of mental simulations. Copyright © 2008 John Wiley & Sons, Ltd.

Across several decades, educational researchers have investigated the contribution of the learning environment to the attainment of educational goals, such as improving academic achievement and motivation to learn. The term learning environment not only includes physical activities in the classroom (e.g. experiments kits, computers), but also includes teaching methods, the type of learning in which pupils are engaged, and assessment methods. In this research, we refined an approach to measuring the impact of a variety of classroom features on many different learning outcomes through the lens of students' perception. A new instrument, the Design-Based Learning Environment Questionnaire (DBLEQ), was field-tested in an eighth-grade USA science classroom setting. This study examined pre-post changes for two different curricula, one emphasising design-based learning (n = 464) and another emphasising scripted inquiry (n = 248). The value of the instrument and ways of analysing its data are illustrated through the range of differences that were found between conditions over time. © 2008 Springer Science+Business Media B.V.

Gene expression is a difficult topic for students to learn and comprehend, at least partially because it involves various biochemical structures and processes occurring at the microscopic level. Designer Bacteria, a design-based learning (DBL) unit for high-school students, applies principles of DBL to the teaching of gene expression. Throughout the 8-week unit, students genetically engineer bacteria to meet a need in their own lives. Through a series of investigations, discussions, and design modifications, students learn about the molecular processes and structures involved in gene expression, and how these processes and structures are dependent upon various environmental variables. This article is intended to describe the Designer Bacteria unit and report preliminary results of student progress and performance on pre-unit and post-unit assessments. Teacher experiences and student progress indicate that Designer Bacteria successfully taught core aspects of gene expression through DBL. © 2008 by The International Union of Biochemistry and Molecular Biology.

Infusing engineering design projects in K-12 settings can promote interest and attract a wide range of students to engineering careers. However, the current climate of high-stakes testing and accountability to standards leaves little room to incorporate engineering design into K-12 classrooms. We argue that design-based learning, the combination of scientific inquiry and engineering design, is an approach that can be used to meet both K-12 educators' and engineering advocates' goals. This paper describes an 8-week high school curriculum unit, the Heating/Cooling System, in which engineering design is used to teach students central and difficult chemistry concepts such as atomic interactions, reactions, and energy changes in reactions. The goals of the paper are to (1) describe this successful design-based unit, (2) provide guidelines for incorporating design-based learning into other science topics, and (3) provide some evidence of its value for teaching difficult chemistry concepts and increasing interest in engineering careers. © 2008 Springer Science+Business Media, LLC.

Analogy was studied in real-world engineering design, using the in vivo method. Analogizing was found to occur frequently, entailing a roughly equal amount of within- and between-domain analogies. In partial support for theories of unconscious plagiarism (Brown & Murphy, 1989; Marsh, Landau, & Hicks, 1996) and Ward's (1994) path-of-least-resistance model, it was found that the reference to exemplars (in the form of prototypes) significantly reduced the number of between-domain analogies between source and target, as compared with using sketches or no external representational systems. Analogy served three functions in relation to novel design concepts: identifying problems, solving problems, and explaining concepts. Problem identifying analogies were mainly within domain, explanatory analogies were mainly between domain, and problem-solving analogies were a mixture of within- and between-domain analogies. Copyright 2007 Psychonomic Society, Inc.

Human visual/spatial problem solving often requires both global and local information to be processed. But the relationship between those two kinds of information and the way in which they interact with one another during problem solving has not been thoroughly discussed. In the particular setting of solving the traveling salesman problem (TSP), we investigated into the relative roles of global and local information processing. An experiment was conducted to measure the importance of global information and the possible constraints of global information processing on search. A model was built to simulate human TSP performance and was used to investigate further the relationship between global information processing and local information processing. Our model was compared with the human data we collected and with other models of human TSP solving. © 2007 Elsevier B.V. All rights reserved.

Private speech used by high-functioning children with autistic spectrum disorders (ASD) (n = 33) during two executive functioning tasks was compared to that of typically developing children (n = 28), and children with ADHD (n = 21). Children with ASD were as likely as others to talk to themselves and their speech was similarly relevant and likely to appear in moments of task difficulty. Unlike others, children with ASD were more likely to get items correct when they were talking than when they were silent. Group differences in performance were observed when children were silent but not when children were talking. Findings suggest that autistic children talk to themselves in relevant ways during problem-solving and that such speech is helpful in normalizing their executive performance relative to controls. © 2006 Springer Science+Business Media, LLC.

This paper describes how SWoRD (scaffolded writing and rewriting in the discipline), a web-based reciprocal peer review system, supports writing practice, particularly for large content courses in which writing is considered critical but not feasibly included. To help students gain content knowledge as well as writing and reviewing skills, SWoRD supports the whole cycle of writing, reviews, back-reviews, and rewriting by scaffolding the journal publication process as its authentic practice model. In addition, SWoRD includes algorithms that compute individual reviewer's review accuracy, which is in turn used to support the various drawbacks of reciprocal peer reviews (e.g., variation in motivation or ability of reviewers). Finally, this paper describes an empirical evaluation showing that the SWoRD approach is effective in improving writing quality in content classes. © 2005 Elsevier Ltd. All rights reserved.