Search

Perceivers spontaneously segment ongoing activity into discrete events. This segmentation is important for the moment-by-moment understanding of events, but may also be critical for how events are encoded into episodic memory. In 3 experiments, we used priming to test the possibility that perceptual event boundaries organize memory for everyday activity into episodic units. Viewers watched movies of everyday activities, such as someone washing a car, and then performed a yes-no recognition task using pictures taken from the movies. Some target pictures were preceded by a prime picture taken from 5 s previously in the movie. This produced priming, reducing response times for the target picture. Priming was greater when the prime was part of the same perceptual event as the target than when it was part of a different event, suggesting that event structure organizes episodic memory. This effect persisted when the sequence of activity was scrambled during encoding, which suggests that it reflects, in part, knowledge about event types and not just the specifics of a given episode. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

People with post-traumatic stress disorder (PTSD) often report difficulty remembering information in their everyday lives. Recent findings suggest that such difficulties may be due to PTSD-related deficits in parsing ongoing activity into discrete events, a process called event segmentation. Here, we investigated the causal relationship between event segmentation and memory by cueing event boundaries and evaluating its effect on subsequent memory in people with PTSD. People with PTSD (n = 38) and trauma-matched controls (n = 36) watched and remembered videos of everyday activities that were either unedited, contained visual and auditory cues at event boundaries, or contained visual and auditory cues at event middles. PTSD symptom severity varied substantial within both the group with a PTSD diagnosis and the control group. Memory performance did not differ significantly between groups, but people with high symptoms of PTSD remembered fewer details from the videos than those with lower symptoms of PTSD. Both those with PTSD and controls remembered more information from the videos in the event boundary cue condition than the middle cue or unedited conditions. This finding has important implications for translational work focusing on addressing everyday memory complaints in people with PTSD.

Many studies suggest that information about past experience, or episodic memory, is divided into discrete units called “events.” Yet we can often remember experiences that span multiple events. Events that occur in close succession might simply be linked because of their proximity to one another, but we can also build links between events that occur farther apart in time. Intuitively, some kind of organizing principle should enable temporally distant events to become bridged in memory. We tested the hypothesis that episodic memory exhibits a narrative-level organization, enabling temporally distant events to be better remembered if they form a coherent narrative. Furthermore, we tested whether post-encoding memory consolidation is necessary to integrate temporally distant events. In three experiments, participants learned and subsequently recalled events from fictional stories, in which pairs of temporally distant events involving side characters (“sideplots”) either formed one coherent narrative or two unrelated narratives. Across participants, we varied whether recall was assessed immediately after learning, or after a delay: 24 hours, 12 hours between morning and evening (“wake”), or 12 hours between evening and morning (“sleep”). Participants recalled more information about coherent than unrelated narrative events, in most delay conditions, including immediate recall and wake conditions, suggesting that post-encoding consolidation was not necessary to integrate temporally distant events into a larger narrative. Furthermore, post hoc modeling across experiments suggested that narrative coherence facilitated recall over and above any effects of sentence-level semantic similarity. This reliable memory benefit for coherent narrative events supports theoretical accounts which propose that narratives provide a high-level architecture for episodic memory.

When people experience everyday activities, their comprehension can be shaped by expectations that derive from similar recent experiences, which can affect the encoding of a new experience into memory. When a new experience includes changes—such as a driving route being blocked by construction—this can lead to interference in subsequent memory. One potential mechanism of effective encoding of event changes is the retrieval of related features from previous events. Another such mechanism is the generation of a prediction error when a predicted feature is contradicted. In two experiments, we tested for effects of these two mechanisms on memory for changed features in movies of everyday activities. Participants viewed movies of an actor performing everyday activities across two fictitious days. Some event features changed across the days, and some features violated viewers’ predictions. Retrieval of previous event features while viewing the second movie was associated with better subsequent memory, providing evidence for the retrieval mechanism. Contrary to our hypotheses, there was no support for the error mechanism: Prediction error was not associated with better memory when it was observed correlationally (Experiment 1) or directly manipulated (Experiment 2). These results support a key role for episodic retrieval in the encoding of new events. They also indicate boundary conditions on the role of prediction errors in driving new learning. Both findings have clear implications for theories of event memory.

Spatial navigation and spatial memory are two important skills for independent living, and are known to be compromised with age. Here, we investigate the neural correlates of successful spatial memory in healthy older adults in order to learn more about the neural underpinnings of maintenance of navigation skill into old age. Healthy older adults watched a video shot by a person navigating a route and were asked to remember objects along the route and then attempted to remember object locations by virtually pointing to the location of hidden objects from several locations along the route. Brain activity during watching and pointing was recorded with functional MRI. Larger activations in temporal and frontal regions during watching, and larger deactivations in superior parietal cortex and intraparietal sulcus during pointing, were associated with smaller location errors. These findings suggest that larger evoked responses during learning of spatial information coupled with larger deactivation of canonical spatial memory regions at retrieval are important for effective spatial memory in late life.

In this target article, Logie makes a strong case for considering variation when seeking to understand mechanisms of memory and cognition. As he puts it, “people may use their cognition in different ways to perform the same task in the laboratory and in everyday life” (Logie, 2018, p. 472). We heartily concur. Here, we underline this message by providing additional examples of inter-individual and between-group variation from research related to our areas of expertise, and extend this point by considering intra-individual variation across different instances of task performance. Our examples come from research in cognitive control, memory, everyday cognition, and cognitive aging.

Mental representations of everyday experience are rich, structured, and multimodal. In this article we consider the adaptive pressures that led to human construction of such representations, arguing that structured event representations enable cognitive systems to more effectively predict the trajectory of naturalistic everyday activity. We propose an account of how cortical systems and the hippocampus (HPC) interact to construct, maintain, and update event representations. This analysis throws light on recent research on story comprehension, event segmentation, episodic memory, and action planning. It also suggests how the growing science base can be deployed to diagnose impairments in event perception and memory, and to improve memory for everyday events.

When a person explores a new environment, they begin to construct a spatial representation of it. Doing so is important for navigating and remaining oriented. How does one’s ability to learn a new environment relate to one’s ability to remember experiences in that environment? Here, 208 adults experienced a first-person videotaped route, and then completed a spatial map construction task. They also took tests of general cognitive abilities (working memory, laboratory episodic memory, processing speed, general knowledge) and of memory for familiar, everyday activities (event memory). Regression analyses revealed that event memory (memory for everyday events and their temporal structure), laboratory episodic memory (memory for words and pictures) and gender were unique predictors of spatial memory. These results implicate the processing of temporal structure and organization as an important cognitive ability in large-scale spatial memory from route experience. Accounting for the temporal structure of people’s experience while learning the layout of novel spaces may improve interventions for addressing navigation problems.

Penetrating traumatic brain injury (pTBI) is associated with deficits in cognitive tasks including comprehension and memory, and also with impairments in tasks of daily living. In naturalistic settings, one important component of cognitive task performance is event segmentation, the ability to parse the ongoing stream of behavior into meaningful units. Event segmentation ability is associated with memory performance and with action control, but is not well assessed by standard neuropsychological assessments or laboratory tasks. Here, we measured event segmentation and memory in a sample of 123 male military veterans aged 59-81 who had suffered a traumatic brain injury as young men, and 34 demographically similar controls. Participants watched movies of everyday activities and segmented them to identify fine-grained or coarse-grained events, and then completed tests of recognition memory for pictures from the movies and of memory for the temporal order of actions in the movies. Lesion location and volume were assessed with computed tomography (CT) imaging. Patients with traumatic brain injury were impaired on event segmentation. Those with larger lesions had larger impairments for fine segmentation and also impairments for both memory measures. Further, the degree of memory impairment was statistically mediated by the degree of event segmentation impairment. There was some evidence that lesions to the ventromedial prefrontal cortex (vmPFC) selectively impaired coarse segmentation; however, lesions outside of a priori regions of interest also were associated with impaired segmentation. One possibility is that the effect of vmPFC damage reflects the role of prefrontal event knowledge representations in ongoing comprehension. These results suggest that assessment of naturalistic event comprehension can be a valuable component of cognitive assessment in cases of traumatic brain injury, and that interventions aimed at event segmentation could be clinically helpful.

Adults segment continuous and dynamic environment into discrete units, and individual differences in segmentation predict individual differences in memory. Similar parsing mechanisms have been identified in infants, using different methods, but little is known about event segmentation in older children or about its relations to memory. We tested event segmentation and its relations to memory in 5- to 7-year-old children and adults. Participants performed two event comprehension tasks with short animated narrative movies: a unitization task, in which they pressed a key to mark boundaries between meaningful events, and a dwell time task, in which they viewed a self-paced slideshow, and completed two memory tasks. Adults outperformed children as expected. For both age groups, better event comprehension was associated with better memory, though which measures showed this relationship varied. Thus, by school age, children have developed event segmentation mechanisms that, like adults, contribute to episodic memory formation.

Memory for related past experiences can guide current perceptions. However, memory can lead one astray if situational features have changed. Thus, to adaptively use memory to guide perception, one needs to retrieve relevant memories and also to register differences between remembered and current events. Event Memory Retrieval and Comparison Theory proposes that observers associatively activate memories of related previous episodes, and that this guides their ongoing perception. Conflicts between previous and current event features can hurt immediate performance, but if changes are registered and encoded they can lead to highly effective encoding of the prior event, current event, and their relationship. Disruption of these mechanisms could play a role in older adults' greater susceptibility to event memory interference. Two experiments tested these hypotheses by asking participants to watch movies depicting two fictive days of an actor. Some activities were repeated across days, others were repeated with a changed feature (e.g., waking up to an alarm clock or a phone alarm), and others were performed only on Day 2. One week after watching the Day 2 movie, participants completed a cued-recall test. Changes that participants detected but did not remember led to proactive interference in recall, but changes that were successfully detected and remembered led to facilitation. Younger adults detected and remembered more changes than older adults, which partly explained older adults' differential memory deficit for changed activities. These findings suggest a role for episodic reminding in event perception and a potential source of age differences in event memory. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The ability to predict what is going to happen in the near future is integral for daily functioning. Previous research suggests that predictability varies over time, with increases in prediction error at those moments that people perceive as boundaries between meaningful events. These moments also tend to be points of rapid change in the environment. Eye tracking provides a method for continuous measurement of prediction as participants watch a movie of an actor performing a series of actions. In two studies, we used eye tracking to study the time course of prediction around event boundaries. In both studies, viewers looked at objects that were about to be touched by the actor shortly before the objects were contacted, demonstrating predictive looking. However, this behavior was modulated by event boundaries: looks to to-be-contacted objects near event boundaries were less likely to be early and more likely to be late, compared to looks to objects contacted within events. This result is consistent with theories proposing that event segmentation results from transient increases in prediction error.Significance StatementThe ability to predict what will happen in the near future is integral for adaptive functioning, and although there has been extensive research on predictive processing, the dynamics of prediction at the second by second level during the perception of naturalistic activity has never been explored. The current studies therefore describe results from a novel task, the Predictive Looking at Action Task (PLAT) that can be used to investigate the dynamics of predictive processing. Demonstrating the utility of this task to investigate predictive processing, this task was applied to study the predictions made by Event Segmentation Theory, which suggests that people experience event boundaries at times of change and unpredictability in the environment. The results of these studies are of interest to communities investigating the dynamic comprehension and segmentation of naturalistic events and to communities studying visual perception of naturalistic activity.

We conducted two experiments to investigate how the eventfulness of everyday experiences influences people’s prospective timing ability. Specifically, we investigated whether events contained within movies of everyday activities serve as markers of time, as predicted by Event Segmentation Theory, or whether events pull attention away from the primary timing task, as predicted by the Attentional Gate theory. In the two experiments reported here, we asked participants to reproduce a previously learned 30 second target duration while watching a movie that contained eventful and uneventful intervals. In Experiment 2, reproduction also occurred during “blank movies” while watching a fixation. In both experiments, participants made shorter and more variable reproductions while simultaneously watching eventful as compared to uneventful movie intervals. Moreover, in Experiment 2, the longest reproductions were produced when participants had to watch the blank movies, which contained no events. These results support Event Segmentation Theory and demonstrate that the elapsing events during prospective temporal reproduction appear to serve as markers of temporal duration rather than distracting from the timing task.

The apolipoprotein E (ApOE) ε4 allele is associated with neuropathological buildup of amyloid in the brain, and with lower performance on some laboratory measures of memory in some populations. In two studies, we tested whether ApOE genotype affects memory for everyday activities. In Study 1, participants aged 20-79 years old (n = 188) watched movies of actors engaged in daily activities and completed memory tests for the activities in the movies. In Study 2, cognitively healthy and demented older adults (n = 97) watched and remembered similar movies, and also underwent structural MRI scanning. All participants provided saliva samples for genetic analysis. In both samples we found that, in older adults, ApOE ε4 carriers demonstrated worse everyday memory performance than did ε4 noncarriers. In Study 2, ApOE ε4 carriers had smaller medial temporal lobes (MTL) volumes, and MTL volume mediated the relationship between ApOE genotype and everyday memory performance. These everyday memory tasks measure genetically determined cognitive decline that can occur prior to a clinical diagnosis of dementia. Further, these tasks are easily administered and may be a useful clinical tool in identifying ε4 carriers who may be at risk for MTL atrophy and further cognitive decline that is a common characteristic of the earliest stages of Alzheimer's disease.

Event segmentation is the parsing of ongoing activity into meaningful events. Segmenting in a normative fashion—identifying event boundaries similar to others’ boundaries—is associated with better memory for and better performance of naturalistic actions. Given this, a reasonable hypothesis is that interventions that improve memory and attention for everyday events could lead to improvement in domains that are important for independent living, particularly in older populations. Event segmentation and memory measures may also be effective diagnostic tools for estimating people's ability to carry out tasks of daily living. Such measures preserve the rich, naturalistic character of everyday activity, but are easy to quantify in a laboratory or clinical setting. Therefore, event segmentation and memory measures may be useful proxies for clinicians to assess everyday functioning in patient populations and an appropriate target for interventions aimed at improving everyday memory and tasks of daily living.

Readers generate situation models representing described events, but the nature of these representations may differ depending on reading goals. We assessed whether instructions to pay attention to different situational dimensions would affect how individuals structure their situation models (Experiment 1), and how they update them when situations change (Experiment 2). In Experiment 1, participants read and segmented narrative texts into events. Some readers were oriented to pay specific attention to characters or space. Sentences containing character or spatial location changes were perceived as event boundaries—particularly if the reader was oriented to characters or space, respectively. In Experiment 2, participants read narratives and responded to recognition probes throughout the texts. Readers who were oriented to the spatial dimension were more likely to update their situation models at spatial changes; all readers tracked the character dimension. Results from both experiments indicate that attention to individual situational dimensions influences how readers segment and update their situation models. More broadly, the results provide evidence for a global situation model updating mechanism that serves to set up new models at important narrative changes.

When people observe everyday activity, they spontaneously parse it into discrete meaningful events. Individuals who segment activity in a more normative fashion show better subsequent memory for the events. If segmenting events effectively leads to better memory, does asking people to attend to segmentation improve subsequent memory? To answer this question, participants viewed movies of naturalistic activity with instructions to remember the activity for a later test, and in some conditions additionally pressed a button to segment the movies into meaningful events or performed a control condition that required button-pressing but not attending to segmentation. In 5 experiments, memory for the movies was assessed at intervals ranging from immediately following viewing to 1 month later. Performing the event segmentation task led to superior memory at delays ranging from 10 min to 1 month. Further, individual differences in segmentation ability predicted individual differences in memory performance for up to a month following encoding. This study provides the first evidence that manipulating event segmentation affects memory over long delays and that individual differences in event segmentation are related to differences in memory over long delays. These effects suggest that attending to how an activity breaks down into meaningful events contributes to memory formation. Instructing people to more effectively segment events may serve as a potential intervention to alleviate everyday memory complaints in aging and clinical populations. (PsycINFO Database Record

Recent studies of rapid resumption—an observer’s ability to quickly resume a visual search after an interruption—suggest that predictions underlie visual perception. Previous studies showed that when the search display changes unpredictably after the interruption, rapid resumption disappears. This conclusion is at odds with our everyday experience, where the visual system seems to be quite efficient despite continuous changes of the visual scene; however, in the real world, changes can typically be anticipated based on previous knowledge. The present study aimed to evaluate whether changes to the visual display can be incorporated into the perceptual hypotheses, if observers are allowed to anticipate such changes. Results strongly suggest that an interrupted visual search can be rapidly resumed even when information in the display has changed after the interruption, so long as participants not only can anticipate them, but also are aware that such changes might occur.

Memory for everyday events plays a central role in tasks of daily living, autobiographical memory, and planning. Event memory depends in part on segmenting ongoing activity into meaningful units. This study examined the relationship between event segmentation and memory in a lifespan sample to answer the following question: Is the ability to segment activity into meaningful events a unique predictor of subsequent memory, or is the relationship between event perception and memory accounted for by general cognitive abilities? Two hundred and eight adults ranging from 20 to 79 years old segmented movies of everyday events and attempted to remember the events afterwards. They also completed psychometric ability tests and tests measuring script knowledge for everyday events. Event segmentation and script knowledge both explained unique variance in event memory above and beyond the psychometric measures, and did so as strongly in older as in younger adults. These results suggest that event segmentation is a basic cognitive mechanism, important for memory across the lifespan.

Everyday action impairments often are observed in demented older adults, and they are common potential barriers to functional independence. We evaluated whether the ability to segment and efficiently encode activities is related to the ability to execute activities. Further, we evaluated whether brain regions important for segmentation also were important for action performance. Cognitively healthy older adults and those with very mild or mild dementia of the Alzheimer's type watched and segmented movies of everyday activities and then completed the Naturalistic Action Test. Structural MRI was used to measure volume in the dorsolateral prefrontal cortex (DLPFC), medial temporal lobes (MTL), posterior cortex, and anterior cingulate cortex (ACC). Dementia status and the ability to segment everyday activities strongly predicted naturalistic action performance, and MTL volume largely accounted for this relationship. In addition, the current results supported the Omission-Commission Model: Different cognitive and neurological mechanisms predicted different types of action error. Segmentation, dementia severity, and MTL volume predicted everyday omission errors, DLPFC volume predicted commission errors, and ACC volume predicted action additions. These findings suggest that event segmentation may be critical for effective action production, and that the segmentation and production of activities may recruit the same event representation system.

Research investigating how people remember the distance of paths they walk has shown two apparently conflicting effects of experience during encoding on subsequent distance judgments. By the feature accumulation effect, discrete path features such as turns, houses, or other landmarks cause an increase in remembered distance. By the distractor effect, performance of a concurrent task during path encoding causes a decrease in remembered distance. In this study, we ask the following: What are the conditions that determine whether the feature accumulation or the distractor effect dominates distortions of space? In two experiments, blindfolded participants were guided along two legs of a right triangle while reciting nonsense syllables. On some trials, one of the two legs contained features: horizontally mounted car antennas (gates) that bent out of the way as participants walked past. At the end of the second leg, participants either indicated the remembered path leg lengths using their hands in a ratio estimation task or attempted to walk, unguided, straight back to the beginning. In addition to response mode, visual access to the paths and time between encoding and response were manipulated to determine whether these factors would affect feature accumulation or distractor effects. Path legs with added features were remembered as shorter than those without, but this result was significant only in the haptic response mode data. This finding suggests that when people form spatial memory representations with the intention of navigating in room-scale spaces, interfering with information accumulation substantially distorts spatial memory.

Boundaries between meaningful events are key moments in comprehending human action. At these points, viewers may focus on the event's contents at the expense of other information. We tested whether visual detection was impaired at those moments perceivers judged to be boundaries between events. Short animated football clips were used as stimulus material, and event boundaries were imposed by having the ball change possession. In a first experiment, we found that possession changes were perceived to be event boundaries. In a second experiment, participants were asked to keep track of 4 of 10 players and to watch for 120 ms probes appearing either at an event boundary or a nonboundary. Probe detection was less accurate at event boundaries. This result suggests that the segmentation of ongoing activity into events corresponds with the regulation of attention over time.

Filmmakers use continuity editing to engender a sense of situational continuity or discontinuity at editing boundaries. The goal of this study was to assess the impact of continuity editing on how people perceive the structure of events in a narrative film and to identify brain networks that are associated with the processing of different types of continuity editing boundaries. Participants viewed a commercially produced film and segmented it into meaningful events, while brain activity was recorded with functional magnetic resonance imaging (MRI). We identified three degrees of continuity that can occur at editing locations: edits that are continuous in space, time, and action; edits that are discontinuous in space or time but continuous in action; and edits that are discontinuous in action as well as space or time. Discontinuities in action had the biggest impact on behavioral event segmentation, and discontinuities in space and time had minor effects. Edits were associated with large transient increases in early visual areas. Spatial-temporal changes and action changes produced strikingly different patterns of transient change, and they provided evidence that specialized mechanisms in higher order perceptual processing regions are engaged to maintain continuity of action in the face of spatiotemporal discontinuities. These results suggest that commercial film editing is shaped to support the comprehension of meaningful events that bridge breaks in low-level visual continuity, and even breaks in continuity of spatial and temporal location.

During perception, people segment continuous activity into discrete events. They do so in part by monitoring changes in features of an ongoing activity. Characterizing these features is important for theories of event perception and may be helpful for designing information systems. The three experiments reported here asked whether the body movements of an actor predict when viewers will perceive event boundaries. Body movements were recorded using a magnetic motion tracking system and compared with viewers' segmentation of his activity into events. Changes in movement features were strongly associated with segmentation. This was more true for fine-grained than for coarse-grained boundaries, and was strengthened when the stimulus displays were reduced from live-action movies to simplified animations. These results suggest that movement variables play an important role in the process of segmenting activity into meaningful events, and that the influence of movement on segmentation depends on the availability of other information sources.

Human activity contains sequential dependencies that observers may use to structure a task environment (e.g., the ordering of steps when tying shoes or getting into a car). Two experiments investigated how people take advantage of sequential structure to understand activity and respond to behaviorally relevant events. Participants monitored animations of simplified human movement to identify target hand gestures. In the first experiment, participants were able to use predictive sequential dependencies to more quickly identify targets. In addition, performance was best at the point in time that followed the sequence. However, the second experiment revealed that how sequential structure affects detection depends on whether the sequence predicts the timing of target events. In all cases, sequence learning was observed without participants' awareness of the sequential dependencies. These results suggest that human activity sequences can be learned without awareness and can be used to adaptively guide behavior.

People tend to perceive ongoing continuous activity as series of discrete events. This partitioning of continuous activity may occur, in part, because events correspond to dynamic patterns that have recurred across different contexts. Recurring patterns may lead to reliable sequential dependencies in observers' experiences, which then can be used to guide perception. The current set of simulations investigated whether this statistical structure within events can be used 1) to develop stable internal representations that facilitate perception and 2) to learn when to update such representations in a self-organizing manner. These simulations demonstrate that experience with recurring patterns enables a system to accurately predict upcoming stimuli within an event, to identify boundaries between such events based on transient increases in prediction error, and to use such boundaries to improve prediction about subsequent activities.

Embodied views of cognition argue that cognitive processes are influenced by bodily experience. This implies that when people make spatial judgments about human bodies, they bring to bear embodied knowledge that affects spatial reasoning performance. Here, we examined the specific contribution to spatial reasoning of visual features associated with the human body. We used two different tasks to elicit distinct visuospatial transformations: object-based transformations, as elicited in typical mental rotation tasks, and perspective transformations, used in tasks in which people deliberately adopt the egocentric perspective of another person. Body features facilitated performance in both tasks. This result suggests that observers are particularly sensitive to the presence of a human head and body, and that these features allow observers to quickly recognize and encode the spatial configuration of a figure. Contrary to prior reports, this facilitation was not related to the transformation component of task performance. These results suggest that body features facilitate task components other than spatial transformation, including the encoding of stimulus orientation.

Visual perspective taking can be used to determine where objects are located relative toanother agent, or whether the agent can see a particular object. Four experiments indicated that different processes provide these different kinds of information. When participants were asked to report whether an object was to the left or to the right of another agent, response times (RTs) increased with increasing angular distance between the participant and the agent, suggesting that participants mentally transformed their perspective to align it with that of the agent. For visibility judgments, RTs were independent of the angle between the participant and the agent but increased with the distance between the agent and the object, suggesting that participants traced the agent's line of sight. Together, these data suggest that perspective taking encompasses at least two qualitatively different computational processes: one that updates the viewer's imagined perspective, and one that traces a line of sight.

Problem-solving often requires imagining spatial changes. Object-based transformations allow imagining an object in a different orientation. Perspective transformations allow imagining changes in one's viewpoint. Three experiments tested the hypothesis that these two transformations are dissociable and specialized for different situations, by manipulating instructions and task parameters and measuring response times, errors, and introspective reports. Human experience with small objects such as telephones and clothes irons consists mostly of manipulation or observed manipulation, which is characterized by object-based transformations. Consistent with this experience, when participants made judgments about small manipulable objects, they showed a strong tendency to use object-based transformations. Experience with human bodies is more varied, including both object-like interactions and interactions in which one must estimate another's perspective. Accordingly, when making judgments about pictures of bodies...

Readers comprehend narrative texts by constructing a series of mental models of the situations described in the text. These models are updated when readers encounter information indicating that the current model is no longer relevant, such as a change in narrative time. The results of four experiments suggest that readers perceive temporal changes in narrative texts as event boundaries, and that when a temporal change is encountered during reading, readers are slower and less able to accurately retrieve prior information from memory. However, the slower responses following temporal changes may be due to processing costs associated with the temporal change, rather than decreased availability in memory. The results of these experiments suggest that readers may use event boundaries as a means for controlling the contents of memory.

The human mind carves time into events much as it carves space into objects. Events are activities that are perceived to have beginnings, middles, and ends, such as going to work and making a bed. Events performed by humans can be enacted by feet, as in getting to work, or by hands, as in making a bed. Although continuous, events are perceived to have discrete parts. Events by feet are segmented into actions at nodes, or turns at landmarks, as revealed in spontaneously produced route maps and route directions. In contrast, events by hands are segmented hierarchically. At the coarse level, the segments are punctuated by objects or object parts, sheets, pillowcases, and blanket in the case of making the bed. At the fine level, segments are punctuated by articulated actions on the same object, spreading the sheet, tucking in the corners, smoothing it out. For both events by feet and events by hands, the segments correspond to changes in goals in subgoals, signaled by perceptually salient changes in physical activity.

Priming from imagery is typically weaker than that from perception. This has been interpreted as resulting from weaker activation of perceptual processes. However, for imagery and perception, commonality is only half the story: Each is also characterized by specific processes. If priming can be due to both unshared and shared components of imagery and perception, then it should be possible to observe greater priming from imagery than from perception. Two new priming experiments were designed to test this hypothesis, while controlling incidental task differences. In both experiments, participants studied objects by counting their parts (from a mental image or a picture). Experiment 1 used a word-picture matching test task, which was hypothesized to depend on stimulus processing specific to perception, and Experiment 2 a size judgment test task, which was hypothesized to depend on retrieval and generation processes specific to imagery. As predicted, priming for perceived objects was greater than priming for imagined objects in the word-picture matching task. Conversely, in the size judgment task, more priming from imagery than from perception was observed. These results support the conclusions that (a) imagery and perception have substantial unshared processes, and (b) these processes contribute to priming.

In order to plan activity, people must imagine the spatial consequences of potential actions. Two classes of mental spatial transformation can be distinguished: Object-based spatial transformations are imagined movements of objects, such as mental rotation. Egocentric perspective transformations are imagined changes in one's viewpoint, such as imagining one's self in the position of another person. Here we report a case in which electrical stimulation of the right parietal cortex selectively interfered with performance of a mental rotation task. Interference was selective to this stimulation site, and was task specific. Performance of the perspective transformation task, and a control for visual encoding and responding, were unimpaired by stimulation. This marks the first instance of the use of direct cortical stimulation to investigate mental spatial transformations.

When does looking at an object prime actions associated with using it, and what aspects of those actions are primed? We examined whether viewing manmade objects with handles would selectively facilitate responses for the hand closest to the handle, attempting to replicate a study reported by Tucker and Ellis (1998). We also examined whether the hypothesized action priming effects depended upon the response hand’s proximity to an object. In seven experiments, participants made judgments about whether pictured objects were manmade or natural, or whether the objects were upright or inverted. They responded by pressing buttons located either on the same or opposite side as the objects’ handles, at variable distances. Action priming was observed only when participants were explicitly instructed to imagine picking up the pictured objects while making their judgments; the data provide no evidence for task-general automatic priming of lateralized responses by object handles. These data indicate that visually encoding an object activates spatially localized action representations only under special circumstances.

How do people perceive routine events, such as making a bed, as these events unfold in time? Research on knowledge structures suggests that people conceive of events as goal-directed partonomic hierarchies. Here, participants segmented videos of events into coarse and fine units on separate viewings; some described the activity of each unit as well. Both segmentation and descriptions support the hierarchical bias hypothesis in event perception: Observers spontaneously encoded the events in terms of partonomic hierarchies. Hierarchical organization was strengthened by simultaneous description and, to a weaker extent, by familiarity. Describing from memory rather than perception yielded fewer units but did not alter the qualitative nature of the descriptions. Although the descriptions were telegraphic and without communicative intent, their hierarchical structure was evident to naive readers. The data suggest that cognitive schemata mediate between perceptual and functional information about events and indicate that these knowledge structures may be organized around object/action units.

This study sought evidence for the independence of two classes of mental spatial transformation: object-based spatial transformations and egocentric perspective transformations. Two tasks were designed to selectively elicit these two transformations using the same materials, participants, and task parameters: one required same-different judgments about pairs of pictures, while the other required left-right judgments about single pictures. For pictures of human bodies, the two tasks showed strikingly different patterns of response time as a function of stimulus orientation. Moreover, across individuals, the two tasks had different relationships to psychometric tests of spatial ability. The chronometric and individual difference data converge with neuropsychological and neuroimaging data in suggesting that different mental spatial transformations are performed by dissociable neural systems.

Manipulating the way a graph is drawn influences viewers' ability to extract information from it. In a series of experiments with simple bar graphs, the authors varied the rendering characteristics and relative heights of the bars and asked participants to estimate the quantities portrayed. The addition of 3-dimensional (3D) perspective depth cues lowered accuracy. This accuracy disadvantage diminished when a short delay was introduced before judgments were reported. The height of the judged bar relative to nearby graphical elements also affected accuracy; this effect was about 1 order of magnitude larger and remained intact when the delay was introduced. Nearby elements also affected viewers' bias (under- or overestimatio n). These effects do not seem to be due to misestimation of object depth. The results suggest that warnings about accuracy decrements due to 3D shading may be overstated, whereas distortions due to neighboring elements should be of more concern.

Previous research has shown that readers generate mental images of events. Most studies have investigated imagery during the reading of short texts, which also included explicit judgment tasks. In two fMRI studies, we assessed whether modality-specific imagery occurs during naturalistic, discourse comprehension. We identified clauses in the texts that elicited auditory, motor, or visual imagery. In both studies, reading motor imagery clauses was associated with increases in activity in left postcentral and precentral sulci, and reading auditory imagery clauses was associated with increases in left superior temporal gyrus and perisylvian language-related regions. Study 2 compared presentation of connected discourse to a condition in which unconnected sentences were presented, preventing the establishment of global coherence. Sensorimotor imagery was strongest when readers were able to generate a globally coherent discourse representation. Overall, these results suggest that modality-specific imagery occurs during discourse comprehension and it is dependent on the development of discourse-level representations.

The majority of research on situation model processing in older adults has focused on narrative texts. Much of this research has shown that many important aspects of constructing a situation model for a text are preserved and may even improve with age. However, narratives need not be text-based, and little is known as to whether these findings generalize to visually-based narratives. The present study assessed the impact of story modality on event segmentation, which is a basic component of event comprehension. Older and younger adults viewed picture stories or read text versions of them and segmented them into events. There was comparable alignment between the segmentation judgments and a theoretically guided analysis of shifts in situational features across modalities for both populations. These results suggest that situation models provide older adults with a stable basis for event comprehension across different modalities of expereinces.

Everyday activities break down into parts and subparts, and appreciating this hierarchical structure is an important component of understanding. In two experiments we found age differences in the ability to perceive hierarchical structure in continuous activity. In both experiments, younger and older adults segmented movies of everyday activities into large and small meaningful events. Older adults’ segmentation deviated more from group norms than did younger adults’ segmentation, and older adults’ segmentation was less hierarchically organized than that of younger adults. Older adults performed less well than younger adults on event memory tasks. In some cases, measures of event segmentation discriminated between those older adults with better and worse memory. These results suggest that the hierarchical encoding of ongoing activity declines with age, and that such encoding may be important for memory.

We present evidence that different mental spatial transformations are used to reason about three different types of items representing a spectrum of animacy: human bodies, nonhuman animals, and inanimate objects. Participants made two different judgments about rotated figures: handedness judgments (“Is this the left or right side?”) and matching judgments (“Are these figures the same?”). Perspective-taking strategies were most prevalent when participants made handedness judgments about human bodies and animals. In contrast, participants generally did not imagine changes in perspective to perform matching judgments. Such results suggest that high-level information about semantic categories, including information about a thing’s animacy, can influence how spatial representations are transformed when performing online problem solving. Supplemental materials for this article may be downloaded from http://mc.psychonomic-journals.org/content/supplemental.

Memory for naturalistic events over short delays is important for visual scene processing, reading comprehension, and social interaction. The research presented here examined relations between how an ongoing activity is perceptually segmented into events and how those events are remembered a few seconds later. In several studies, participants watched movie clips that presented objects in the context of goal-directed activities. Five seconds after an object was presented, the clip paused for a recognition test. Performance on the recognition test depended on the occurrence of perceptual event boundaries. Objects that were present when an event boundary occurred were better recognized than other objects, suggesting that event boundaries structure the contents of memory. This effect was strongest when an object's type was tested but was also observed for objects' perceptual features. Memory also depended on whether an event boundary occurred between presentation and test; this variable produced complex interactive effects that suggested that the contents of memory are updated at event boundaries. These data indicate that perceptual event boundaries have immediate consequences for what, when, and how easily information can be remembered.

When reading a story or watching a film, comprehenders construct a series of representations in order to understand the events depicted. Discourse comprehension theories and a recent theory of perceptual event segmentation both suggest that comprehenders monitor situational features such as characters' goals, to update these representations at natural boundaries in activity. However, the converging predictions of these theories had previously not been tested directly. Two studies provided evidence that changes in situational features such as characters, their locations, their interactions with objects, and their goals are related to the segmentation of events in both narrative texts and films. A 3rd study indicated that clauses with event boundaries are read more slowly than are other clauses and that changes in situational features partially mediate this relation. A final study suggested that the predictability of incoming information influences reading rate and possibly event segmentation. Taken together, these results suggest that processing situational changes during comprehension is an important determinant of how one segments ongoing activity into events and that this segmentation is related to the control of processing during reading.

Interface design should be informed by the application of top-down cognitive principles derived from basic theory and research. Cognitive design principles from 2 domains, event cognition and media, were applied to the design of interfaces for teaching procedures. According to theories of event cognition, procedures should be presented hierarchically, organized by objects or large object parts and actions on objects. According to research on effects of media, adding appropriate graphics to text instructions can facilitate learning and memory. These principles were partially supported in 2 tasks: assembling a musical instrument and building a model. Although both top-down principles were effective in guiding interface design, they were not sufficient. They can be combined with iterative bottom-up methods to produce usable interfaces.

Interpretations of graphs seem to be rooted in principles of cognitive naturalness and information processing rather than arbitrary correspondences. These predict that people should more readily associate bars with discrete comparisons between data points because bars are discrete entities and facilitate point estimates. They should more readily associate lines with trends because lines connect discrete entities and directly represent slope. The predictions were supported in three experiments--two examining comprehension and one production. The correspondence does not seem to depend on explicit knowledge of rules. Instead, it may reflect the influence of the communicative situation as well as the perceptual properties of graphs.