Search

Background: Computer‐based assessment allows for the monitoring of reader behaviour. The identification of patterns in this behaviour can provide insights that may be useful in informing educational interventions. Objectives: Our study aims to explore what different patterns of reading activity exist, and investigates their interpretation and consistency across different task sets (units), countries, and languages. Three patterns were expected: on‐task, exploring and disengaged. Methods: Using log data from the PISA 2012 digital reading assessment (9226 students from seven countries), we conducted hierarchical cluster analyses with typical process indicators of digital reading assessments. We identified different patterns and explored whether they remained consistent across different units. To validate the interpretation of the identified patterns, we examined their relationship to performance and student characteristics (gender, socio‐economic status, print reading skills). Results and Conclusions: The results indicate a small number of transnational clusters, with unit‐specific differences. Cluster interpretation is supported by associations with student characteristics—for example, students with low print reading skills were more likely to show a disengaged pattern than proficient readers. Exploring behaviour tended to be exhibited only once across the three units: It occurred in the first unit for proficient readers and in later units for less skilled readers. Major Takeaways: Behavioural patterns can be identified in digital reading tasks that may prove useful for educational monitoring and intervention. Although task situations are designed to evoke certain behaviours, the interpretation of observed behavioural patterns requires validation based on task requirements, assessment context and relationships to other available information. Lay Description: What is already known about the subject matter?: Students differ in how they read, comprehend and use digital information.Indicators from process data provide insight about how students engage with digital reading tasks. What does this paper add to the subject matter?: Based on multiple process indicators, a small number of clusters indicating different behavioural activity can be distinguished.These clusters can be described as on‐task, passive, hasty, exploring, disengaged, persistent and lost interest.A meaningful interpretation of the clusters must consider the requirements of the underlying tasks. Implications for practice and/or policy: Knowledge of how students engage with digital resources may provide useful feedback for teachers to guide students' learning or intervene when they struggle.Educational monitoring: The high comparability of country‐specific results suggests an invariant set of solution strategies in the digital reading assessment. [ABSTRACT FROM AUTHOR]

In recent years, different professional and academic settings have been increasingly utilizing ePortfolios to serve multiple purposes from recruitment to evaluation. This paper analyzes ePortfolios created by graduate students at a Canadian university. Demonstrated is how students' constructions can, and should, be more than a simple compilation of artifacts. Examined is an online learning environment whereby we shared knowledge, supported one another in knowledge construction, developed collective expertise, and engaged in progressive discourse. In our analysis of the portfolios, we focused on reflection and deepening understanding of learning. We discussed students' use of metaphors and hypertexts as means of making cognitive connections. We found that when students understood technological tools and how to use them to substantiate their thinking processes and to engage the readers/ viewers, their ePortfolios were richer and more complex in their illustrations of learning. With more experience and further analysis of exemplars of existing portfolios, students became more nuanced in their organization of their ePortfolios, reflecting the messages they conveyed. Metaphors and hypertexts became useful vehicles to move away from linearity and chronology to new organizational modes that better illustrated students' cognitive processes. In such a community of inquiry, developed within an online learning space, the instructor and peers had an important role in enhancing reflection through scaffolding. We conclude the paper with a call to explore the interactions between viewer/reader and the materials presented in portfolios as part of learning occasions. [ABSTRACT FROM AUTHOR]