Search

Issue:  Technology is pervasive in medicine, but we too rarely examine how it shapes assessment, learning, knowledge, and performance. Cultures of assessment also shape identities, social relations, and the knowledge and behavior recognized as legitimate by a profession. Therefore, the combination of technology and assessment within medical education is worthy of review. Online proctoring services have become more prevalent during the Covid-19 pandemic, as a means of continuing high-stakes invigilated examinations online. With criticisms about increased surveillance, discrimination, and the outsourcing of control to commercial vendors, is this simply "moving exams online", or are there more serious implications? What can this extreme example tell us about how our technologies of assessment influence relationships between trainees and medical education institutions?, Evidence:  We combine postdigital and postphenomenology approaches to analyze the written component of the 2020 online proctored United Kingdom Royal College of Physicians (MRCP) membership exam. We examine the scripts, norms, and trust relations produced through this example of online proctoring, and then locate them in historical and economic contexts. We find that the proctoring service projects a false objectivity that is undermined by the tight script with which examinees must comply in an intensified norm of surveillance, and by the interpretation of digital data by unseen human proctors. Nonetheless, such proctoring services are promoted by an image of data-driven innovation, a rhetoric of necessity in response to a growing problem of online cheating, and an aversion, within medical education institutions, to changing assessment formats (and thus the need to accept different forms of knowledge as legitimate)., Implications:  The use of online proctoring technology by medical education institutions intensifies established norms, already present within examinations, of surveillance and distrust. Moreover, it exacerbates tensions between conflicting agendas of commercialization, accountability, and the education of trustworthy professionals. Our analysis provides an example of why it is important to stop and consider the holistic implications of introducing technological "solutions", and to interrogate the intersection of technology and assessment practices in relation to the wider goals of medical education.

Context: Medical schools are complex organisations existing at the intersection of higher education and healthcare services. This complexity is compounded by many competing pressures and drivers from professional and regulatory bodies, the wider political environment and public expectations, producing a range of challenges for those involved in all stages of medical education. There are established approaches that have been used to address research questions related to these challenges; some focus on organisational structures, characteristics and performance; others on the interactions that take place in a particular setting. Less common are approaches that integrate data on macro-level structures with the micro-level interactions of the people who inhabit those structures. Looking at the interaction of the macro and the micro opens up possibilities for the new insights., Framework: We propose using an approach with roots in social theory-Inhabited Institutionalism (II)-that is largely unexplored in medical education. II has been described as Janus-faced, looking both outwards, at the broader context of medical education, and inwards, at the ways in which meanings are constructed and re-constructed by participants within a particular setting., Methods: After describing the theoretical framework of II, we explain how it can be used to understand medical education as subject to both broader societal structures (the macro level) and interactions between people (the micro level), as well as-crucially-their mutual influence., Conclusion: II offers the opportunity to combine macro- and micro-level perspectives, leading to a more expansive understanding of the operation of medical education which sees its form and function as neither entirely determined by structures nor a construction of individuals engaged in it. In doing so, it potentially offers a valuable way of considering the intractable problem of how to successfully manage change, offering a combined top-down and bottom-up perspective., (© 2021 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Background: Threshold concepts (TCs) are defined as ideas within a discipline that are often conceptually difficult ("troublesome"), but when learned, transform a learner's understanding. Electroencephalography (EEG) has been recognized as a conceptually difficult field in neurology, and a study of threshold concepts in EEG may provide insights into how it is taught and learned., Methods: Semi-structured interviews were performed with 12 EEG experts in the US and Canada. Experts identified potential TCs and troublesome knowledge, and explored how these concepts were taught and learned. Interview transcripts were coded and analyzed using a general thematic analysis approach, based on the core elements of the threshold concepts framework., Results: One concept (polarity) emerged most clearly as a threshold concept. Other troublesome areas included pattern interpretation and clinical significance, but these lacked some of the characteristics of TCs. Several themes emerged, including the role of TCs and troublesome knowledge in determining expertise and the role of prior experience., Conclusions: We have used the threshold concepts framework to explore potential barriers to learning, suggest ways to support learners, and identify potential points of emphasis for teaching and learning EEG. A similar approach could be applied to the study of teaching and learning in other conceptually difficult areas of medical education.