Search

Background: Medical education is a multifarious endeavour integrating a range of pedagogies and philosophies. Complexity as a science or theory ('complexity') signals a move away from a reductionist paradigm to one which appreciates that interactions in multi-component systems, such as healthcare systems, can result in adaptive and emergent outcomes. This examination of the nexus between medical education and complexity theory aims to discover ways that complexity theory can inform medical education and medical education research. Methods: A structured literature review was conducted to examine the nexus between medical education and complexity; 5 databases were searched using relevant terms. Papers were included if they engaged fully with complexity as a science or theory and were significantly focused on medical education. All types of papers were included, including conceptual papers (e.g. opinion and theoretical discussions), case studies, program evaluations and empirical research. A narrative and thematic synthesis was undertaken to create a deep understanding of the use of complexity in medical education. Results: Eighty-three papers were included; the majority were conceptual papers. The context and theoretical underpinnings of complexity as a relevant theory for medical education were identified. Bibliographic and temporal observations were noted regarding the entry of complexity into medical education. Complexity was relied upon as a theoretical framework for empirical studies covering a variety of elements within medical education including: knowledge and learning theories; curricular, program and faculty development; program evaluation and medical education research; assessment and admissions; professionalism and leadership; and learning for systems, about systems and in systems. Discussion: There is a call for greater use of theory by medical educators. Complexity within medical education is established, although not widespread. Individualistic cultures of medicine and comfort with reductionist epistemologies challenges its introduction. However, complexity was found to be a useful theory across a range of areas by a limited number of authors and is increasingly used by medical educators and medical education researchers. This review has further conceptualized how complexity is being used to support medical education and medical education research. Conclusion: This literature review can assist in understanding how complexity can be useful in medical educationalists' practice. [ABSTRACT FROM AUTHOR]

Objectives: To evaluate the impact a novel education programme - to improve research engagement, awareness, understanding and confidence - had on a diverse health and social care workforce. Barriers and facilitators to engagement were explored together with research capacity-building opportunities and ways to embed a research culture. The programme is entitled 'Supporting The Advancement of Research Skills' (STARS programme); the paper reports findings from a health and social care setting in England, UK. Methods: A four-level outcome framework guided the approach to evaluation and was further informed by key principles of research capacity development and relevant theory. Quantitative data were collected from learners before and after engagement; these were analysed descriptively. Semi-structured online interviews were conducted with learners and analysed thematically. A purposive sample was achieved to include a diversity in age, gender, health and social care profession, and level of attendance (regular attendees, moderate attendees and non-attenders). Results: The evaluation spanned 18 half-day workshops and 11 seminars delivered by expert educators. 165 (2% of total staff at Midlands Partnership University NHS Foundation Trust (MPFT)) staffs booked one or more education sessions; 128 (77%) including Allied Health Professionals (AHPs), psychologists, nursing and midwifery, and social workers attended one or more session. Key themes of engagement with teaching sessions, relevance and impact of training and promoting a research active environment were identified with relevant sub-themes. Positive impacts of training were described in terms of research confidence, intentions, career planning and application of research skills as a direct result of training. Lack of dedicated time for research engagement, work pressures and time commitments required for the programme were key barriers. Facilitators that facilitated engagement are also described. Conclusions: Findings demonstrate the impact that a free, virtual and high-quality research education programme had at individual and organisational levels. The programme is the product of a successful collaboration between health and social care and academic organisations; this provides a useful framework for others to adapt and adopt. Key barriers to attendance and engagement spoke to system-wide challenges that an education programme could not address in the short-term. Potential solutions are discussed in relation to protecting staff time, achieving management buy-in, recognising research champions, and having a clear communication strategy. [ABSTRACT FROM AUTHOR]

Background: The COVID-19 pandemic changed the way we work, spend, live, and learn. The impact was felt in the health sector where hospitals cancelled elective surgery, put on hold outpatient services, and implemented new social distancing procedures and telehealth systems, to enable hospitals to increase bed capacity. For medical students, these factors meant significant disruption to their clinical placements, remote delivery of their education, cessation of international and interstate placements, complicated by significant travel restrictions and border closures. There were concerns that final year students might be unable to graduate that year due to this lack of clinical exposure. Innovation: As a result of this disruption in late March 2020 we developed an innovative 6 week 'COVID-19 e-lective' rotation, consisting of online modules, virtual clinical tutorials and a COVID project totalling the equivalent of 200 h of work. Results: An evaluation was undertaken that found it to be remarkably successful in meeting the students' learning needs and alleviating concerns about disrupted placements. It was also conducted during 2021 for all Year 4 students to help expand clinical placement opportunities. Outcomes: This paper describes the e-lective, its innovations, its challenges, and its evaluation findings, for others to learn from. [ABSTRACT FROM AUTHOR]

Background: Interprofessional learning is gaining momentum in revolutionizing healthcare education. During the academic year 2015/16, seven undergraduate-entry health and social care programs from two universities in Hong Kong took part in an interprofessional education program. Based on considerations such as the large number of students involved and the need to incorporate adult learning principles, team-based learning was adopted as the pedagogy for the program, which was therefore called the interprofessional team-based learning program (IPTBL). The authors describe the development and implementation of the IPTBL program and evaluate the effectiveness of the program implementation. Methods: Eight hundred and one students, who are predominantly Chinese, participated in the IPTBL. The quantitative design (a pretest-posttest experimental design) was utilized to examine the students' gains on their readiness to engage in interprofessional education (IPE). Results: Three instructional units (IUs) were implemented, each around a clinical area which could engage students from complementary health and social care disciplines. Each IU followed a team-based learning (TBL) process: pre-class study, individual readiness assurance test, team readiness assurance test, appeal, feedback, and application exercise. An electronic platform was developed and was progressively introduced in the three IUs. The students' self-perceived attainment of the IPE learning outcomes was high. Across all four subscales of RIPLS, there was significant improvement in student's readiness to engage in interprofessional learning after the IPTBL. A number of challenges were identified: significant time involvement of the teachers, difficulty in matching students from different programs, difficulty in making IPTBL count towards a summative assessment score, difficulty in developing the LAMS platform, logistics difficulty in managing paper TBL, and inappropriateness of the venue. Conclusions: Despite some challenges in developing and implementing the IPTBL program, our experience showed that TBL is a viable pedagogy to be used in interprofessional education involving hundreds of students. The significant improvement in all four subscales of RIPLS showed the effects of the IPTBL program in preparing students for collaborative practice. Factors that contributed to the success of the use of TBL for IPE are discussed. [ABSTRACT FROM AUTHOR]

Abstract Background Medical education is a multifarious endeavour integrating a range of pedagogies and philosophies. Complexity as a science or theory (‘complexity’) signals a move away from a reductionist paradigm to one which appreciates that interactions in multi-component systems, such as healthcare systems, can result in adaptive and emergent outcomes. This examination of the nexus between medical education and complexity theory aims to discover ways that complexity theory can inform medical education and medical education research. Methods A structured literature review was conducted to examine the nexus between medical education and complexity; 5 databases were searched using relevant terms. Papers were included if they engaged fully with complexity as a science or theory and were significantly focused on medical education. All types of papers were included, including conceptual papers (e.g. opinion and theoretical discussions), case studies, program evaluations and empirical research. A narrative and thematic synthesis was undertaken to create a deep understanding of the use of complexity in medical education. Results Eighty-three papers were included; the majority were conceptual papers. The context and theoretical underpinnings of complexity as a relevant theory for medical education were identified. Bibliographic and temporal observations were noted regarding the entry of complexity into medical education. Complexity was relied upon as a theoretical framework for empirical studies covering a variety of elements within medical education including: knowledge and learning theories; curricular, program and faculty development; program evaluation and medical education research; assessment and admissions; professionalism and leadership; and learning for systems, about systems and in systems. Discussion There is a call for greater use of theory by medical educators. Complexity within medical education is established, although not widespread. Individualistic cultures of medicine and comfort with reductionist epistemologies challenges its introduction. However, complexity was found to be a useful theory across a range of areas by a limited number of authors and is increasingly used by medical educators and medical education researchers. This review has further conceptualized how complexity is being used to support medical education and medical education research. Conclusion This literature review can assist in understanding how complexity can be useful in medical educationalists' practice.

Background: Scientometric studies are one of the most important and useful tools to assess the research performance and knowledge impact of researchers. The aim of this study was to map out the scientific performance of the Iranian medical academics with respect to a detailed range of scientometric indicators. Methods: Using scientometric approach, individual and scientific performance data of medical academic staff were extracted from the Iranian Scientometric Information Database (ISID). Total number of publications, total number of citations, citation per paper, h-index, international collaboration, self-citation, SJR decile, i10-Index, Quartile distribution were the studied scientometric variables. Out of the registered 19,023 academic staff, 746 were included in the study through simple random sampling method using random sample extraction function in STATA. Data were analyzed using STATA 14 statistical software package. Results: Most of the included academicians were men (60%). A total of 13,682 articles were published by them until 2018, being cited 114,928 times with a mean of 5.77 citation per paper. H-index median was three and about 90% of the staff had an H-index below 10. Number of published papers, cite per paper and H-index metrics were significantly different with respect to gender, academic position/degree, and general field of study (p < 0.05). About 2.5% of published articles were contributed through international collaboration. The scientometric performance of academic staff was highly diverse with respect to the employing institution and its national classification group (type 1, 2, 3). Conclusions: Nevertheless to the great scientific production of medical academics, individual and institutional characteristics were identified as effective variables in academics research performance and should be considered in their assessment. Academicians affiliated with type 2 and 3 universities (based on national ranking of medical universities) had weaker research performance compared to those affiliated with type 1 universities. However, low rate of international research collaborations was a common challenge in medical universities. [ABSTRACT FROM AUTHOR]

Introduction: The last two decades have seen a shift in former Soviet countries from highly specialized to more family medicine-focused systems. Medical education has slowly adjusted to these reforms, although the region is still at risk to have a chronic shortage of family doctors. This paper presents the evaluation of a new post-graduate family medicine program in Tajikistan, focused on competency-based training. The findings are relevant for policy makers, international organizations and practitioners participating in similar medical education reform programs. Methods: We employed a quasi-experimental control group design and compared intervention residents, control group residents with traditional training, and 1st year residents with no training in two outcomes, clinical knowledge and competencies. We employed two objective measures, a written multiple-choice question test (MCQT) and an Objective Structured Clinical Examination (OSCE), respectively. We report reliability and validity of the measures along with ANOVA, planned contrasts and effect size estimates to examine differences across groups. Results: We found statistically significant differences in both clinical knowledge and competencies between intervention and control groups. We also detected a large intervention effect size. Participants in the intervention outperformed control group participants in the two measures. Our analysis suggests that intervention and control group participants are comparable in terms of initial knowledge and competencies, strengthening the argument that the intervention caused the improvement in the program outcomes. Discussion: Receiving tailored training and structured opportunities to practice knowledge and competencies in clinical settings have a positive effect on the education of family medicine doctors in Tajikistan. Our results support curriculum reform and investment in medical education in the form of longer and supervised on-the-job preparation designed to be more in line with international standards. We discuss suggestions for future studies and potential requirements to inform replicability in other countries. Conclusion: Family medicine is well recognized as central to health systems throughout the world, but high quality residency training lags behind in some countries. Our study showed that investing in family medicine residency programs and structured training is effective in increasing critical clinical competencies. We encourage promoting comprehensive post graduate family medicine doctor training so that the goals of a family medicine centered health system are attainable. [ABSTRACT FROM AUTHOR]

Background: Interpersonal and communication skills (ICS) are important core competencies in medical education and certification. In this study, we identified self- and simulated patient (SP)-reported ratings of US first-year medical students' ICS and the influence of age and gender on performance appraisal during the Objective-Structured Clinical Examination (OSCE). Methods: OSCE participants, including 172 first-year medical students and 15 SPs were asked to evaluate the students' ICS using the American Board of Internal Medicine–Patient-Satisfaction Questionnaire (ABIM–PSQ), electronically and via paper, respectively. Self- and SP-reported ratings of students' ICS were presented as the median on a 5-point Likert-scale and as three categories defined as "good," "very good," and "inadequate." Results: SPs assessed all 172 students in the OSCE, while 43.6% of students assessed their own performance. The majority of students and SPs evaluated the students' ICS as very good. 23.3% of SPs and 5.3% of students rated the medical students' ability to encourage patient question-asking and answer questions as inadequate (P < 0.002). Neither age nor gender influenced the medical students' self-assessment of ICS. Female SPs assigned lower scores to students in regard to respecting patients and encouraging patient question-asking and answering. Older SPs was more likely to assign lower scores on all survey questions. Conclusions: In the present study, self- and SP-reported ratings of first-year medical students' ICS were mainly "very good" with no influence of students' age or gender. Older age and female gender among the SPs were associated with a reduction in SP-reported ratings of students' ICS. [ABSTRACT FROM AUTHOR]

Background: The key step in evaluating the quality of clinical nursing practice education lies in establishing a scientific, objective, and feasible index system. Current assessments of clinical teaching typically measure hospital learning environments, classroom teaching, teaching competency, or the internship quality of nursing students. As a result, clinical evaluations are often insufficient to provide focused feedback, guide faculty development, or identify specific areas for clinical teachers to implement change and improvement. Therefore, the purpose of our study was to to construct a scientific, systematic, and clinically applicable evaluation index system of clinical nursing practice teaching quality and determine each indicator's weight to provide references for the scientific and objective evaluation of clinical nursing practice teaching quality. Methods: Based on the "Structure-Process-Outcome" theoretical model, a literature review and Delphi surveys were conducted to establish the evaluation index system of clinical nursing practice teaching quality. Analytic Hierarchy Process (AHP) was employed to determine the weight of each indicator. Results: The effective response rate for the two rounds of expert surveys was 100%. The expert authority coefficients were 0.961 and 0.975, respectively. The coefficient of variation for the indicators at each level ranged from 0 to 0.25 and 0 to 0.21, and the Kendall harmony coefficients were 0.209 and 0.135, respectively, with statistically significant differences (P < 0.001). The final established index system included 3 first-level, 10 second-level, and 29 third-level indicators. According to the weights computed by the AHP, first-level indicators were ranked as "Process quality" (39.81%), "Structure quality" (36.67%), and "Outcome quality" (23.52%). Among the secondary indicators, experts paid the most attention to "Teaching staff" (23.68%), "Implementation of teaching rules and regulations (14.14%), and "Teaching plans" (13.20%). The top three third-level indicators were "Level of teaching staff" (12.62%), "Structure of teaching staff" (11.06%), and "Implementation of the management system for teaching objects" (7.54%). Conclusion: The constructed evaluation index system of clinical nursing practice teaching quality is scientific and reliable, with reasonable weight. The managers' focus has shifted from outcome-oriented to process-oriented approaches, and more focus on teaching team construction, teaching regulations implementation, and teaching design is needed to improve clinical teaching quality. [ABSTRACT FROM AUTHOR]

Background: The positive effects of active and passive music activities on older people with dementia are well and largely documented by the literature. Nevertheless, the use of music as a non-pharmacological intervention is not so common both in private and public older people care facilities because in-home staff have no competencies for delivering such activities. Conversely, the realization and implementation of a co-designed music-based curriculum for dementia care professionals may help the diffusion of music in the older people care facilities. This study was aimed at evaluating the learning outcomes of the SOUND training, based on an original co-designed music-based curriculum for dementia care professionals and implemented in Italy, Portugal and Romania. Methods: The SOUND training study was developed through three phases: a) the co-design of the music-based curriculum for dementia care professionals, involving 55 people in the three participating countries; b) the teaching of the training curriculum to 63 dementia care professionals (29 in Italy, 17 in Portugal and 17 in Romania), delivered both in person and via a Moodle platform named Virtual Music Circle; c) the learning outcomes assessment, carried out by means of 13 self-evaluation tests, and a practical test, and the trainees' course evaluation by a questionnaire. Results: Most of the trainees reached the highest score in the evaluation of the theoretical competencies in the three study countries. Conversely, some practical competencies in the facilitation of music activities need to be fine-tuned. The SOUND training course was evaluated very positively in the overall structure, theoretical contents, and practical workshops by the trainees. Nevertheless, they preferred the face-to-face compared to the distance learning methodology in the three countries. Conclusions: The SOUND training curriculum was effective in teaching music techniques and neurocognitive knowledge to dementia care professionals. Nevertheless, future courses should be differentiated for dementia care professionals with or without previous music knowledge and competencies. Moreover, the course is fully sustainable, because it does not require additional costs given that the curriculum is fully accessible online and it is also replicable because it trains professionals who can continue to apply the method in their working routine. [ABSTRACT FROM AUTHOR]

Background: The non-curative setting makes communication and shared decision-making in palliative care extremely demanding. This is even more so for patients with limited health literacy. So far, research in palliative care focusing on shared decision-making with patients with limited health literacy is lacking. Recent research from our team indicates that the assessment of these patients' understanding of their situation and the implementation of shared decision-making in palliative care, needs improvement. Methods: To improve communication and decision-making, especially with patients with limited health literacy, we developed and evaluated a blended training programme for healthcare providers. The training programme comprised of an e-learning and a team training. The evaluation was performed by 1. conducting interviews (n = 15) focused on evaluating the whole programme and, 2. coding video-recorded outpatient consultations on the extent to which providers involved patients in decision-making before (n = 19) and after (n = 20) the intervention, using the 5-item OPTION coding instrument. Results: The interviews showed that healthcare providers valued the skills they had learned during the e-learning and team training. Providers specifically valued the teach-back technique, learned to use simpler wording and felt better able to recognize patients with limited health literacy. Many providers reported a change in communication behaviour as a consequence of the training programme. Suggestions for improvement for both e-learning and training were, amongst others, a follow-up team training course and a new scenarios for the e-learning about discussing palliative care. For both the pre- and the post-measurement, involving patients in decision-making lies between a minimal and a moderate effort; differences were not significant. Conclusions: The e-learning and team training were valued positively by the healthcare providers. Adaptations to the e-learning have been made after evaluation. The e-learning has been implemented in several hospitals and medical education. To improve shared decision-making in practice a more sustained effort is needed. [ABSTRACT FROM AUTHOR]

Background: An innovative program, the Practice Support Program (PSP), for full-service family physicians and their medical office assistants in primary care practices was recently introduced in British Columbia, Canada. The PSP was jointly approved by both government and physician groups, and is a dynamic, interactive, educational and supportive program that offers peer-to-peer training to physicians and their office staff. Topic areas range from clinical tools/skills to office management relevant to General Practitioner (GP) practices and "doable in real GP time". PSP learning modules consist of three half-day learning sessions interspersed with 6-8 week action periods. At the end of the third learning session, all participants were asked to complete a pen-and-paper survey that asked them to rate (a) their satisfaction with the learning module components, including the content and (b) the perceived impact the learning has had on their practices and patients. Methods: A total of 887 GPs (response rates ranging from 26.0% to 60.2% across three years) and 405 MOAs (response rates from 21.3% to 49.8%) provided responses on a pen-and-paper survey administered at the last learning session of the learning module. The survey asked respondents to rate (a) their satisfaction with the learning module components, including the content and (b) the perceived impact the learning has had on their practices and patients. The psychometric properties (Chronbach's alphas) of the satisfaction and impact scales ranged from .82 to .94. Results: Evaluation findings from the first three years of the PSP indicated consistently high satisfaction ratings and perceived impact on GP practices and patients, regardless of physician characteristics (gender, age group) or work-related variables (e.g., time worked in family practice). The Advanced Access Learning Module, which offers tools to improve office efficiencies, decreased wait times for urgent, regular and third next available appointments by an average of 1.2, 3.3, and by 3.4 days across all physicians. For the Chronic Disease Management module, over 87% of all GP respondents developed a CDM patient registry and reported being able to take better care of their patients. After attending the Adult Mental Health module: 94.1% of GPs agreed that they felt more comfortable helping patients who required mental health care; over 82% agreed that their skills and their confidence in diagnosing and treating mental health conditions had improved; and 41.0% agreed that their frequency of prescribing medications, if appropriate, had decreased. Additionally for the Adult Mental Health module, a 3-6 month follow-up survey of the GPs indicated that the implemented changes were sustained over time. Conclusion: GP and medical office assistant participant ratings show that the PSP learning modules were consistently successful in providing GPs and their staff with new learning that was relevant and could be implemented and used in "real-GP-time". [ABSTRACT FROM AUTHOR]

Abstract Background Scientometric studies are one of the most important and useful tools to assess the research performance and knowledge impact of researchers. The aim of this study was to map out the scientific performance of the Iranian medical academics with respect to a detailed range of scientometric indicators. Methods Using scientometric approach, individual and scientific performance data of medical academic staff were extracted from the Iranian Scientometric Information Database (ISID). Total number of publications, total number of citations, citation per paper, h-index, international collaboration, self-citation, SJR decile, i10-Index, Quartile distribution were the studied scientometric variables. Out of the registered 19,023 academic staff, 746 were included in the study through simple random sampling method using random sample extraction function in STATA. Data were analyzed using STATA 14 statistical software package. Results Most of the included academicians were men (60%). A total of 13,682 articles were published by them until 2018, being cited 114,928 times with a mean of 5.77 citation per paper. H-index median was three and about 90% of the staff had an H-index below 10. Number of published papers, cite per paper and H-index metrics were significantly different with respect to gender, academic position/degree, and general field of study (p

Background: The seven categories of the Stanford Faculty Development Program (SFDP) represent a framework for planning and assessing medical teaching. Nevertheless, so far there is no specific evaluation tool for large-group lectures that is based on these categories. This paper reports the development and psychometric validation of a short German evaluation tool for large-group lectures in medical education (SETMED-L: 'Student Evaluation of Teaching in MEDical Lectures') based on the SFDP-categories. Methods: Data were collected at two German medical schools. In Study 1, a full information factor analysis of the new 14-item questionnaire was performed. In Study 2, following cognitive debriefings and adjustments, a confirmatory factor analysis was performed. The model was tested for invariance across medical schools and student gender. Convergent validity was assessed by comparison with results of the FEVOR questionnaire. Results: Study 1 ( n = 922) yielded a three-factor solution with one major (10 items) and two minor factors (2 items each). In Study 2 ( n = 2740), this factor structure was confirmed. Scale reliability ranged between α = 0.71 and α = 0.88. Measurement invariance was given across student gender but not across medical schools. Convergent validity in the subsample tested ( n = 246) yielded acceptable results. Conclusion: The SETMED-L showed satisfactory to very good psychometric characteristics. The main advantages are its short yet comprehensive form, the integration of SFDP-categories and its focus on medical education. [ABSTRACT FROM AUTHOR]

Abstract Objectives To evaluate the impact a novel education programme - to improve research engagement, awareness, understanding and confidence - had on a diverse health and social care workforce. Barriers and facilitators to engagement were explored together with research capacity-building opportunities and ways to embed a research culture. The programme is entitled ‘Supporting The Advancement of Research Skills’ (STARS programme); the paper reports findings from a health and social care setting in England, UK. Methods A four-level outcome framework guided the approach to evaluation and was further informed by key principles of research capacity development and relevant theory. Quantitative data were collected from learners before and after engagement; these were analysed descriptively. Semi-structured online interviews were conducted with learners and analysed thematically. A purposive sample was achieved to include a diversity in age, gender, health and social care profession, and level of attendance (regular attendees, moderate attendees and non-attenders). Results The evaluation spanned 18 half-day workshops and 11 seminars delivered by expert educators. 165 (2% of total staff at Midlands Partnership University NHS Foundation Trust (MPFT)) staffs booked one or more education sessions; 128 (77%) including Allied Health Professionals (AHPs), psychologists, nursing and midwifery, and social workers attended one or more session. Key themes of engagement with teaching sessions, relevance and impact of training and promoting a research active environment were identified with relevant sub-themes. Positive impacts of training were described in terms of research confidence, intentions, career planning and application of research skills as a direct result of training. Lack of dedicated time for research engagement, work pressures and time commitments required for the programme were key barriers. Facilitators that facilitated engagement are also described. Conclusions Findings demonstrate the impact that a free, virtual and high-quality research education programme had at individual and organisational levels. The programme is the product of a successful collaboration between health and social care and academic organisations; this provides a useful framework for others to adapt and adopt. Key barriers to attendance and engagement spoke to system-wide challenges that an education programme could not address in the short-term. Potential solutions are discussed in relation to protecting staff time, achieving management buy-in, recognising research champions, and having a clear communication strategy.

Background: Valid and reliable instruments are required to measure the effect of educational interventions to improve evidence-based practice (EBP) knowledge and skills in occupational therapy. The aims of this paper are to: 1) describe amendments to the Adapted Fresno Test of Competence in EBP (AFT), and 2) report the psychometric properties of the modified instrument when used with South African occupational therapists. Methods: The clinical utility of the AFT was evaluated for use with South African occupational therapists and modifications made. The modified AFT was used in two studies to assess its reliability and validity. In Study 1 a convenience sample of 26 occupational therapists in private practice or government-funded health facilities in a South African province were recruited to complete the modified AFT on two occasions 1 week apart. Completed questionnaires were scored independently by two raters. Inter-rater, test-retest reliability and internal consistency were determined. Study 2 was a pragmatic randomised controlled trial involving occupational therapists in four Western Cape Department of Health district municipalities (n = 58). Therapists were randomised in matched pairs to one of two educational interventions (interactive or didactic), and completed the modified AFT at baseline and 12 weeks after the intervention. An intention-to-treat analysis was performed. Data were not normally distributed, thus non-parametric statistics were used. Results: In Study 1, 21 of 26 participants completed the questionnaire twice. Test-retest (ICC = 0.95, 95 % CI = 0.88–0.98) and inter-rater reliability (Time 1: ICC = 0.995, 95 % CI = 0.99–0.998; Time 2: ICC = 0.99, 95 % CI = 0.97–0.995) were excellent for total scores. Internal consistency based on time 1 scores was satisfactory (α = 0.70). In Study 2, 28 participants received an interactive educational intervention and completed the modified AFT at baseline and 12 weeks later. Median total SAFT scores increased significantly from baseline to 12-weeks (Z = −4.078, p < 0.001) with a moderate effect size (r = 0.55). Conclusion: The modified AFT has demonstrated validity for detecting differences in EBP knowledge between two groups. It also has excellent test-retest and inter-rater reliability. The instrument is recommended for contexts where EBP is an emerging approach and time is at a premium. [ABSTRACT FROM AUTHOR]

Background: The Practice Support Program (PSP) is an innovative peer-to-peer continuing medical education (CME) program that offers full-service family physicians/general practitioners (GPs) in British Columbia (BC), Canada, post-graduate training on a variety of topics. We present the evaluation findings from the PSP learning module on enhancing end-of-life (EOL) care within primary care. Methods: Pen-and-paper surveys were administered to participants three times: at the beginning of the first training session (n = 608; 69.6 % response rate), at training completion (n = 381, 55.6 % response rate), and via a mail-out survey at 3-6 months following training completion (n = 109, 24.8 % response rate). Surveys asked GPs about current EOL-related practices and confidence in EOL-related skills. At end of training, respondents also provided ratings of satisfaction and perceptions of the module's impact on their practice and their EOL patients. Results: Satisfaction and impact were rated very highly by over 90 % of the GP respondents. Module participation increased the GPs' confidence on EOL-related communication and collaboration skills: e.g., initiating conversations about EOL care, developing an action plan for EOL care, communicating the patient's needs and wishes to other care providers, participating in collaborative care with home and community care nurses, and accessing and referring patients to EOL specialists in the community. Increased confidence was maintained at 3-6 months following completion of training. Conclusions: The EOL learning module offered by the PSP to family physicians in BC is a successful and impactful CME accredited training module for enhancing end-of-life care in primary care settings. [ABSTRACT FROM AUTHOR]

Abstract Background Transition into higher education has been identified as one of the most stressful periods for learners. Interventions targeting the transition phase such as near- peer mentoring might help address some of these challenges. We were however unable to identify a published systematic review of the literature describing outcomes of near-peer mentoring of medical students during the transition phase into medical school. The aim of this paper is to review the literature and describe the outcomes of near-peer mentoring schemes for first-year medical students in the transition phase. Methods A search of different electronic databases was carried out, using the search terms peer, buddy, mentor*, counsel*, advise*, tutor*, student, medical, school. 1861 articles were identified, however only 5 studies met the inclusion criteria- primary mentees should be first-years, and mentors must be inclusive of second-years but not limited to them. In reporting this paper, the PRISMA guidelines were followed. Results Published material on near-peer mentoring for medical students is scarce. Three outcomes for peer mentoring were identified- professional and personal development, stress reduction, and ease of transitioning. Incidentally, peer-mentoring was also found to have facilitated the development of personal and professional attitudes in the mentors. The quality of the evaluation methods in the studies was however low to moderate. Conclusion Near-peer-mentoring is a way of promoting professional and personal development. It is also promising to aid transition and maintain well-being of first-year medical students. However, larger, better quality longitudinal studies, are needed to ascertain its true value for these students.

Background: The 'human resources for health' crisis has highlighted the need for more health (care) professionals and led to an increased interest in health professional education, including master's degree programmes. The number of these programmes in low- and middle-income countries (LMIC) is increasing, but questions have been raised regarding their relevance, outcome and impact. We conducted a systematic review to evaluate the outcomes and impact of health-related master's degree programmes. Methods: We searched the databases Scopus, Pubmed, Embase, CINAHL, ERIC, Psychinfo and Cochrane (1999 - November 2011) and selected websites. All papers describing outcomes and impact of health-related Master programmes were included. Three reviewers, two for each article, extracted data independently. The articles were categorised by type of programme, country, defined outcomes and impact, study methods used and level of evidence, and classified according to outcomes: competencies used in practice, graduates' career progression and impact on graduates' workplaces and sector/society. Results: Of the 33 articles included in the review, most originated from the US and the UK, and only one from a low-income country. The programmes studied were in public health (8), nursing (8), physiotherapy (5), family practice (4) and other topics (8). Outcomes were defined in less than one third of the articles, and impact was not defined at all. Outcomes and impact were measured by self-reported alumni surveys and qualitative methods. Most articles reported that competencies learned during the programme were applied in the workplace and alumni reported career progression or specific job changes. Some articles reported difficulties in using newly gained competencies in the workplace. There was limited evidence of impact on the workplace. Only two articles reported impact on the sector. Most studies described learning approaches, but very few described a mechanism to ensure outcome and impact of the programme. Conclusions: Evidence suggests that graduates apply newly learned competencies in the field and that they progress in their career. There is a paucity of well-designed studies assessing the outcomes and impact of health-related master's degree programmes in low- and middle-income countries. Studies of such programmes should consider the context and define outcomes and impact. [ABSTRACT FROM AUTHOR]

Background: Technological advances have enabled the widespread use of video cases via web-streaming and online download as an educational medium. The use of real subjects to demonstrate acute pathology should aid the education of health care professionals. However, the methodology by which this effect may be tested is not clear. Methods: We undertook a literature review of major databases, found relevant articles relevant to using patient video cases as educational interventions, extracted the methodologies used and assessed these methods for internal and construct validity. Results: A review of 2532 abstracts revealed 23 studies meeting the inclusion criteria and a final review of 18 of relevance. Medical students were the most commonly studied group (10 articles) with a spread of learner satisfaction, knowledge and behaviour tested. Only two of the studies fulfilled defined criteria on achieving internal and construct validity. The heterogeneity of articles meant it was not possible to perform any meta-analysis. Conclusions: Previous studies have not well classified which facet of training or educational outcome the study is aiming to explore and had poor internal and construct validity. Future research should aim to validate a particular outcome measure, preferably by reproducing previous work rather than adopting new methods. In particular cognitive processing enhancement, demonstrated in a number of the medical student studies, should be tested at a postgraduate level. [ABSTRACT FROM AUTHOR]

Background: An assessment programme, a purposeful mix of assessment activities, is necessary to achieve a complete picture of assessee competence. High quality assessment programmes exist, however, design requirements for such programmes are still unclear. We developed guidelines for design based on an earlier developed framework which identified areas to be covered. A fitness-for-purpose approach defining quality was adopted to develop and validate guidelines. Methods: First, in a brainstorm, ideas were generated, followed by structured interviews with 9 international assessment experts. Then, guidelines were fine-tuned through analysis of the interviews. Finally, validation was based on expert consensus via member checking. Results: In total 72 guidelines were developed and in this paper the most salient guidelines are discussed. The guidelines are related and grouped per layer of the framework. Some guidelines were so generic that these are applicable in any design consideration. These are: the principle of proportionality, rationales should underpin each decisions, and requirement of expertise. Logically, many guidelines focus on practical aspects of assessment. Some guidelines were found to be clear and concrete, others were less straightforward and were phrased more as issues for contemplation. Conclusions: The set of guidelines is comprehensive and not bound to a specific context or educational approach. From the fitness-for-purpose principle, guidelines are eclectic, requiring expertise judgement to use them appropriately in different contexts. Further validation studies to test practicality are required. [ABSTRACT FROM AUTHOR]

Abstract Background The COVID-19 pandemic changed the way we work, spend, live, and learn. The impact was felt in the health sector where hospitals cancelled elective surgery, put on hold outpatient services, and implemented new social distancing procedures and telehealth systems, to enable hospitals to increase bed capacity. For medical students, these factors meant significant disruption to their clinical placements, remote delivery of their education, cessation of international and interstate placements, complicated by significant travel restrictions and border closures. There were concerns that final year students might be unable to graduate that year due to this lack of clinical exposure. Innovation As a result of this disruption in late March 2020 we developed an innovative 6 week ‘COVID-19 e-lective’ rotation, consisting of online modules, virtual clinical tutorials and a COVID project totalling the equivalent of 200 h of work. Results An evaluation was undertaken that found it to be remarkably successful in meeting the students’ learning needs and alleviating concerns about disrupted placements. It was also conducted during 2021 for all Year 4 students to help expand clinical placement opportunities. Outcomes This paper describes the e-lective, its innovations, its challenges, and its evaluation findings, for others to learn from.

Background: Health education is considered the most important component of primary health care. Paying attention to organizational factors can help to improve the quality of health education. Therefore, the present study was conducted to explain organizational factors affecting health education among health care providers. Method: This is a qualitative, descriptive, and phenomenological study that was conducted between 2020 -2022 on 50 health care workers who had been selected by purposeful sampling method in different settings including hospitals, GP office, behavioral disease counseling center, universities, and comprehensive health centers in the south and the center region of Iran. Data were collected by in-depth, semi-structured, and individual interviews, as well as focus group discussion, and continued until data saturation. Data were analyzed by MAXQDA software using qualitative content analysis in three stages: preparation, organization, and reporting. To evaluate the scientific accuracy of the findings in this study, 4 criteria of Lincoln & Guba were used. Results: The results revealed that every practice and policy in a health care organization from assessing needs, setting goals, planning activities, implementations and measurement outcome could affect health education practice and subsequently the health of population; nevertheless, the crucial role of health education practice is being neglected in health organizations. Organizational factors affecting health education were classified into three categories of planning, organizing, and also monitoring and evaluating. The category of planning had three subcategories of infrastructure planning, manpower planning, and design and planning for implementation of health education programs. The categories of organizing had two subcategories of coordination between different units of the Minister of Health and coordination between the health sector and other sectors of society. The categories of monitoring and evaluation had three subcategories of proper feedback, bureaucracy system, reward or reinforcement, failure to define health education as part of the job description, and the impact of electronic health records on the quality of evaluation. Conclusion: The results offer expertise and preliminary tools to help with evidence-based health education program planning and evaluation. The Support of managers, like providing manpower in accordance with the target population and infrastructure, can improve health education in the health system. In addition, intra- and inter-sectoral coordination at different levels of the health system to implement tailored programs according to the needs of clients by health education professionals, and the use of health education theories seem necessary. It is also recommended to review the monitoring system with appropriate feedback, define health education as a healthy activity, and develop appropriate criteria for better implementation of health education. [ABSTRACT FROM AUTHOR]

Background: Medical schools in Sub-Saharan Africa have adopted competency based medical education (CBME) to improve the quality of graduates trained. In 2015, Makerere University College of Health Sciences (MaKCHS) implemented CBME for the Bachelor of Medicine and Bachelor of Surgery (MBChB) programme in order to produce doctors with the required attributes to address community health needs. However, no formal evaluation of the curriculum has been conducted to determine whether all established competencies are being assessed. Objective: To evaluate whether assessment methods within the MBChB curriculum address the stated competencies. Methods: The evaluation adopted a cross-sectional study design in which the MBChB curriculum was evaluated using an Essential Course Evidence Form (ECEF) that was developed to collect information about each assessment used for each course. Information was collected on: (1) Assessment title, (2) Description, (3) Competency domain (4) Sub-competency addressed, (5) Student instructions, and (6) Grading method/details. Data were entered into a structured Access data base. In addition, face-to-face interviews were conducted with faculty course coordinators. Results: The MBChB curriculum consisted of 62 courses over 5 years, focusing on preclinical skills in years 1–2 and clinical skills in years 3–5. Fifty-nine competencies were identified and aggregated into 9 domains. Fifty-eight competencies were assessed at least one time in the curriculum. Faculty cited limited training in assessment as well as large student numbers as hindrances to designing robust assessments for the competencies. Conclusion: CBME was successfully implemented evidenced by all but one of the 59 competencies within the nine domains established being assessed within the MBChB curriculum at MaKCHS. Faculty interviewed were largely aware of it, however indicated the need for more training in competency-based assessment to improve the implementation of CBME. [ABSTRACT FROM AUTHOR]

Background: In 2008 the sub-Saharan FAIMER Regional Institute launched a faculty development programme aimed at enhancing the academic and research capacity of health professions educators working in sub-Saharan Africa. This two-year programme, a combination of residential and distance learning activities, focuses on developing the leadership, project management and programme evaluation skills of participants as well as teaching the key principles of health professions education-curriculum design, teaching and learning and assessment. Participants also gain first-hand research experience by designing and conducting an education innovation project in their home institutions. This study was conducted to determine the perceptions of participants regarding the personal and professional impact of the SAFRI programme. Methods: A retrospective document review, which included data about fellows who completed the programme between 2008 and 2011, was performed. Data included fellows’ descriptions of their expectations, reflections on achievements and information shared on an online discussion forum. Data were analysed using Kirkpatrick’s evaluation framework. Results: Participants (n=61) came from 10 African countries and included a wide range of health professions educators. Five key themes about the impact of the SAFRI programme were identified: (1) belonging to a community of practice, (2) personal development, (3) professional development, (4) capacity development, and (5) tools/strategies for project management and/or advancement. Conclusion: The SAFRI programme has a positive developmental impact on both participants and their respective institutions. [ABSTRACT FROM AUTHOR]

Background: This is a practice guide for the evaluation tool specifically created to objectively evaluate longitudinal faculty development programs (FDP) using the "5×2 -D backward planning faculty development model". It was necessary to create this tool as existing evaluation methods are designed to evaluate linear faculty development models with a specific endpoint. This backward planning approach is a cyclical model without an endpoint, consisting of 5 dynamic steps that are flexible and interchangeable, therefore can be a base for an evaluation tool that is objective and takes into account all the domains of the FDP in contrast to the existing, traditional, linear evaluation tools which focus on individual aspects of the program. The developed tool will target evaluation of longitudinal faculty development programs regardless of how they were planned. Methodology: Deductive qualitative grounded theory approach was used. Evaluation questions were generated and tailored based on the 5 × 2-D model followed by 2 Delphi rounds to finalize them. Based on the finalized evaluation questions from the results of the Delphi rounds, two online focus group discussions (FGDs) were conducted to deduce the indicators, data sources and data collection method. Results: Based on the suggested additions, the authors added 1 new question to domains B, with a total of 42 modifications, such as wording changes or discarding or merging questions. Some domains received no comments, therefore, were not included in round 2. For each evaluation question, authors generated indicators, data sources and data collection methods during the FGD. Conclusion: The methodology used to develop this tool takes into account expert opinions. Comprehensiveness of this tool makes it an ideal evaluation tool during self-evaluation or external quality assurance for longitudinal FDP. After its validation and testing, this practice guide can be used worldwide, along with the provided indicators which can be quantified and used to suit the local context. [ABSTRACT FROM AUTHOR]

Abstract Introduction The last two decades have seen a shift in former Soviet countries from highly specialized to more family medicine-focused systems. Medical education has slowly adjusted to these reforms, although the region is still at risk to have a chronic shortage of family doctors. This paper presents the evaluation of a new post-graduate family medicine program in Tajikistan, focused on competency-based training. The findings are relevant for policy makers, international organizations and practitioners participating in similar medical education reform programs. Methods We employed a quasi-experimental control group design and compared intervention residents, control group residents with traditional training, and 1st year residents with no training in two outcomes, clinical knowledge and competencies. We employed two objective measures, a written multiple-choice question test (MCQT) and an Objective Structured Clinical Examination (OSCE), respectively. We report reliability and validity of the measures along with ANOVA, planned contrasts and effect size estimates to examine differences across groups. Results We found statistically significant differences in both clinical knowledge and competencies between intervention and control groups. We also detected a large intervention effect size. Participants in the intervention outperformed control group participants in the two measures. Our analysis suggests that intervention and control group participants are comparable in terms of initial knowledge and competencies, strengthening the argument that the intervention caused the improvement in the program outcomes. Discussion Receiving tailored training and structured opportunities to practice knowledge and competencies in clinical settings have a positive effect on the education of family medicine doctors in Tajikistan. Our results support curriculum reform and investment in medical education in the form of longer and supervised on-the-job preparation designed to be more in line with international standards. We discuss suggestions for future studies and potential requirements to inform replicability in other countries. Conclusion Family medicine is well recognized as central to health systems throughout the world, but high quality residency training lags behind in some countries. Our study showed that investing in family medicine residency programs and structured training is effective in increasing critical clinical competencies. We encourage promoting comprehensive post graduate family medicine doctor training so that the goals of a family medicine centered health system are attainable.