Search

Medical Education 2012: 46: 777-784 Objectives Written tests are an integral part of selection into general practice specialty training in the UK. Evidence supporting their validity and reliability as shortlisting tools has prompted their introduction into the selection processes of other medical specialties. This study explores whether candidate performance on two written tests predicts performance on subsequent workplace-based simulation exercises. Methods A prospective analysis of candidate performance ( n = 135) during the general practice selection process was undertaken. Candidates were shortlisted using their scores on two written tests, a clinical problem-solving test (CPST) and a situational judgement test (SJT). Successful candidates then undertook workplace-based simulation exercises at a selection centre (SC). Scores on the CPST and SJT were correlated with SC scores. Regression analysis was undertaken to explore the predictive validity of the CPST and SJT for SC performance. Results The data show that the CPST and SJT are predictive of performance in workplace-based simulations ( r = 0.598 for the CPST, r = 0.717 for the SJT). The SJT is a better predictor of SC performance than the CPST ( R2 = 0.51 versus R2 = 0.35). However, the two tests together provide the greatest degree of predictive ability, accounting for 57% of the variance seen in mean scores across SC exercises. Conclusions The CPST and SJT play valuable roles in shortlisting and are predictive of performance in workplace-based SC exercises. This study provides evidence for their continued use in selection for general practice training and their expansion to other medical specialties. [ABSTRACT FROM AUTHOR]

Background Selection into general practice training is undertaken using a competency based approach. The clear advantage of this approach over traditional methods has been demonstrated through evaluation of its validity and reliability. However, the relationship between selection and performance in the Royal College of General Practitioner examinations (MRCGP) has yet to be explored. The MRCGP comprises of an applied knowledge test (AKT), a clinical skills assessment (CSA) and workplace-based assessments (WPBA). Aim To explore the predictive validity of general practice selection scores using the AKT and CSA elements of the MRCGP as a final outcome measure. Methods This study carried out a retrospective analysis of 101 trainees from the Wales Deanery who were successfully selected on to general practice training in 2007. Selection data consisted of an overall selection score as well as scores from each individual stage of selection. Correlation was used to explore associations between selection scores and examination scores. Results The score for overall performance at selection achieved statistically significant correlation with examination performance (r=0.491 for the AKT and r=0.526 for the CSA, P<0.01). Conclusions The general practice selection process is predictive of future performance in the MRCGP. INSET: The selection process for Wales 2007 general practice training.... [ABSTRACT FROM AUTHOR]