Search

INTRODUCTION: Generative artificial intelligence (AI) has proven to be a powerful tool with increasing applications in clinical care and medical education. ChatGPT has performed adequately on many specialty certification and knowledge assessment exams. The objective of this study was to assess the performance of ChatGPT 4 on a multiple-choice exam meant to simulate the Canadian urology board exam. METHODS: Graduating urology residents representing all Canadian training programs gather yearly for a mock exam that simulates their upcoming board-certifying exam. The exam consists of written multiple-choice questions (MCQs) and an oral objective structured clinical examination (OSCE). The 2022 exam was taken by 29 graduating residents and was administered to ChatGPT 4. RESULTS: ChatGPT 4 scored 46% on the MCQ exam, whereas the mean and median scores of graduating urology residents were 62.6%, and 62.7%, respectively. This would place ChatGPT's score 1.8 standard deviations from the median. The percentile rank of ChatGPT would be in the sixth percentile. ChatGPT scores on different topics of the exam were as follows: oncology 35%, andrology/benign prostatic hyperplasia 62%, physiology/anatomy 67%, incontinence/female urology 23%, infections 71%, urolithiasis 57%, and trauma/reconstruction 17%, with ChatGPT 4's oncology performance being significantly below that of postgraduate year 5 residents. CONCLUSIONS: ChatGPT 4 underperforms on an MCQ exam meant to simulate the Canadian board exam. Ongoing assessments of the capability of generative AI is needed as these models evolve and are trained on additional urology content. [ABSTRACT FROM AUTHOR]

INTRODUCTION: The Objective Structured Clinical Examination (OSCE) is an attractive tool of competency assessment in a high-stakes summative exam. An advantage of the OSCE is the ability to assess more realistic context, content, and procedures. Each year, the Queen's Urology Exam Skills Training (QUEST) is attended by graduating Canadian urology residents to simulate their upcoming board exams. The exam consists of a written component and an OSCE. The aim of this study was to determine the inter-observer consistency of scoring between two examiners of an OSCE for a given candidate. METHODS: Thirty-nine participants in 2020 and 37 participants in 2021 completed four stations of OSCEs virtually over the Zoom platform. Each candidate was examined and scored independently by two different faculty urologists in a blinded fashion at each station. The OSCE scoring consisted of a checklist rating scale for each question. An intra-class correlation (ICC) analysis was conducted to determine the inter-rater reliability of the two examiners for each of the four OSCE stations in both the 2020 and 2021 OSCEs. RESULTS: For the 2020 data, the prostate cancer station scores were most strongly correlated (ICC 0.746, 95% confidence interval [CI] 0.556-0.862, p<0.001). This was followed by the general urology station (ICC 0.688, 95% CI 0.464-0.829, p<0.001), the urinary incontinence station (ICC 0.638, 95% CI 0.403-0.794, p<0.001), and finally the nephrolithiasis station (ICC 0.472, 95% CI 0.183-0.686, p<0.001). For the 2021 data, the renal cancer station had the highest ICC at 0.866 (95% CI 0.754-0.930, p<0.001). This was followed by the nephrolithiasis station (ICC 0.817, 95% CI 0.673-0.901, p<0.001), the pediatric station (ICC 0.809, 95% CI 0.660-0.897, p<0.001), and finally the andrology station (ICC 0.804, 95% CI 0.649-0.895, p<0.001). A Pearson correlation coefficient was calculated for all stations, and all show a positive correlation with global exam scores. It is noteworthy that some stations were more predictive of overall performance, but this did not necessarily mean better ICC scores for these stations. CONCLUSIONS: Given a specific clinical scenario in an OSCE exam, inter-rater reliability of scoring can be compromised on occasion. Care should be taken when high-stakes decisions about promotion are made based on OSCEs with limited standardization. [ABSTRACT FROM AUTHOR]

Introduction: The natural history of small renal masses has been well-defined, leading to the recommendation of active surveillance in some patients with limited life expectancy. However, this information is less clear for large renal masses (LRM), leading to ambiguity for management in the older, comorbid patient. The objective of this study was to define the natural history, including the growth rate and metastatic risk, of LRM in order to better counsel patients regarding active surveillance. Methods: This was a retrospective review of patients with solid renal masses >4 cm that had repeated imaging identified from an institutional imaging database. Patient comorbidities and outcomes were obtained through retrospective chart analysis. Outcomes assessed included tumor growth and metastatic rates, as well as cancer-specific (CSS) and overall survival (OS) using Kaplan-Meier methodology. Results: We identified 69 patients between 2005 and 2016 who met the inclusion criteria. Mean age at study entry was 75.5 years; mean tumor maximal dimension at study entry was 5.6 cm. CSS was 83% and OS 63% for patients presenting without metastasis, with a mean followup of 57.5 months. The mean growth rate of those that developed metastasis during followup (n=15) was 0.98 cm/year (95% confidence interval [Cl] 0.33-1.63) as compared to those that did not develop metastasis (n=46), with a growth rate of 0.67 cm/year (95% Cl 0.34-1) (non-significant). Seven patients had evidence of metastasis at the baseline imaging of their LRM and had subsequent growth rate of 1.47 cm/year (95% Cl 0.37-2.57) (non-significant). Conclusions: Compared to small renal masses, LRM are associated with higher metastasis rates and lower CSS and more rapid growth rates. Selection criteria for recommending observation of LRM in older, comorbid patients should be more conservative than for small renal masses. [ABSTRACT FROM AUTHOR]

Introduction: Many factors impact the performance of graduating residents on certification exams. It is thought that most factors are related to the individual candidate's ability, motivation, and work ethic. Less understood, however, is whether a training program has any impact on the preparation and performance of its graduates on certification exams. We present 20 years of results of a national preparatory exam that all graduating residents complete about three months before the Royal College of Physicians and Surgeons of Canada (RCPSC) qualifying urology exam. This exam, known colloquially as QUEST, aims to simulate the RCPSC exam with written and oral components. We aimed to analyze the impact of a training program on the performance of its residents. Methods: A retrospective review of exam results from 1997-2016 was conducted. During that time, 495 candidates from all 12 Canadian urology training programs undertook the exam. The performance of graduating residents from each individual program was grouped together for any given year. The different programs were anonymized, as the aim of this study is to assess the impact of a training program and not to rate the different programs. Statistical analysis using one-way ANOVA was conducted. Results: All training programs fall within one standard deviation of the mean for the written component, the oral component, and the overall score. The residents of four training programs had statistically better scores than the overall mean of the written component. The residents of three out of these four training programs also had statistically better scores than the overall mean of the oral component and the overall results of the exam. Conclusions: Most Canadian training programs prepare their residents adequately for this simulated certification exam in urology. However, there are some training programs that consistently prepare graduating residents to outperform their peers. [ABSTRACT FROM AUTHOR]

Introduction: Ambulatory percutaneous nephrolithotomy (PCNL) has been limited to highly selected patients. The objective of our study was to compare complication and stone-free rates after ambulatory PCNL in standard selection criteria vs. extended criteria patients. Methods: We conducted a retrospective review of prospective data on all patients who underwent ambulatory PCNL at one academic center from 2007-2018. Extended criteria patients were defined as one or more of: age >75 years, body mass index (BMI) >30 kg/m2, American Society of Anesthesiologists (ASA) score >2, bilateral stones, solitary kidney, transplant kidney, complete staghorn calculi, stone burden >40 mm, multiple tracts, or prior nephrostomy tubes/stents. Primary outcomes were complication rates (Clavien-Dindo classification) and stone-free rates. Results: We identified 118 patients, of which 92 (78%) met extended criteria. Mean BMI was 31 kg/m2 and 45% were ASA 3 or higher. Mean sum maximum stone diameter was 24 mm. Multiple stones were present in 25%, bilateral stones in 7%, and complete staghorn stones in 4% of patients. There was no difference in complication (12% vs. 18%, p=0.56), emergency department visit (12% vs. 18%, p=0.56), or re-admission (4% vs. 5%, p=1) rates between standard and extended criteria patients, respectively. Of the complications, 85% were Clavien-Dindo grade 1. Stone-free rates were not different between standard (84%) and extended (83%) criteria patients (p=1). No extended criteria variables were associated with complications in multivariable analysis. Conclusions: Complication and stone-free rates were not different between standard and extended selection criteria patients undergoing ambulatory PCNL. This data indicates that many of the preoperative patient and stone factors that have previously been used as exclusion criteria for ambulatory PCNL are not strictly necessary complication and stone-free rates in standard selection criteria vs. extended criteria patients from our cohort. [ABSTRACT FROM AUTHOR]

Introduction: The importance of developing inter-professional communication and leadership skills among residents is well-recognized; however, formal tools to assess these skills are lacking. The goal of our study was to assess the leader and communicator roles in graduating urology residents using a validated self-assessment form developed for business students that focuses on inter-professional skills., Methods: Chief residents (n=36) were evaluated with surveys of communication and leadership skills. The same surveys were administered through email to the residents' program directors (PDs). Resident self-assessment and PD assessment were compared using paired and non-paired t-tests., Results: Graduating urology residents' self-assessment of their communication and leadership skills did not differ from assessments made by their PDs (77.6 vs. 74.4%; p=0.19); however, there were outlier candidates in whom PD assessment differed substantially from self-assessment on both surveys. Graduating urology residents scored themselves higher on self-awareness (82.6 vs. 77%; p= 0.05) and lower on stress management (67.7 vs. 77%; p= 0.01) compared to their PDs. Resident self-assessment scores were similar to business students on both communication and leadership surveys. Limitations were the small sample size and lack of survey evaluation by those surveyed., Conclusions: Graduating urology residents' self-assessment of their own communication and leadership skills did not differ greatly from assessment by their PDs or a sample of business students. Comparison of self-assessment evaluations and evaluations by PDs allowed us to identify outliers in whom self-assessment and PD-assessment markedly differed, which may allow for more focused and meaningful feedback.

Introduction: There has been increasing awareness of employment difficulties for physicians, especially surgeons, in Canada over the past few years. Our objective was to elucidate the attitudes and experiences of graduating Canadian urology residents in obtaining employment., Methods: We surveyed four separate cohorts of graduating urology residents in 2010, 2011, 2016, and 2017. Responses from the 2010 and 2011 cohorts were combined and compared to the combined results of the 2016 and 2017 cohorts. Mean Likert responses were compared using unpaired t-tests. An agreement score was created for those responding with "strongly agree" and "agree" on the Likert scale., Results: A total of 126 surveys were administered with a 100% response rate. The job market was rated as poor or very poor by 64.9% and 58.4% of graduates in 2010/2011 and 2016/2017, respectively (p=0.67). Lack of resources was identified as the biggest barrier to improved employment in both cohorts. Networking at meetings and staff urologists at their institution were the most important factors aiding employment identified by both cohorts. The ideal practice was academic or academically associated community practices in a large urban area, with 5-10 partners for both cohorts., Conclusions: The majority of graduating urology residents viewed the job market as poor or very poor and this did not change over a six-year period. It is unclear how much personal preference for location and practice type drove the somewhat negative outlook of employment opportunities, as the majority of residents were seeking large urban, academic, or academically associated community practices in competitive locations.

Introduction: : Laparoscopic partial nephrectomy (LPN) remains one of the more challenging procedures in urology. Minimizing warm ischemia time (WIT) and bleeding requires efficient intracorporeal suturing. In addition, achieving negative surgical margins requires complete excision of the tumour. We report a large Canadian series of laparoscopic partial nephrectomy with intermediate follow-up., Methods: : Between September 2000 and August 2008, 152 consecutive laparoscopic partial nephrectomies were performed at our centre. Demographic, pathological and clinical data were collected through a retrospective review of the charts., Results: : The average tumour size was 2.68 cm (Range: 0.5-8.8. The vast majority of tumours were malignant (80%). All margins were negative, except for 2 patients who underwent an immediate re-resection. There were no local recurrences or distant metastasis during the follow-up period of 44.3 months. Most procedures required hilar clamping (93.4%) with a mean WIT of 34 minutes, with a clear trend for declining WIT with increasing experience. Five procedures were converted to laparoscopic radical nephrectomy, 10 converted to a hand-assisted procedure, and 1 was converted to an open partial nephrectomy. The average blood loss was 162 cc. Complications related to the procedure were classified according to the Clavien grading system. The average drop in the glomerular filtration rate was calculated by the Modification of Diet in Renal Disease (MDRD) Study equation between preoperative and 2.5 months postoperative was 8.6 mL/min/1.73 m(2)., Conclusions: : LPN is a challenging procedure that requires advanced laparoscopic skills. LPN is feasible with excellent oncological outcomes, and an acceptable complication profile. The short-term impact on overall renal function is minimal. The most common postoperative complication was pseudo-aneurysm requiring embolization, which reinforces the intra-operative need for meticulous and a quick suture-ligation of blood vessels during LPN.

Objective: We assessed the pattern of local recurrence after salvage cryoablation of the prostate, and the impact of local recurrence on intermediate-term outcome., Methods: One hundred twenty-two patients who underwent salvage cryoablation were studied after a mean follow-up of 56 months. Serial prostate biopsy was carried out after cryoablation. The histopathology of prostate biopsies before and after cryoablation were compared. The prognostic value of post-cryoablation biopsy was assessed with the Cox regression method., Results: 23.1% of patients had a positive biopsy for prostate cancer following salvage cryoablation. Most cancer recurrences occurred in the apex (51.5%), base (21.2%) and seminal vesicles (18.2%). The presence of cancer at the base of the prostate was found to be a prognostic factor for eventual biochemical failure. Overall 5-year biochemical disease-free survival (bDFS) was 28%, however patients with cancer at the base of the prostate had a 5-year bDFS of 0%., Conclusion: Cancer recurrences occurred in areas where aggressive freezing was avoided as it might result in serious problems (e.g., urethro-rectal fistula and incontinence). Post-cryoablation biopsies and the location of persistent disease are of prognostic value.

Background: Small renal masses are increasingly being discovered incidentally on imaging performed for another reason. The standard of care for these masses involves excision by open or laparoscopic techniques. Recently, ablative techniques such as radiofrequency ablation (RFA) and cryoablation have taken a more prominent role in the treatment algorithm for these masses. We sought to evaluate the efficacy and safety of radiofrequency ablation in the treatment of renal tumours., Methods: We conducted a review of the literature. There was no language restriction. We obtained studies from the following sources: the Cochrane Library, PubMed, EMBASE, LILACS and Current Controlled Trials., Results: We identified no clinical trials in the literature. Thus we described the results from case series and retrospective studies with a reasonable sample size (number of reported patients in each study > 65). Most patients undergoing RFA had T1a disease with a mean tumour size of about 3 cm. Radiofrequency ablation was usually performed percutaneously with image guidance. Reported follow-up was short and ranged from 1 to 30 months. Most series used radiographic response as a surrogate for cancer control. The rates of local recurrence of the tumour were as high as 13.0% (average 8.5%) and were slightly higher than those associated with cryoablation and partial nephrectomy. Complications included hemorrhage, ureteral strictures and loss of a renal unit., Conclusion: Our review demonstrates that RFA is a suitable and promising therapy in patients with small renal tumours who are considered to be poor candidates for more involved surgery. However, clinical trials with long-term data are needed to establish the oncological efficacy.