Search

Objectives: To investigate the interobserver agreement among midwives for the interpretation of intrapartum CTG traces, using both the 2015 FIGO guidelines and the physiology-based guidelines. Material and methods: Retrospective, single-center, observational study conducted at the Maternity Hospital of the University of Parma, Italy, between November 2022 and July 2023. We selected 100 nonconsecutive intrapartum CTG traces from women undergoing operative delivery (cesarean or instrumental vaginal delivery). Participating midwives received the last 60 min of CTG recording prior to the decision for an operative delivery was made. Five midwives with different professional experience classified the CTG tracing according to the 2015 FIGO guidelines and the physiology-based guidelines at the time of the decision for the operative delivery. Each midwife was categorized as senior or junior if her clinical experience was equal or more or less than 5 years. All participating midwives were blinded to the demographic and clinical variables of each case, as well as to the labor and neonatal outcome. The main outcome of the study was the interobserver agreement among the 5 midwives with either guideline. The secondary outcome was the interobserver agreement based on clinical experience. The agreement between the observers was estimated through the Krippendorff's alpha statistics. Results: The interobserver agreement for the interpretation of intrapartum CTG traces according to the 2015 FIGO guideline was in the upper limit of the "unacceptable" classification, with a Krippendorff's alpha of 0.632 (95% CI, 0.545–0.723). The interobserver agreement of the physiology-based CTG guideline was classified as "unacceptable" with a Krippendorff's alpha of 0.359 (95% CI, 0.125–0.582). The interobserver agreement among senior midwives according to the 2015 FIGO guidelines was considered as "tentative acceptable agreement" with a Krippendorff's alpha of 0.724 (95% CI, 0.636–0.805). Among junior midwives, the interobserver agreement according to the latter guideline was classified as "unacceptable" with a Krippendorff's alpha of 0.569 (95% CI, 0.359–0.751). Using the physiology-based guideline, the interobserver agreement of the senior midwives – Krippendorff's alpha 0.493 (95% CI, 0.320–0.623) – and "junior" midwives – Krippendorff's alpha 0.359 (95% CI, 0.100–0.581) – were considered both "unacceptable". Conclusions: Our study showed that intrapartum CTG interpretation is characterized by an overall unacceptable level of interobserver agreement among midwives, with the 2015 FIGO guidelines showing better agreement compared to physiology-based guidelines. The interpretation of intrapartum CTG by "senior" midwives using the 2015 FIGO guidelines showed the highest, interobserver agreement, indicating a "tentative acceptable agreement". [ABSTRACT FROM AUTHOR]

Objective Despite its routine use in intrapartum care, the technique of fetal cardiotocography has some limitations. The aim of this study is to analyze the predictive capacity and interobserver agreement in the latest versions of four international cardiotocography guidelines: Federation of Gynecology and Obstetrics (FIGO), American College of Obstetrics and Gynecology (ACOG), the National Institute for Health and Care Excellence (NICE) and Chandraharan, used to predict neonatal acidemia. Study design The last 30 min of 150 cardiotocographic records were analyzed over all the pH ranges and were blindly evaluated by three independent reviewers. The sensitivity, specificity, positive predictive value, negative predictive value, and area under the receiver operating characteristic curve (AUC) were calculated to assess the predictive capacity of each fetal cardiotocographic guideline. The degree of interobserver agreement was evaluated with the Fleiss Kappa coefficient. Results Observers found fetal cardiotocography guidelines to have a variable sensitivity and specificity. The Chandraharan classification reached the highest sensitivity (78.79%), while ACOG had the highest specificity (95.73%). On average for the three observers, Chandraharan had the highest discrimination capacity for neonatal acidemia, although this was only moderate (AUC 0.66; 95%CI, 0.55–0.77) and did not differ significantly from the remaining guidelines. The degree of agreement among the three observers, assessed according to the Fleiss Kappa coefficient, was generally acceptable or moderate for all items and classifications, being highest with the FIGO classification (ĸ = 0.35; 95%CI, 0.28–0.41) and lowest with the ACOG (ĸ = 0.23; 95%CI, 0.16–0.30). Conclusion Although all the guidelines have a moderate capacity to predict neonatal acidemia, the Chandraharan guideline has the highest capacity. This follows a different approach from the others in that it relies on interpretations of cardiotocographic traces based on fetal physiology. The degree of interobserver agreement is, in general, acceptable for the four guidelines, and is the highest for FIGO. [ABSTRACT FROM AUTHOR]

Introduction: To examine interobserver agreement in intrapartum cardiotocography (CTG) classification in women undergoing trial of labor after a cesarean section (TOLAC) at term with or without complete uterine rupture. Materials and methods: Nineteen blinded and independent Danish obstetricians assessed CTG tracings from 47 women (174 individual pages) with a complete uterine rupture during TOLAC and 37 women (133 individual pages) with no uterine rupture during TOLAC. Individual pages with CTG tracings lasting at least 20 min were evaluated by three different assessors and counted as an individual case. The tracings were analyzed according to the modified version of the Federation of Gynaecology and Obstetrics (FIGO) guidelines elaborated for the use of STAN (ST-analysis). Occurrence of defined abnormalities was recorded and the tracings were classified as normal, suspicious, pathological, or preterminal. The interobserver agreement was evaluated using Fleiss' kappa. Results: Agreement on classification of a preterminal CTG was almost perfect. The interobserver agreement on normal, suspicious or pathological CTG was moderate to substantial. Regarding the presence of severe variable decelerations, the agreement was moderate. No statistical difference was found in the interobserver agreement between classification of tracings from women undergoing TOLAC with and without complete uterine rupture. Conclusions: The interobserver agreement on classification of CTG tracings from high-risk deliveries during TOLAC is best for assessment of a preterminal CTG and the poorest for the identification of severe variable decelerations. [ABSTRACT FROM AUTHOR]

Objective: Despite the growing trend to embrace pre-biopsy MRI in the diagnostic pathway for prostate cancer (PC), its performance and inter-observer variability outside high-volume centres remains unknown. This study aims to evaluate sensitivity of and variability between readers of prostate MRI outside specialized units with radical prostatectomy (RP) specimen as the reference standard. Materials and methods: Retrospective study comprising a consecutive cohort of all 97 men who underwent MRI and subsequent RP between January 2012 and December 2014 at a private hospital in Sweden. Three readers, blinded to clinical data, reviewed all images (including 11 extra prostate MRI to reduce bias). A tumour was considered detected if the overall PI-RADS v2 score was 3–5 and there was an approximate match (same or neighbouring sector) of tumour sector according to a 24 sector system used for both MRI and whole mount sections. Results: Detection rate for the index tumour ranged from 67 to 76%, if PI-RADS 3–5 lesions were considered positive and 54–66% if only PI-RADS score 4–5 tumours were included. Detection rate for aggressive tumours (GS ≥ 4 + 3) was higher; 83.1% for PI-RADS 3–5 and 79.2% for PI-RADS 4–5. The agreement between readers showed average κ values of 0.41 for PI-RADS score 3–5 and 0.51 for PI-RADS score 4–5. Conclusions: Prostate MRI evidenced a moderate detection rate for clinically significant PC with a rather large variability between readers. Clinics outside specialized units must have knowledge of their performance of prostate MRI before considering omitting biopsies in men with negative MRI. [ABSTRACT FROM AUTHOR]

This study was conducted to determine the incidence of inter-observer variability in Eastern Cooperative Oncology Group (ECOG) performance status (PS) rating between patients with leukemia and lymphoma and their physicians. ECOG PS was assessed at diagnosis by patients and their physicians and stratified by disease subtype, gender, age, disease stage and education. Association between patient- and physician-rated PS and overall survival (OS) was stratified by subtype and prognostic risk score. Overall, 65% of patients and physicians rated PS the same. Age, disease stage and disease subtype were significant predictors of PS disagreement. PS was a significant predictor of OS irrespective of assessment by patients or physicians across all subtypes except those with Hodgkin lymphoma. These findings suggest the need for physicians to better communicate with patients when determining PS, as PS is a strong predictor of survival and is critical in treatment decisions, including determining fitness for cancer treatment. [ABSTRACT FROM AUTHOR]

One of the indicators for evaluating the capability of a process is the process capability index. In this article, bootstrap confidence intervals of the generalized process capability index (GPCI) proposed by Maiti et al. are studied through simulation, when the underlying distributions are Lindley and Power Lindley distributions. The maximum likelihood method is used to estimate the parameters of the models. Three bootstrap confidence intervals namely, standard bootstrap (SB), percentile bootstrap (PB), and bias-corrected percentile bootstrap (BCPB) are considered for obtaining confidence intervals of GPCI. A Monte Carlo simulation has been used to investigate the estimated coverage probabilities and average width of the bootstrap confidence intervals. Simulation results show that the estimated coverage probabilities of the percentile bootstrap confidence interval and the bias-corrected percentile bootstrap confidence interval get closer to the nominal confidence level than those of the standard bootstrap confidence interval. Finally, three real datasets are analyzed for illustrative purposes. [ABSTRACT FROM AUTHOR]

When studying the agreement between two observers rating the same n units into the same k discrete ordinal categories, Bangdiwala (1985) proposed using the “agreement chart” to visually assess agreement. This article proposes that often it is more interesting to focus on the patterns of disagreement and visually understanding the departures from perfect agreement. The article reviews the use of graphical techniques for descriptively assessing agreement and disagreements, and also reviews some of the available summary statistics that quantify such relationships. [ABSTRACT FROM AUTHOR]

It is shown that a symmetric kappa corresponding to ac×ctable withc⩾ 3 categories can be written as a function of the unweighted kappa corresponding to the same table and thec(c− 1)/2 distinct unweighted kappas associated with the (c− 1) × (c− 1) tables that are obtained by combining two categories. The result is a new MGB-type result. [ABSTRACT FROM AUTHOR]

Objectives. During endoscopic surveillance in patients with longstanding colitis, a variety of lesions can be encountered. Differentiation between dysplastic and non-dysplastic lesions can be challenging. The accuracy of visual endoscopic differentiation and interobserver agreement (IOA) has never been objectified. Material and methods. We assessed the accuracy of expert and nonexpert endoscopists in differentiating (low-grade) dysplastic from non-dysplastic lesions and the IOA among and between them. An online questionnaire was constructed containing 30 cases including a short medical history and an endoscopic image of a lesion found during surveillance employing chromoendoscopy. Results. A total of 17 endoscopists, 8 experts, and 9 nonexperts assessed all 30 cases. The overall sensitivity and specificity for correctly identifying dysplasia were 73.8% (95% confidence interval (CI) 62.1-85.4) and 53.8% (95% CI 42.6-64.7), respectively. Experts showed a sensitivity of 76.0% (95% CI 63.3-88.6) versus 71.8% (95% CI 58.5-85.1, p = 0.434) for nonexperts, the specificity 61.0% (95% CI 49.3-72.7) versus 47.1% (95% CI 34.6-59.5, p = 0.008). The overall IOA in differentiating between dysplastic and non-dysplastic lesions was fair 0.24 (95% CI 0.21-0.27); for experts 0.28 (95% CI 0.21-0.35) and for nonexperts 0.22 (95% CI 0.17-0.28). The overall IOA for differentiating between subtypes was fair 0.21 (95% CI 0.20-0.22); for experts 0.19 (95% CI 0.16-0.22) and nonexpert 0.23 (95% CI 0.20-0.26). Conclusion. In this image-based study, both expert and nonexpert endoscopists cannot reliably differentiate between dysplastic and non-dysplastic lesions. This emphasizes that all lesions encountered during colitis surveillance with a slight suspicion of containing dysplasia should be removed and sent for pathological assessment. [ABSTRACT FROM AUTHOR]

We proposed two simple moment-based procedures, one with (GCCC1) and one without (GCCC2) normality assumptions, to generalize the inference of concordance correlation coefficient for the evaluation of agreement among multiple observers for measurements on a continuous scale. A modified Fisher's Z-transformation was adapted to further improve the inference. We compared the proposed methods with U-statistic-based inference approach. Simulation analysis showed desirable statistical properties of the simplified approach GCCC1, in terms of coverage probabilities and coverage balance, especially for small samples. GCCC2, which is distribution-free, behaved comparably with the U-statistic-based procedure, but had a more intuitive and explicit variance estimator. The utility of these approaches were illustrated using two clinical data examples. [ABSTRACT FROM AUTHOR]

Purpose: To test interobserver agreement in the fluorescein/indocyanine green angiography (FA/ICGA) scoring system for uveitis. Methods: Four observers scored 32 dual FA/ICGAs. Spearman rank correlation was used to analyze correlation between pairs of observers in scores assigned to angiographic signs. Kappa statistics were used to test agreement between pairs of observers in comparative total FA and ICGA scores. Results: The authors found a significant correlation between pairs of observers in scores assigned to all FA signs and all except one ICGA sign. The only discordant sign was early stromal vessel hyperfluoresence on ICGA. There was a moderate to substantial agreement between pairs of observers in comparative FA/ICGA total scores. Conclusions: The level of agreement between uveitis specialists in scoring of dual FA/ICGA indicates that the scoring system tested in this study will be useful for clinical studies of uveitis. Increased experience with this system may further improve its reproducibility. [ABSTRACT FROM AUTHOR]

Complex Regional Pain Syndrome type 1 (CRPS I) is a controversial clinical diagnosis. It is unknown which differential diagnoses are important in chronic pain patients suspected of having CRPS I. In this study 25 patients with possible CRPS I were interviewed and examined by 6 CRPS-experts. On average, one out of four CRPS-experts disagreed with the diagnosis when CRPS I was diagnosed by a colleague. CRPS I could not be diagnosed with much certainty. Idiopathic and somatoform pain syndromes are important differential diagnoses in CRPS I. [ABSTRACT FROM AUTHOR]