Search

Objectives: To investigate the interobserver agreement among midwives for the interpretation of intrapartum CTG traces, using both the 2015 FIGO guidelines and the physiology-based guidelines. Material and methods: Retrospective, single-center, observational study conducted at the Maternity Hospital of the University of Parma, Italy, between November 2022 and July 2023. We selected 100 nonconsecutive intrapartum CTG traces from women undergoing operative delivery (cesarean or instrumental vaginal delivery). Participating midwives received the last 60 min of CTG recording prior to the decision for an operative delivery was made. Five midwives with different professional experience classified the CTG tracing according to the 2015 FIGO guidelines and the physiology-based guidelines at the time of the decision for the operative delivery. Each midwife was categorized as senior or junior if her clinical experience was equal or more or less than 5 years. All participating midwives were blinded to the demographic and clinical variables of each case, as well as to the labor and neonatal outcome. The main outcome of the study was the interobserver agreement among the 5 midwives with either guideline. The secondary outcome was the interobserver agreement based on clinical experience. The agreement between the observers was estimated through the Krippendorff's alpha statistics. Results: The interobserver agreement for the interpretation of intrapartum CTG traces according to the 2015 FIGO guideline was in the upper limit of the "unacceptable" classification, with a Krippendorff's alpha of 0.632 (95% CI, 0.545–0.723). The interobserver agreement of the physiology-based CTG guideline was classified as "unacceptable" with a Krippendorff's alpha of 0.359 (95% CI, 0.125–0.582). The interobserver agreement among senior midwives according to the 2015 FIGO guidelines was considered as "tentative acceptable agreement" with a Krippendorff's alpha of 0.724 (95% CI, 0.636–0.805). Among junior midwives, the interobserver agreement according to the latter guideline was classified as "unacceptable" with a Krippendorff's alpha of 0.569 (95% CI, 0.359–0.751). Using the physiology-based guideline, the interobserver agreement of the senior midwives – Krippendorff's alpha 0.493 (95% CI, 0.320–0.623) – and "junior" midwives – Krippendorff's alpha 0.359 (95% CI, 0.100–0.581) – were considered both "unacceptable". Conclusions: Our study showed that intrapartum CTG interpretation is characterized by an overall unacceptable level of interobserver agreement among midwives, with the 2015 FIGO guidelines showing better agreement compared to physiology-based guidelines. The interpretation of intrapartum CTG by "senior" midwives using the 2015 FIGO guidelines showed the highest, interobserver agreement, indicating a "tentative acceptable agreement". [ABSTRACT FROM AUTHOR]

Simple Summary: Tumor necrosis can be frequently found in malignant tumors and its prognostic value has been confirmed in multiple solid tumors in human and veterinary medicine. We evaluated the level of necrosis in 154 cases of feline mammary tumors (FMTs) using semi-quantitative and quantitative methods and found that tumor necrosis is particularly common in malignant tumors with clinicopathological characteristics associated with aggressive biological behavior. In addition, there was a positive correlation between the semi-quantitative and the quantitative methods, and the former had a high interobserver agreement. These results provide evidence of the importance of necrosis in FMTs and support the implementation of a semi-quantitative evaluation of necrosis in the FMT diagnostic routine. Necrosis is a common finding in human and animal neoplasms. The percentage of tumor necrosis is included in tumor grading schemes in veterinary oncology; however, evaluation methods are often overlooked. Different studies have assessed the prognostic value of tumor necrosis in feline mammary tumors with contradictory results, which could be related to methodologic variability. In this study, a comprehensive evaluation of tumor necrosis in feline mammary tumors (FMTs) was conducted, by applying a semi-quantitative and a quantitative methodology for assessing necrosis. The interobserver agreement, the relationship with clinicopathological characteristics and the prognostic value of necrosis were analyzed in 154 FMT cases. Although subjectivity in the assessment of necrosis existed, an almost perfect agreement (weighted quadratic k = 0.851) between two observers was obtained. Furthermore, there was a significant positive correlation between the semi-quantitative and quantitative methods. Necrosis was more common and more extensive in malignant tumors than in their benign counterparts. Despite the non-significant results in the survival analysis, extensive necrosis was significantly associated with aggressive clinicopathological features, such as higher histological grade, high mitotic count and lymphovascular invasion. Our results support the potential relevance of necrosis in FMT. [ABSTRACT FROM AUTHOR]

Background: The diagnostic accuracy of colon capsule endoscopy (CCE) depends on a well-cleansed bowel. Evaluating the cleansing quality can be difficult with a substantial interobserver variation. Objectives: Our primary aim was to establish a standard of agreement for bowel cleansing in CCE based on evaluations by expert readers. Then, we aimed to investigate the interobserver agreement on bowel cleansing. Design: We conducted an interobserver agreement study on bowel cleansing quality. Methods: Readers with different experience levels in CCE and colonoscopy evaluated bowel cleansing quality on the Leighton–Rex scale and Colon Capsule CLEansing Assessment and Report (CC-CLEAR), respectively. All evaluations were reported on an image level. A total of 24 readers rated 500 images on each scale. Results: An expert opinion-based agreement standard could be set for poor and excellent cleansing but not for the spectrum in between, as the experts agreed on only a limited number of images representing fair and good cleansing. The overall interobserver agreement on the Leighton–Rex full scale was good (intraclass correlation coefficient (ICC) 0.84, 95% CI (0.82–0.85)) and remained good when stratified by experience level. On the full CC-CLEAR scale, the overall agreement was moderate (ICC 0.62, 95% CI (0.59–0.65)) and remained so when stratified by experience level. Conclusion: The interobserver agreement was good for the Leighton–Rex scale and moderate for CC-CLEAR, irrespective of the reader's experience level. It was not possible to establish an expert-opinion standard of agreement for cleansing quality in CCE images. Dedicated training in using the scales may improve agreement and enable future algorithm calibration for artificial intelligence supported cleansing evaluation. Trial registration: All included images were derived from the CAREforCOLON 2015 trial (Registered with The Regional Health Research Ethics Committee (Registration number: S-20190100), the Danish data protection agency (Ref. 19/29858), and ClinicalTrials.gov (registration number: NCT04049357)). [ABSTRACT FROM AUTHOR]

Purpose: To evaluate the impact of video sequences (cine-loops) on the interobserver agreement (IOA) using risk stratification systems (RSSs) for thyroid nodules (TNs). Methods: Twenty TNs were randomly selected from a large database and evaluated by twelve experienced observers using five different RSSs (Kwak-, ACR-, EU-, Korean-TIRADS, ATA Guidelines). In the first step, the evaluation was conducted based on static ultrasound (US) images in two planes ("static"). Six months later, these cases were reevaluated by the same observers using video sequences in two planes ("cine-loops"). Fleiss' kappa (κ) was calculated for the IOA analyses. Results: IOA on static was moderate with κ values of 0.46, 0.42, 0.40, 0.45, and 0.38 for the Kwak-, ACR-, EU-, Korean-TIRADS, and ATA Guidelines, respectively, while the IOA on cine-loops was fair with κ values of 0.41, 0.38, 0.37, 0.36, and 0.34 for the Kwak-, ACR-, EU-, Korean-TIRADS, and ATA Guidelines, respectively. The overall IOA was superior in static images versus cine-loops (p = 0.024). Among other findings, the subgroup analyses (related to age, gender, US certificates, number of thyroid US per week, and RSSs experience) particularly showed that the experience of the observers in using RSSs had a significant influence on the IOA. Conclusions: The overall IOA (all twelve observers and all five RSSs) was superior on static US images in comparison to cine-loops. Furthermore, the overall IOA of the five US features revealed superior κ values of the static images over cine-loops. However, this impact was significantly lower when the observers were highly experienced in the use of US RSSs of TNs. [ABSTRACT FROM AUTHOR]

Line-field confocal optical coherence tomography (LC-OCT) is a new technology for skin cancer diagnostics. However, the interobserver agreement (IOA) of known image markers of keratinocyte carcinomas (KC), including basal cell carcinoma (BCC) and squamous cell carcinoma (SCC), as well as precursors, SCC in situ (CIS) and actinic keratosis (AK), remains unexplored. This study determined IOA on the presence or absence of 10 key LC-OCT image markers of KC and precursors, among evaluators new to LC-OCT with different levels of dermatologic imaging experience. Secondly, the frequency and association between reported image markers and lesion types, was determined. Six evaluators blinded to histopathologic diagnoses, assessed 75 LC-OCT images of KC (21 SCC; 21 BCC), CIS (12), and AK (21). For each image, evaluators independently reported the presence or absence of 10 predefined key image markers of KCs and precursors described in an LC-OCT literature review. Evaluators were stratified by experience-level as experienced (3) or novices (3) based on previous OCT and reflectance confocal microscopy usage. IOA was tested for all groups, using Conger’s kappa coefficient (κ). The frequency of reported image marker and their association with lesion-types, were calculated as proportions and odds ratios (OR), respectively. Overall IOA was highest for the image markers lobules (κ = 0.68, 95% confidence interval (CI) 0.57;0.78) and clefting (κ = 0.63, CI 0.52;0.74), typically seen in BCC (94%;OR 143.2 and 158.7, respectively, p < 0.001), followed by severe dysplasia (κ = 0.42, CI 0.31;0.53), observed primarily in CIS (79%;OR 7.1, p < 0.001). The remaining seven image-markers had lower IOA (κ = 0.06–0.32) and were more evenly observed across lesion types. The lowest IOA was noted for a well-defined (κ = 0.07, CI 0;0.15) and interrupted dermal-epidermal junction (DEJ) (κ = 0.06, CI -0.002;0.13). IOA was higher for all image markers among experienced evaluators versus novices. This study shows varying IOA for 10 key image markers of KC and precursors in LC-OCT images among evaluators new to the technology. IOA was highest for the assessments of lobules, clefting, and severe dysplasia while lowest for the assessment of the DEJ integrity. [ABSTRACT FROM AUTHOR]

Objectives Few cytologically indeterminate thyroid fine-needle aspirations (FNAs) harbor BRAF V600E. Here, we assess interobserver agreement for The Bethesda System for Reporting Thyroid Cytopathology (TBSRTC) category III (atypia of undetermined significance [AUS]) FNAs harboring BRAF V600E and contrast their features with those harboring non- BRAF V600E alterations, with attention to cytopathology experience. Methods Seven reviewers evaluated 5 AUS thyroid FNAs harboring BRAF V600E. To blind reviewers, cases were intermixed with 19 FNAs falling within other TBSRTC categories and in which genetic alterations other than BRAF V600E had been identified (24 FNAs total). Interobserver agreement against both "index" and most popular ("mode") diagnoses was calculated. Four additional BRAF V600E cases were independently reviewed. Results Reviewers included 3 trainees and 3 American Board of Pathology (board)–certified cytopathologists. Board-certified cytopathologists, whose experience ranged from 2 to more than 15 subspecialty practice years, had known AUS rates. BRAF V600E was identified in 5 of 260 (2%) AUS FNAs. Interobserver agreement was higher among cytopathologists with more experience. Mode diagnosis differed from index diagnosis in 6 of 11 cases harboring RAS-like alterations; mode diagnosis was AUS in 4 of 5 BRAF V600E FNAs. Conclusions Atypia of undetermined significance of thyroid FNAs harboring BRAF V600E is uncommon yet relatively reproducible, particularly among pathologists with experience. It is advisable to sequence BRAF across V600 in such cases. [ABSTRACT FROM AUTHOR]

Objective: In the Netherlands, antenatal cardiotocography (aCTG) to assess fetal well‐being is performed in obstetrician‐led care. An innovative initiative was started to evaluate whether aCTG for specific indications—reduced fetal movements, external cephalic version, or postdate pregnancy—is feasible in non‐obstetrician‐led care settings by independent primary care midwives. Quality assessment is essential when reorganizing and shifting tasks and responsibilities. Therefore, we aimed to assess the inter‐ and intraobserver agreement for aCTG assessments between and within four professional groups involved in Dutch maternity care regarding the overall classification and assessment of the various components of aCTG. Method: This was a prospective study among 47 Dutch primary care midwives, hospital‐based midwives, residents, and obstetricians. Ten aCTG traces were assessed twice at a 1 month interval. To ensure a representative sample, we used two different sets of 10 aCTG traces each. We calculated the degree of agreement using the proportions of agreement. Results: The proportions of agreement for interobserver agreement on the classification of aCTG between and within the four professional groups varied from 0.82 to 0.94. The proportions of agreement for each professional group were slightly higher for intraobserver (0.86–0.94) than for interobserver agreement. For the various aCTG components, the proportions of agreement for interobserver agreement varied from 0.64 (presence of contractions) to 0.98 (baseline heart frequency). Conclusion: The proportion of agreement levels between and within the maternity care professionals in the classification of aCTG traces among healthy women were comparable. This means that these professional groups are equally well able to classify aCTGs in healthy pregnant women. Synopsis: The proportion of agreement levels between and within professionals in midwife‐led and obstetrician‐led care in the classification of antenatal cardiotocography traces among healthy women are comparable. [ABSTRACT FROM AUTHOR]

Congo red staining of fat pad fine needle aspiration specimens is a method utilized for evaluation of amyloid deposition. However, these specimens can pose diagnostic challenges for cytopathologists. As part of ongoing internal quality improvement measures, the objective of this study was to evaluate the intradepartmental interobserver agreement of these specimens and to identify factors that affect the variability of the interpretations. There were 7 participants, which included 3 trainees, 3 cytopathologists, and 1 cytotechnologist. Each participant reviewed 50 Congo red stained fat pad fine needle aspiration slides. The interpretations were categorized into 3 groups: negative, indeterminate/suspicious, and positive. The participants also noted any interpretation challenges they encountered for each case. There was only slight interobserver agreement among all participants (κ = 0.133). Stratified by participant group, the interobserver agreement among the trainees was slight bordering on poor (κ = 0.028) and among cytopathologists was fair (κ = 0.249). The highest agreement between 2 observers was between 2 cytopathologists and the level of agreement was moderate bordering on fair (κ = 0.426). There were only 3 cases (6.0%) with full agreement among observers, while in 25 cases (50.0%), there were 2 category differences in interpretations. The primary diagnostic challenge reported by participants was when weak or focal birefringence was encountered as well as cases complicated by poor stain quality and overstaining. We found only slight interobserver agreement among all study participants. A major area of challenge was cases with weak birefringence resulting in high variance of interpretation among participants. • Abdominal fat pad fine needle aspiration (FNA) biopsy is a commonly used method to evaluate amyloid deposition. However, there are possible causes for false positive/negative interpretations which could also cause interobserver variability. • The current study aims to evaluate the interobserver agreement rate of Congo red stain interpretation of fat pad FNA smears and to identify factors that affect the variability of the interpretations. • The results of the study showed only slight agreement among all participants. Although the level of agreement was higher among cytopathologists than trainees, it was still only fair at best. The factors interfering with the interpretation included weak or yellow-white birefringence by polarization and poor Congo red stain quality. [ABSTRACT FROM AUTHOR]

Purpose: Ultrasound evaluation of thyroid nodules is the preferred technique, but it is dependent on operator interpretation, leading to inter-observer variability. The current study aimed to determine the inter-physician consensus on nodular characteristics, risk categorization in the classification systems, and the need for fine needle aspiration puncture. Methods: Four endocrinologists from the same center blindly evaluated 100 ultrasound images of thyroid nodules from 100 different patients. The following ultrasound features were evaluated: composition, echogenicity, margins, calcifications, and microcalcifications. Nodules were also classified according to ATA, EU-TIRADS, K-TIRADS, and ACR-TIRADS classifications. Krippendorff's alpha test was used to assess interobserver agreement. Results: The interobserver agreement for ultrasound features was: Krippendorff's coefficient 0.80 (0.71–0.89) for composition, 0.59 (0.47–0.72) for echogenicity, 0.73 (0.57–0.88) for margins, 0.55 (0.40–0.69) for calcifications, and 0.50 (0.34–0.67) for microcalcifications. The concordance for the classification systems was 0.7 (0.61–0.80) for ATA, 0.63 (0.54–0.73) for EU-TIRADS, 0.64 (0.55–0.73) for K-TIRADS, and 0.68 (0.60–0.77) for K-TIRADS. The concordance in the indication of fine needle aspiration puncture (FNA) was 0.86 (0.71–1), 0.80 (0.71–0.88), 0.77 0.67–0.87), and 0.73 (0.64–0.83) for systems previously described respectively. Conclusions: Interobserver agreement was acceptable for the identification of nodules requiring cytologic study using various classification systems. However, limited concordance was observed in risk stratification and many ultrasonographic characteristics of the nodules. [ABSTRACT FROM AUTHOR]

Background: Anal cytology represents a tool for anal cancer screening in high‐risk populations. In addition to accuracy, the reproducibility of the interpretation is of key importance. The authors evaluated the agreement of anal cytologic interpretation between two cytopathologists. Methods: Liquid‐based cytologic slides from human immunodeficiency virus (HIV)‐negative men who have sex with men (MSM) were evaluated by two readers with at least 10 years of expertise in cervical cytology. Cases with a discordant interpretation were reviewed, and a consensus was reached. Human papillomavirus (HPV) genotyping was performed using a proprietary HPV genotyping test. Unweighted and weighted Cohen kappa and 95% confidence interval (CI) values were calculated. Results: Overall, 713 slides that were adequate for interpretation were evaluated (MSM: median age, 33 years). An HPV test was performed on 620 samples (87.0%). Considering a dichotomous interpretation (negative for intraepithelial lesion or malignancy vs. atypical squamous cells of undetermined significance or worse), the crude agreement between the two readers was 93.3% (kappa = 0.82; 95% CI, 0.77–0.87). Once a consensus for discordant cases was reached, the best agreement was found for the negative for intraepithelial lesion or malignancy category (511 of 528 samples; 96.8%), whereas the atypical squamous cells of undetermined significance category showed the lowest agreement (90 of 117 samples, 76.9%). Considering the individual cytologic categories, overall agreement was 92.1% (kappa = 0.85; 95% CI, 0.81–0.89). The discordant interpretations were not associated with high‐risk HPV infection, HPV16 infection, or MSM age. Conclusions: The results indicating excellent interobserver agreement in this study substantiate the use of anal cytology in the setting of human immunodeficiency virus‐negative MSM. The excellent interobserver agreement found in this study substantiates the use of anal cytology in the setting of human immunodeficiency virus‐negative men who have sex with men. Evaluation of anal cytology reproducibility is critical to ensure it is a valuable tool in anal cancer screening. [ABSTRACT FROM AUTHOR]

Objective: To compare the diagnostic performance for the detection of clinically significant prostate cancers and interobserver agreement between PI-RADS v2 and v2.1 Material and Method: The mpMRI images of 258 patients and 394 nodüles included in this retrospective study were obtained on 3T MR and evaluated by two radiologists according to PI-RADS v2 and v2.1. Sensitivity and specificity between v2 and v2.1 compared. Detection rates for clinically significant prostate cancers of upgraded and downgraded lesions in the use of v2.1 from v2 were assessed. Interobserver agreement was assessed using κ statistics. Results: PI-RADS v2.1 and v2 showed higher sensitivity and lower specificity (100%, 52.38%) in peripheral zone and showed higher sensitivity and specificity (92.86%, 98.79%) in transition zone for category ≥4 lesions in the detection of csPCa, not significantly difference was found between the two versions. Interobserver agreement was statistically significant and very weak in the transition zone (κ=0.383, κ=0.279, respectively), very strong in the peripheral zone (κ=0.869) according to both classifications and they were similar. Conclusion: The diagnostic performance of PI-RADS v2 and v2.1 were found similar in detecting clinically significant cancers and all cancers in both zones. The clinically significant cancer detection rate in category 2+1 lesions in the transition zone was higher than in category 2 lesions but it wasn’t statistically significant. Interobserver agreement was low in the transition zone and very strong in the peripheral zone in both versions.

Objectives: Timely and accurate preoperative diagnosis of uterine sarcoma will increase patient survival. The primary aim of this study was to describe the ultrasound features of uterine sarcoma compared with those of uterine leiomyoma based on the terms and definitions of the Morphological Uterus Sonographic Assessment (MUSA) group. A secondary aim was to assess the interobserver agreement for reporting on ultrasound features according to MUSA terminology. Methods: This was a retrospective cohort study of patients with uterine sarcoma or uterine leiomyoma treated in a single tertiary center during the periods 1997–2019 and 2016–2019, respectively. Demographic characteristics, presenting symptoms and surgical outcomes were extracted from patients' files. Ultrasound images were re‐evaluated independently by two sonologists using MUSA terms and definitions. Descriptive statistics were calculated and interobserver agreement was assessed using Cohen's κ (with squared weights) or intraclass correlation coefficient, as appropriate. Results: A total of 107 patients were included, of whom 16 had a uterine sarcoma and 91 had a uterine leiomyoma. Abnormal uterine bleeding was the most frequent presenting symptom (69/107 (64%)). Compared with leiomyoma cases, patients with uterine sarcoma were older (median age, 65 (interquartile range (IQR), 60–70) years vs 48 (IQR, 43–52) years) and more likely to be postmenopausal (13/16 (81%) vs 15/91 (16%)). In the uterine sarcoma cohort, leiomyosarcoma was the most frequent histological type (6/16 (38%)), followed by adenosarcoma (4/16 (25%)). On ultrasound evaluation, according to Observers 1 and 2, the tumor border was irregular in most sarcomas (11/16 (69%) and 13/16 (81%) cases, respectively), but regular in most leiomyomas (65/91 (71%) and 82/91 (90%) cases, respectively). Lesion echogenicity was classified as non‐uniform in 68/91 (75%) and 51/91 (56%) leiomyomas by Observers 1 and 2, respectively, and 15/16 (94%) uterine sarcomas by both observers. More than 60% of the uterine sarcomas showed acoustic shadows (11/16 (69%) and 10/16 (63%) cases by Observers 1 and 2, respectively), whereas calcifications were reported in a small minority (0/16 (0%) and 2/16 (13%) cases by Observers 1 and 2, respectively). In uterine sarcomas, intralesional vascularity was reported as moderate to abundant in 13/16 (81%) cases by Observer 1 and 15/16 (94%) cases by Observer 2, while circumferential vascularity was scored as moderate to abundant in 6/16 (38%) by both observers. Interobserver agreement for the presence of cystic areas, calcifications, acoustic shadow, central necrosis, color score (overall, intralesional and circumferential) and maximum diameter of the lesion was moderate. The agreement for shape of lesion, tumor border and echogenicity was fair. Conclusions: A postmenopausal patient presenting with abnormal uterine bleeding and a new or growing mesenchymal mass with irregular tumor borders, moderate‐to‐abundant intralesional vascularity, cystic areas and an absence of calcifications on ultrasonography is at a higher risk of having a uterine sarcoma. Interobserver agreement for most MUSA terms and definitions is moderate. Future studies should validate the abovementioned clinical and ultrasound findings on uterine mesenchymal tumors in a prospective multicenter fashion. © 2023 International Society of Ultrasound in Obstetrics and Gynecology. [ABSTRACT FROM AUTHOR]

Objective: To compare the diagnostic performance for the detection of clinically significant prostate cancers and interobserver agreement between PI-RADS v2 and v2.1 Material and Method: The mpMRI images of 258 patients and 394 nodüles included in this retrospective study were obtained on 3T MR and evaluated by two radiologists according to PIRADS v2 and v2.1. Sensitivity and specificity between v2 and v2.1 were compared. Detection rates for clinically significant prostate cancers were evaluated. Interobserver agreement was evaluated using κ statistics. Results: PI-RADS v2.1 and v2 had higher sensitivity and lower specificity (100%, 52.38%) in the peripheral zone, and showed higher sensitivity and specificity (92.86%, 98.79%) in the transition zone for category ≥4 lesions to estimate csPCa, but no remarkable difference was found between the two versions. Interobserver agreement was statistically significant and very weak in the transition zone (κ=0.383, κ=0.279, respectively), very strong in the peripheral zone (κ=0.869) according to both classifications and they were similar. Conclusion: The diagnostic performance of PI-RADS v2 and v2.1 were found similar in the determination of clinically significant cancers and all cancers in both zones. The clinically significant cancer detection rate in category 2+1 lesions in the transition zone was higher than in category 2 lesions but it was not statistically significant. Interobserver agreement was low in the transition zone and very strong in the peripheral zone in both versions. [ABSTRACT FROM AUTHOR]

Introduction: Being able to recognize high-risk facial basal cell carcinoma (BCC) may lead to fewer incomplete excisions and inappropriate treatments. Objectives: We sought to investigate clinical and dermoscopic criteria for predicting facial BCC subtypes, analyze the interobserver agreement between readers, and develop a diagnostic algorithm to predict high-risk histopathological subtype. Methods: In this single-center, retrospective investigation, 6 independent readers evaluated predefined clinical and dermoscopic criteria in images of histopathologically verified primary facial BCCs including: topography, border demarcation, vessels, ulceration, white porcelain areas, shiny white blotches and strands, and pigmented structures and vessels within ulceration. Results: Overall, 297 clinical and dermoscopic image pairs were analyzed. The strongest associations with high-risk subtype were: “bumpy” topography (OR 3.8, 95% CI, 3.1-4.7), ill-defined borders (OR 3.4, 95% CI 3.1-4.7), white porcelain area (OR 3.5, 95% CI 2.8-4.5), and vessels within ulceration (OR 3.1, 95% CI 2.4-4.1). Predominantly focused vessels were a positive diagnostic criterium for either nodular (OR 1.7, 95% CI 1.3-2.2) or high-risk (OR 2.0, 95% CI 1.6-2.5) subtypes and a strong negative diagnostic criterium for superficial BCC (OR 14.0, 95% CI 9.6-20.8). Interobserver agreement ranged from fair to substantial (κ=0.36 to 0.72). A diagnostic algorithm based on these findings demonstrated a sensitivity of 81.4% (95% CI, 78.9-83.7%) and a specificity of 53.3% (95% CI, 49.7-56.9%) for predicting high-risk BCC subtype. Conclusions: Integration of both clinical and dermoscopic features (including novel features such as topography and vessels within ulceration) are essential to improve subtype prediction of facial BCCs and management decisions.

Abstract Background While the effectiveness of cardiotocography in reducing neonatal morbidity is still debated, it remains the primary method for assessing fetal well-being during labor. Evaluating how accurately professionals interpret cardiotocography signals is essential for its effective use. The objective was to evaluate the accuracy of fetal hypoxia prediction by practitioners through the interpretation of cardiotocography signals and clinical variables during labor. Material and methods We conducted a cross-sectional online survey, involving 120 obstetric healthcare providers from several countries. One hundred cases, including fifty cases of fetal hypoxia, were randomly assigned to participants who were invited to predict the fetal outcome (binary criterion of pH with a threshold of 7.15) based on the cardiotocography signals and clinical variables. After describing the participants, we calculated (with a 95% confidence interval) the success rate, sensitivity and specificity to predict the fetal outcome for the whole population and according to pH ranges, professional groups and number of years of experience. Interobserver agreement and reliability were evaluated using the proportion of agreement and Cohen’s kappa respectively. Results The overall ability to predict a pH level below 7.15 yielded a success rate of 0.58 (95% CI 0.56-0.60), a sensitivity of 0.58 (95% CI 0.56-0.60) and a specificity of 0.63 (95% CI 0.61-0.65). No significant difference in the success rates was observed with respect to profession and number of years of experience. The success rate was higher for the cases with a pH level below 7.05 (0.69) and above 7.20 (0.66) compared to those falling between 7.05 and 7.20 (0.48). The proportion of agreement between participants was good (0.82), with an overall kappa coefficient indicating substantial reliability (0.63). Conclusions The use of an online tool enabled us to collect a large amount of data to analyze how practitioners interpret cardiotocography data during labor. Despite a good level of agreement and reliability among practitioners, the overall accuracy is poor, particularly for cases with a neonatal pH between 7.05 and 7.20. Factors such as profession and experience level do not present notable impact on the accuracy of the annotations. The implementation and use of a computerized cardiotocography analysis software has the potential to enhance the accuracy to detect fetal hypoxia, especially for ambiguous cardiotocography tracings.

Necrosis is a common finding in human and animal neoplasms. The percentage of tumor necrosis is included in tumor grading schemes in veterinary oncology; however, evaluation methods are often overlooked. Different studies have assessed the prognostic value of tumor necrosis in feline mammary tumors with contradictory results, which could be related to methodologic variability. In this study, a comprehensive evaluation of tumor necrosis in feline mammary tumors (FMTs) was conducted, by applying a semi-quantitative and a quantitative methodology for assessing necrosis. The interobserver agreement, the relationship with clinicopathological characteristics and the prognostic value of necrosis were analyzed in 154 FMT cases. Although subjectivity in the assessment of necrosis existed, an almost perfect agreement (weighted quadratic k = 0.851) between two observers was obtained. Furthermore, there was a significant positive correlation between the semi-quantitative and quantitative methods. Necrosis was more common and more extensive in malignant tumors than in their benign counterparts. Despite the non-significant results in the survival analysis, extensive necrosis was significantly associated with aggressive clinicopathological features, such as higher histological grade, high mitotic count and lymphovascular invasion. Our results support the potential relevance of necrosis in FMT.

The study investigated the repeatability of brain diffusion-based stiffness prediction (DWI stiff) in healthy volunteers. Thirty-one healthy volunteers were examined with DWI stiff using two different sets of b-values: b200-1500 s/mm2 (DWI stiff , 1500) and b200-1000 s/mm2 (DWI stiff , 1000). Each b-value set was scanned twice per imaging session without repositioning the participants. DWI stiff images were reconstructed from each set. Two observers delineated regions of interest (ROIs) on each DWI stiff image. The repeatability coefficient (RC), coefficient of variation (CV), inter- and intraobserver agreement were calculated. After excluding three participants due to image artifacts, the study included twenty-eight volunteers (mean age (range)) 37 years (24–62), 10 males, 18 females). For DWI stiff , 1500, the lowest and the highest RCs were in the parietal lobe (0.52) and respectively the brain stem (1.17). The lowest RC for DWI stiff , 1000 was in the frontal lobe (0.42) and the highest in the brain stem (1.58). The CV for whole brain measurements was 3.83 % for DWI stiff , 1500 and 4.93 % for DWI stiff , 1000. The Bland‒Altman (BA) limits of agreement (LoA) for the intraobserver agreement of DWI stiff , 1500 were −0.90 to 1.06 and respectively −0.78 to 0.88 for DWI stiff , 1000. Regarding interobserver agreement, the LoA were −0.85 to 0.94 for DWI stiff , 1500 and −0.61 to 0.66 for DWI stiff , 1000. DWI stiff is a precise technique with some observer dependence. Repeatability is higher for DWI stiff , 1000 s/mm2 than for DWI stiff 1500 s/mm2. Our findings suggest that DWI stiff can reliably detect stiffness changes larger than 4.93 % in healthy volunteers. Further studies should investigate whether the repeatability of DWI stiff may be affected by the presence of pathology such as a brain tumor. [ABSTRACT FROM AUTHOR]

Purpose: In this systematic review, we evaluate the effect of radiographs and 2D and 3D imaging techniques on the interobserver agreement of six commonly used classification systems for tibial plateau fractures. Methods: In accordance with PRISMA guidelines, PubMed, Cochrane, Embase and Web of Science were searched for studies regarding the effect of 2D and 3D imaging techniques on the interobserver agreement of tibial plateau classification systems. Studies validating new classification systems, not providing own data or only providing information on the interobserver agreement for radiographs were excluded. Studies were scored based on the ROBINS-I risk of bias tool. Results: Our review analysed 14 studies on different classification systems used for tibial plateau fractures in clinical practice, with the Schatzker classification being the most commonly used classification system. The results showed that the addition of 2D CT led to a significant improvement of interobserver agreement for one study. However, other included studies showed varying levels of interobserver agreement, ranging from fair to substantial according to the interpretation by Landis and Koch. The addition of 3D CT resulted in a significant deterioration in one study for the Schatzker classification. Similar to the addition of 2D CT, the interobserver agreement for the Schatzker classification with the addition of 3D CT were heterogeneous ranging from fair to almost perfect according to the interpretation by Landis and Koch. Conclusions: The use of 2D CT can be recommended for classifying tibial plateau fractures with the Schatzker classification, AO/OTA classification and Hohl classification. The value of 3D CT on the interobserver agreement of commonly used classification systems remains uncertain and unproven. Therefore, we do not recommend the use of 3D CT for the classification of tibial plateau fractures. Overall, the advancement of imaging techniques is not in line with the advancement in interobserver agreement on fracture classification. [ABSTRACT FROM AUTHOR]

Background: Several classification systems have been developed to support orthopedic surgeons regarding diagnostic, treatment, or prognostic outcomes of distal radius fracture (DRF). However, the best classification system for this fracture remains controversial. We aimed to identify the reliability of three different DRF classifications among orthopedists in training (medical residents).Methods: Orthopedic residents (n = 22) evaluated thirty cases of DRF in anteroposterior and lateral projections in three different periods (0, 6, 12 months). Each radiography was sorted with three different classifications: Frykman, AO/OTA, and Jupiter-Fernandez. All assessments were blinded to the investigators. The inter- and intra-observer reliability was evaluated using the Cohen's kappa coefficient. An additional analysis was performed for a simpler sub-classification of the AO/OTA (27, 9, or 3 groups).Results: Inter-observer agreement for AO/OTA, Frykman, and Jupiter-Fernandez classifications was slight (k = 0.15), fair (k = 0.31), and fair (k = 0.30), respectively. Intra-observer agreement showed similar results: AO/OTA, k = 0.14; Frykman, k = 0.28; and Jupiter-Fernandez, k = 0.28. When the AO/OTA classification was simplified (9 or 3 descriptions), the inter-observer agreement improved from slight (k = 0.16) to fair (k = 0.21 and k = 0.30, respectively). A similar improvement from slight (k = 0.14) to fair (k = 0.32 and k = 0.21) was detected for intra-observer agreement.Conclusions: The more complex the DRF classification system, the more complex is to reach reliable inter- and intra-observer agreements between orthopedic trainees. Senior residents did not necessarily show greater kappa values in DRF classifications. [ABSTRACT FROM AUTHOR]

Introduction: It is a shortcoming of traditional cardiotocography (CTG) classification table formats that CTG traces are frequently classified differently by different users, resulting in poor interobserver agreements. A fast‐and‐frugal tree (FFTree) flow chart may help provide better concordance because it is straightforward and has clearly structured binary questions with understandable "yes" or "no" responses. The initial triage to determine whether a fetus is suitable for labor when utilizing fetal ECG ST analysis (STAN) is very important, since a fetus with restricted capacity to respond to hypoxic stress may not generate STAN events and therefore may become falsely negative. This study aimed to compare physiology‐focused FFTree CTG interpretation with FIGO classification for assessing the suitability for STAN monitoring. Material and methods: A retrospective study of 36 CTG traces with a high proportion of adverse outcomes (17/36) selected from a European multicenter study database. Eight experienced European obstetricians evaluated the initial 40 minutes of the CTG recordings and judged whether STAN was a suitable fetal surveillance method and whether intervention was indicated. The experts rated the CTGs using the FFTree and FIGO classifications at least 6 weeks apart. Interobserver agreements were calculated using proportions of agreement and Fleiss' kappa (κ). Results: The proportions of agreement for "not suitable for STAN" were for FIGO 47% (95% confidence interval [CI] 42%–52%) and for FFTree 60% (95% CI 56–64), ie a significant difference; the corresponding figures for "yes, suitable" were 74% (95% CI 71–77) and 70% (95% CI 67–74). For "intervention needed" the figures were 52% (95% CI 47–56) vs 58% (95% CI 54–62) and for "expectant management" 74% (95% CI 71–77) vs 72% (95% CI 69–75). Fleiss' κ agreement on "suitability for STAN" was 0.50 (95% CI 0.44–0.56) for the FIGO classification and 0.57 (95% CI 0.51–0.63) for the FFTree classification; the corresponding figures for "intervention or expectancy" were 0.53 (95% CI 0.47–0.59) and 0.57 (95% CI 0.51–0.63). Conclusions: The proportion of agreement among expert obstetricians using the FFTree physiological approach was significantly higher compared with the traditional FIGO classification system in rejecting cases not suitable for STAN monitoring. That might be of importance to avoid false negative STAN recordings. Other agreement figures were similar. It remains to be shown whether the FFTree simplicity will benefit less experienced users and how it will work in real‐world clinical scenarios. [ABSTRACT FROM AUTHOR]

Background: Primary sclerosing cholangitis (PSC) is a cholestatic liver disease that progresses to cirrhosis and liver failure. The Anali and Amsterdam scores are based upon imaging features on MRI and ERCP, respectively. Aims: We aimed to compare the interobserver variability and performances of these scores. Methods: Patients with PSC with at least 1 MRCP were included. Images were independently scored by 2 experts. Agreement and prognostic performance with a primary end point of hepatic decompensation was assessed. Results: Fifty-nine patients were included (67.8% male, 86.4% IBD). Interobserver agreement for the Anali and Amsterdam scores were moderate (k = 0.49; 95% CI 0.35–0.64 and k = 0.43; 95% CI 0.30–0.56, respectively). Among the Anali components, dysmorphy (caudate/right lobe ratio > 0.9) had fair agreement (k = 0.37; 95% CI 0.14–0.60) and portal hypertension (k = 0.64, 95% CI 0.32–0.89) and intrahepatic dilation (k = 0.70; 95% CI 0.53–0.87) had substantial agreement. The Amsterdam extrahepatic and intrahepatic scores had fair agreement (k = 0.38; 95% CI 0.23–0.52) and moderate agreement (k = 0.50; 95% CI 0.34–0.67), respectively. Anali score (HR 5.90, 95% CI 1.64–21.21), total bilirubin (HR = 3.23; 95% Cl 1.06–9.91), and age (HR = 1.05; 95% CI 1.00–1.11) were independent predictors of hepatic decompensation. Mayo risk score and Anali score had good discriminative ability with c-statistics of 0.78 (CI 0.59–0.96) and 0.76 (CI 0.56–0.91). Anali score remained an independent predictor after adjusting for Mayo risk score. Conclusion: Anali score adds additional predictive value for hepatic decompensation in patients with PSC. [ABSTRACT FROM AUTHOR]

Neuromuscular disorders can lead to nocturnal hypoventilation. Accurate diagnosis of hypoventilation is imperative to guide treatment decisions. This study determined interobserver agreement for a number of definitions of nocturnal hypoventilation in children and adolescents with neuromuscular disorders. Overall mean interobserver agreement was 89% (range 66–100%); however, reliability of agreement was moderate at best (Fleiss κ = 0.574, p < 0.001). When hypoventilation was present, the objective definition used most frequently was an average increase in partial pressure of carbon dioxide (pCO2) ≥ 3 mm Hg from NREM to REM. The appearance of the transcutaneous CO2 (TCO2) trend graph and an increase in pCO2 ≥ 10 mm Hg from awake to asleep were most often associated with a false positive diagnosis. The variation and at best moderate agreement between pediatric sleep physicians observed in this study when diagnosing hypoventilation in children with neuromuscular disorders may be partially explained by the existence of multiple definitions and failure to remove artifact and “drift” from the TCO2 data.

Purpose: To evaluate the impact of video sequences (cine-loops) on the interobserver agreement (IOA) using risk stratification systems (RSSs) for thyroid nodules (TNs). Methods: Twenty TNs were randomly selected from a large database and evaluated by twelve experienced observers using five different RSSs (Kwak-, ACR-, EU-, Korean-TIRADS, ATA Guidelines). In the first step, the evaluation was conducted based on static ultrasound (US) images in two planes (“static”). Six months later, these cases were reevaluated by the same observers using video sequences in two planes (“cine-loops”). Fleiss’ kappa (κ) was calculated for the IOA analyses. Results: IOA on static was moderate with κ values of 0.46, 0.42, 0.40, 0.45, and 0.38 for the Kwak-, ACR-, EU-, Korean-TIRADS, and ATA Guidelines, respectively, while the IOA on cine-loops was fair with κ values of 0.41, 0.38, 0.37, 0.36, and 0.34 for the Kwak-, ACR-, EU-, Korean-TIRADS, and ATA Guidelines, respectively. The overall IOA was superior in static images versus cine-loops (p = 0.024). Among other findings, the subgroup analyses (related to age, gender, US certificates, number of thyroid US per week, and RSSs experience) particularly showed that the experience of the observers in using RSSs had a significant influence on the IOA. Conclusions: The overall IOA (all twelve observers and all five RSSs) was superior on static US images in comparison to cine-loops. Furthermore, the overall IOA of the five US features revealed superior κ values of the static images over cine-loops. However, this impact was significantly lower when the observers were highly experienced in the use of US RSSs of TNs.

Introduction: Imaging analysis of foraminal stenosis in the fifth lumbar (L5) nerve root remains to be a challenge because of the anatomical complexity of the lumbosacral transition. T2-weighted three-dimensional (3D) magnetic resonance images (MRI) have been dominantly used for diagnosis of lumbar foraminal stenosis, while the reliability of T1-weighted images (WI) has also been proven. In this study, we aim to compare the reliability and reproducibility of T1- and T2-weighted 3D MRI in diagnosing lumbar foraminal stenosis (LFS) of the L5 nerve root. Methods: In this study, 39 patients with unilateral L5 radiculopathy (20 had L4-L5 intracanal stenosis; 19 had L5-S foraminal stenosis) were enrolled, prospectively. T1- and T2-weighted 3D lumbar MRI were obtained from each patient. T1WI and T2WI were blinded and then separately reviewed twice by four examiners randomly. The examiners were instructed to answer the side of LFS or absence of LFS. The correct answer rate, sensitivity, specificity, and area under the curve were analyzed and compared between T1WI and T2WI. Also, intra- and interobserver agreements were calculated using kappa (κ)-statistics and compared in the same manner. Results: The average correct answer rate, sensitivity, specificity, and area under the curve of the T1WI/T2WI were 84.6%/80.1%, 82.9%/80.3%, 86.3%/81.3%, and 0.846/0.801, respectively. The intraobserver κ-values of the four examiners ranged from 0.692 to 0.916 (average: 0.762) and from 0.669 to 0.801 (average: 0.720) for T1WI and T2WI, respectively. The interobserver κ-values calculated in a round-robin manner (24 combinations in total) ranged from 0.544 to 0.790 (average: 0.657) and from 0.524 to 0.828 (average: 0.652), respectively. Conclusions: As per our findings, T1- and T2-weighted 3D MRI were determined to have nearly equivalent reliability and reproducibility in terms of diagnosing LFS of the L5 nerve root.

Objective Distal clavicle fracture classification directly affects the treatment decisions. It is unclear whether the classification systems implemented differ depending on surgeons' backgrounds. This study aimed to compare the interobserver agreement of four classification systems used for lateral clavicle fractures by shoulder specialists and general trauma surgeons. Methods Radiographs of 20 lateral clavicle fractures representing a full spectrum of adult fracture patterns were analyzed by eight experienced shoulder specialists and eight general trauma surgeons from 10 different hospitals. All cases were graded according to the Orthopedic Trauma Association (OTA), Neer, Jäger/Breitner, and Gongji classification systems. To measure observer agreement, Fleiss' kappa coefficient (κ) was applied and assessed. Results When only X‐ray films were presented, both groups achieved fair agreement. However, when the 3D‐CT scan images were provided, improved interobserver agreement was found in the specialist group when the OTA, Jäger/Breitner, and Gongji classification systems were used. In the generalist groups, improved agreement was found when using the Gongji classification system. In terms of interobserver reliability, the OTA, Neer, and Jäger/Breitner classification systems showed better agreement among shoulder specialists, while a slightly lower level of agreement was found using the Gongji classification system. For the OTA classification system, interobserver agreement had a mean kappa value of 0.418, ranging from 0.446 (specialist group) to 0.402 (generalist group). For the Neer classification system, interobserver agreement had a mean kappa value of 0.368, ranging from 0.402 (specialist group) to 0.390 (generalist group). For the Jäger/Breitner classification system, the inter‐observer agreement had a mean kappa value of 0.380, ranging from 0.413 (specialist group) to 0.404 (generalist group). For the Gongji classification system, interobserver agreement had a mean kappa value of 0.455, ranging from 0.480 (specialist group) to 0.485 (generalist group). Conclusion Generally speaking, 3D‐CT scans provide a richer experience that can lead to better results in most classification systems of lateral clavicle fractures, highlighting the value of digitization and specialization in diagnosis and treatment. Competitive interobserver agreement was exhibited in the generalist group using the Gongji classification system, suggesting that the Gongji classification is suitable for general trauma surgeons who are not highly experienced in the shoulder field.

Simple Summary: Thyroiditis is one of the most common immune toxicities in patients treated with combination immune checkpoint inhibition. Increased metabolic activity in the thyroid can be observed on FDG-PET/CT performed for the purposes of response assessment. The aim of our retrospective study was to assess the association and temporal profile of FDG-PET/CT findings suggesting thyroiditis with the natural history of clinical and biochemical thyroid dysfunction. Our findings demonstrated that an increased metabolic activity of the thyroid seen on routine FDG-PET/CT correlates with a biochemical diagnosis of thyroiditis and persists well after the initial biochemical diagnosis. We demonstrated that patients with FDG-PET/CT changes were more likely to develop overt clinical hypothyroidism. Background: FDG-PET/CT used for immune checkpoint inhibitor (ICI) response assessment can incidentally identify immune-related adverse events (irAEs), including thyroiditis. This study aimed to correlate the time course of FDG-PET/CT evidence of thyroiditis with clinical and biochemical evolution of thyroid dysfunction. Methods: A retrospective review was performed by two independent blinded nuclear medicine physicians (NMPs) of thyroidal FDG uptake in 127 patients who underwent PET/CT between January 2016 and January 2019 at baseline and during treatment monitoring of combination ICI therapy for advanced melanoma. Interobserver agreement was assessed and FDG-PET/CT performance defined by a receiver-operating characteristic (ROC) curve using thyroid function tests (TFTs) as the standard of truth. Thyroid maximum standardized uptake value (SUVmax) and its temporal changes with respect to the longitudinal biochemistry were serially recorded. Results: At a median of 3 weeks after commencing ICI, 43/127 (34%) had a diagnosis of thyroiditis established by abnormal TFTs. FDG-PET/CT was performed at baseline and at a median of 11 weeks (range 3–32) following the start of therapy. ROC analysis showed an area under the curve of 0.87 (95% CI 0.80, 0.94) for FDG-PET/CT for detection of thyroiditis with a positive predictive value of 93%. Among patients with biochemical evidence of thyroiditis, those with a positive FDG-PET/CT were more likely to develop overt hypothyroidism (77% versus 35%, p < 0.01). In the evaluation of the index test, there was an almost perfect interobserver agreement between NMPs of 93.7% (95% CI 89.4–98.0), kappa 0.83. Conclusion: Increased metabolic activity of the thyroid on routine FDG-PET/CT performed for tumoral response of patients undergoing ICI therapy is generally detected well after routine biochemical diagnosis. Elevation of FDG uptake in the thyroid is predictive of overt clinical hypothyroidism and suggests that an ongoing robust inflammatory response beyond the initial thyrotoxic phase may be indicative of thyroid destruction. [ABSTRACT FROM AUTHOR]

We aimed to compare the performance and interobserver agreement of radiologists manually segmenting images or those assisted by automatic segmentation. We further aimed to reduce interobserver variability and improve the consistency of radiomics features. This retrospective study included 327 patients diagnosed with prostate cancer from September 2016 to June 2018; images from 228 patients were used for automatic segmentation construction, and images from the remaining 99 were used for testing. First, four radiologists with varying experience levels retrospectively segmented 99 axial prostate images manually using T2-weighted fat-suppressed magnetic resonance imaging. Automatic segmentation was performed after 2 weeks. The Pyradiomics software package v3.1.0 was used to extract the texture features. The Dice coefficient and intraclass correlation coefficient (ICC) were used to evaluate segmentation performance and the interobserver consistency of prostate radiomics. The Wilcoxon rank sum test was used to compare the paired samples, with the significance level set at p < 0.05. The Dice coefficient was used to accurately measure the spatial overlap of manually delineated images. In all the 99 prostate segmentation result columns, the manual and automatic segmentation results of the senior group were significantly better than those of the junior group (p < 0.05). Automatic segmentation was more consistent than manual segmentation (p < 0.05), and the average ICC reached >0.85. The automatic segmentation annotation performance of junior radiologists was similar to that of senior radiologists performing manual segmentation. The ICC of radiomics features increased to excellent consistency (0.925 [0.888~0.950]). Automatic segmentation annotation provided better results than manual segmentation by radiologists. Our findings indicate that automatic segmentation annotation helps reduce variability in the perception and interpretation between radiologists with different experience levels and ensures the stability of radiomics features. [ABSTRACT FROM AUTHOR]

Purpose: When an optical colonoscopy is carried out, Scope Guide can assist the endoscopist in determining the localization. In colon capsule endoscopy (CCE), this support is not available. To our knowledge, the interobserver agreement on landmark identification has never been studied. This study aims to investigate the interobserver agreement on landmark identification in CCE. Methods: An interobserver study was carried out comparing the landmark identification (the ileocecal valve, hepatic flexure, splenic flexure, and anus) in CCE investigations between an external private contractor and three in-house CCE readers with different levels of experience. All CCE investigations analyzed in this study were carried out as a part of the Danish screening program for colorectal cancer. Patients were between 50 and 74 years old with a positive fecal immunochemical test (FIT). A random sample of 20 CCE investigations was taken from the total sample of more than 800 videos. Results: Overall interobserver agreement on all landmarks was 51%. Interobserver agreement on the first cecal image (ileocecal valve), hepatic flexure, splenic flexure, and last rectal image (anus) was 72%, 29%, 22%, and 83%, respectively. The overall interobserver agreement, including only examinations with adequate bowel preparation (n = 16), was 54%, and for individual landmarks, 73%, 32%, 24%, and 85%. Conclusion: Overall interobserver agreement on all four landmarks from CCE was poor. Measures are needed to improve landmark identification in CCE investigations. Artificial intelligence could be a possible solution to this problem. [ABSTRACT FROM AUTHOR]

Purpose: The aim of this study was to evaluate interobserver agreement (IOA) on target volume definition for pancreatic cancer (PACA) within the Radiosurgery and Stereotactic Radiotherapy Working Group of the German Society of Radiation Oncology (DEGRO) and to identify the influence of imaging modalities on the definition of the target volumes. Methods: Two cases of locally advanced PACA and one local recurrence were selected from a large SBRT database. Delineation was based on either a planning 4D CT with or without (w/wo) IV contrast, w/wo PET/CT, and w/wo diagnostic MRI. Novel compared to other studies, a combination of four metrics was used to integrate several aspects of target volume segmentation: the Dice coefficient (DSC), the Hausdorff distance (HD), the probabilistic distance (PBD), and the volumetric similarity (VS). Results: For all three GTVs, the median DSC was 0.75 (range 0.17–0.95), the median HD 15 (range 3.22–67.11) mm, the median PBD 0.33 (range 0.06–4.86), and the median VS was 0.88 (range 0.31–1). For ITVs and PTVs the results were similar. When comparing the imaging modalities for delineation, the best agreement for the GTV was achieved using PET/CT, and for the ITV and PTV using 4D PET/CT, in treatment position with abdominal compression. Conclusion: Overall, there was good GTV agreement (DSC). Combined metrics appeared to allow a more valid detection of interobserver variation. For SBRT, either 4D PET/CT or 3D PET/CT in treatment position with abdominal compression leads to better agreement and should be considered as a very useful imaging modality for the definition of treatment volumes in pancreatic SBRT. Contouring does not appear to be the weakest link in the treatment planning chain of SBRT for PACA. [ABSTRACT FROM AUTHOR]

Aim: Liver biopsy is the gold standard for demonstrating hepatic damage in patients with chronic hepatitis. In this study, the reproducibility of the Modified Ishak Histological Activity Index (MHAI), used in the histopathological evaluation of chronic hepatitis, between observers trained in different centers was investigated. Patients and Methods: A total of 64 liver needle biopsies were included in the study between 2020 and 2023. Sections of the cases stained with hematoxylin-eosin, silver and trichrome were re-evaluated under a light microscope by the investigator (İÇ) and re-scored according to MHAI. In statistical evaluation, Cohen's kappa statistics were applied using the SPSS 21.0 progr am. Results: When all cases are taken into consideration in statistical evaluation, kappa value is; MAI was found to be 0.02 (slight) for degree and 0.38 (fair) for stage. When the researcher's compatibility with other pathologists was evaluated, the kappa values in the grading were quite low and found to be incompatible. Although there were higher values (0.12-0.49) in the stage than in the degree, the fit was poor and moderate. However, pathologists with a long-term history of collaboration showed higher levels of compliance, highlighting the importance of ongoing exchange of information. Conclusion: This study highlights the need for a standardized approach to interpretation and application of MHAI scoring to increase reproducibility. [ABSTRACT FROM AUTHOR]

Purpose: To evaluate interobserver agreement on the findings of baseline contrast-enhanced multidetector computed tomography (CE-MDCT) performed at the postoperative third month in patients who underwent surgery due to ductal adenocarcinoma of the pancreatic head and investigate the value of these findings in predicting locoregional recurrence. Material and methods: The baseline CE-MDCT images of 198 patients who underwent the Whipple procedure due to pancreatic head tumors were evaluated independently by three radiologists at the postoperative third month. The radiologists were asked to note suspicious findings in terms of locoregional recurrence, including postoperative fat stranding, the presence of perivascular contrast-enhanced solid tissue, short diameter of solid tissue if present, the shape of solid tissue (convex/concave), presence of peritoneal implants, diameter (mm) of pancreatic duct dilatation if present, the presence of lymph nodes larger than 5 mm, portal vein stenosis (≥50 and <50%), the presence of ascites, and the presence of distant metastases, as specified by the Society of Abdominal Radiology in October 2022. The agreement between the radiologists and the value of these parameters in predicting locoregional recurrence were investigated. Results: Among the CE-MDCT findings evaluated, the radiologists had a moderate-to-high level of agreement concerning the presence of perivascular contrast-enhanced solid tissue. However, there was a poor interobserver agreement on the shape of solid tissue. A very high level of agreement was found among the radiologists in the evaluation of pancreatic duct dilatation, peritoneal implants, ascites, and the presence of distant metastases. According to the univariate analysis, the rates of portal vein stenosis had a 1.419 -fold effect [odds ratio (OR)=1.419, [95% confidence interval (CI)= 0.548–3.679, p=0.041], lymph node presence had a 2.337 -fold effect [odds ratio (OR)=2.337, [95% confidence interval (CI)= 1.165–4.686, p=0.015], perivascular contrast-enhanced solid tissue had 2.241 -fold effect [odds ratio (OR)=2.241, [95% confidence interval (CI)= 1.072–4.684, p=0.005]. In the multivariate analysis, perivascular contrast-enhanced solid tissue had 2.241 -fold effect [odds ratio (OR)=2.519, [95% confidence interval (CI)= 1.132–5.605, p=0.024]. Conclusion: In the postoperative baseline CE-MDCT examination, the presence of solid tissue, lymph node presence, and portal vein stenosis in the surgical bed are among the findings that may indicate early locoregional recurrence in patients with pancreatic ductal adenocarcinoma. [ABSTRACT FROM AUTHOR]

ObjectivesThe Lower Anogenital Squamous Terminology (LAST) recommendations classify human papillomavirus-associated squamous lesions into low- and high-grade squamous intraepithelial lesions (LSILs/HSILs). Our study aimed to assess interobserver agreement among 6 experienced pathologists in assigning 40 anal lesions previously diagnosed as anal intraepithelial neoplasia 2 (AIN 2) to either HSIL or non-HSIL categories.MethodsAgreement based on photomicrographs of H&E alone or H&E plus p16 immunohistochemistry was calculated using κ coefficients.ResultsAgreement was fair based on H&E alone (κ = 0.42; 95% confidence interval [CI], 0.34-0.52). Adding p16 improved agreement to moderate (κ = 0.55; 95% CI, 0.54-0.62). On final diagnosis, 21 cases (53%) had unanimous diagnoses, and 19 (47%) were divided. When designating p16 results as positive or negative, agreement was excellent (κ = 0.92; 95% CI, 0.83-0.95). Among variables (staining location, extent, and intensity), staining of the basal/parabasal layers was a consistent feature in cases with consensus for positive results (20/20). Of the 67 H&E diagnoses with conflicting p16 results, participants modified 32 (48%), downgrading 23 HSILs and upgrading 9 non-HSILs.ConclusionsAlthough p16 increased interobserver agreement, disagreement remained considerable regarding intermediate lesions. p16 expression, particularly if negative, can reduce unwarranted HSIL diagnoses and unnecessary treatment.

Monitoring the fidelity with which implementers implement behavioral procedures is important, but individuals tasked with monitoring fidelity may have received little training. As a result, their data may be affected by variations in implementers' performance, such as the frequency of fidelity errors. To determine the extent to which the frequency of fidelity errors affected data accuracy, we used a multielement design in which novice observers collected fidelity data from video models with three levels of programmed fidelity (40%, 80%, and 100%) of a procedure based on differential reinforcement of other behavior (DRO). Participants collected fidelity data with lower accuracy, as indexed by interobserver agreement scores, when errors were more frequent. These findings suggest that individuals collecting fidelity data may need additional supports to detect and record all errors when procedural fidelity is low. [ABSTRACT FROM AUTHOR]

Background and aim: To evaluate and compare magnetic resonance imaging (MRI) sequences that could potentially be used in the diagnosis of coronavirus disease 2019 (COVID-19). Materials and methods: Included in the study were 42 patient who underwent thorax computed tomography (CT) for COVID-19 pneumonia and thorax MRI for any reason within 24 h after CT. The T2-weighted fast spin echo periodically rotated overlapping parallel lines with enhanced reconstruction (PROPELLER) (T2W-FSE-P), fast imaging employing steady-state acquisition, T2 fat-saturated FSE, axial T1 liver acquisition with volume acceleration (LAVA) and single-shot FSE images were compared in terms of their ability to show COVID-19 findings. Results: The mean age of the patients was 47.2 ± 24 years. Of the patients, 22 were male (52.4%) and 20 (47.6%) were female. The interobserver intraclass coefficient (ICC) for the image quality score was the highest in the T2W-FSE-P sequence and lowest in the T1 LAVA sequence. All of the lesion-based evaluations of the interobserver agreement were statistically significant, with the kappa value varying between 0.798 and 0.998. Conclusion: All 5 sequences evaluated in the study were successful in showing the parenchymal findings of COVID-19. Since the T2WFSE-P sequence had the best scores in both interobserver agreement and ICC for the image quality score, it was considered that it can be included in thorax MRI examinations to assist the diagnosis of COVID-19. [ABSTRACT FROM AUTHOR]

Correct classification of fractures according to their patterns is critical for developing a treatment plan in orthopaedic surgery. Unfortunately, for proximal humeral fractures (PHF), methods for proper classification have remained a jigsaw puzzle that has not yet been fully solved despite numerous proposed classifications and diagnostic methods. Recently, many studies have suggested that three-dimensional printed models (3DPM) can improve the interobserver agreement on PHF classifications. Moreover, Virtual Reality (VR) has not been properly studied for classification of shoulder injuries. The current study investigates the PHF classification accuracy relative to an expert committee when using either 3DPM or equivalent models displayed in VR among 36 orthopaedic surgery residents from different hospitals. We designed a multicentric randomised controlled trial in which we created two groups: a group exposed to a total of 34 3DPM and another exposed to VR equivalents. Association between classification accuracy and group assignment (VR/3DPM) was assessed using mixed effects logistic regression models. The results showed VR can be considered a non-inferior technology for classifying PHF when compared to 3DPM. Moreover, VR may be preferable when considering possible time and resource savings along with potential uses of VR for presurgical planning in orthopaedics. [ABSTRACT FROM AUTHOR]

Objective: Distal clavicle fracture classification directly affects the treatment decisions. It is unclear whether the classification systems implemented differ depending on surgeons' backgrounds. This study aimed to compare the interobserver agreement of four classification systems used for lateral clavicle fractures by shoulder specialists and general trauma surgeons. Methods: Radiographs of 20 lateral clavicle fractures representing a full spectrum of adult fracture patterns were analyzed by eight experienced shoulder specialists and eight general trauma surgeons from 10 different hospitals. All cases were graded according to the Orthopedic Trauma Association (OTA), Neer, Jäger/Breitner, and Gongji classification systems. To measure observer agreement, Fleiss' kappa coefficient (κ) was applied and assessed. Results: When only X‐ray films were presented, both groups achieved fair agreement. However, when the 3D‐CT scan images were provided, improved interobserver agreement was found in the specialist group when the OTA, Jäger/Breitner, and Gongji classification systems were used. In the generalist groups, improved agreement was found when using the Gongji classification system. In terms of interobserver reliability, the OTA, Neer, and Jäger/Breitner classification systems showed better agreement among shoulder specialists, while a slightly lower level of agreement was found using the Gongji classification system. For the OTA classification system, interobserver agreement had a mean kappa value of 0.418, ranging from 0.446 (specialist group) to 0.402 (generalist group). For the Neer classification system, interobserver agreement had a mean kappa value of 0.368, ranging from 0.402 (specialist group) to 0.390 (generalist group). For the Jäger/Breitner classification system, the inter‐observer agreement had a mean kappa value of 0.380, ranging from 0.413 (specialist group) to 0.404 (generalist group). For the Gongji classification system, interobserver agreement had a mean kappa value of 0.455, ranging from 0.480 (specialist group) to 0.485 (generalist group). Conclusion: Generally speaking, 3D‐CT scans provide a richer experience that can lead to better results in most classification systems of lateral clavicle fractures, highlighting the value of digitization and specialization in diagnosis and treatment. Competitive interobserver agreement was exhibited in the generalist group using the Gongji classification system, suggesting that the Gongji classification is suitable for general trauma surgeons who are not highly experienced in the shoulder field. [ABSTRACT FROM AUTHOR]

Introduction: Grey Scale Inversion Imaging (GSII), a radiology reading software, has been utilized to improve anatomical and pathological delineation and consequently increase the diagnostic accuracy in a variety of trauma and Orthopaedic conditions. Objective/aim: The objective of this study was to assess whether Grey Scale Inversion Imaging (GSII) has any impact on the diagnostic accuracy and inter-observer reliability in diagnosing neck of femur fractures. Method: We performed a retrospective, single-centre study, to identify 50 consecutive anteroposterior (AP) pelvis radiographs of patients who presented to our unit with suspected neck of femur fractures between 2020 and 2021. The images included a combination of normal pelvic radiographs and others with features suggestive either intracapsular or extracapsular neck of femur fractures, which had been confirmed on computed tomography (CT), magnetic resonance imaging (MRI) and/or subsequent surgery. Four independent observers (two Trauma and Orthopaedics (T&O) consultants, one T&O Trainee Registrar (ST3 level) and one Trainee Senior House Officer (SHO in T&O) reviewed the images and graded each radiograph image using the Likert scale in response to the statement "there is a fracture". Following this, the same radiographs were inverted to Grey Scale Inversion Imaging (GSII) grey scale images and reassessed. RAND correlation was used for statistical analysis. Results: Overall, observers appeared to have similar accuracy with normal radiographic imaging and with GSI sequences. Conclusion: Grey Scale Inversion Imaging (GSII) of digital radiographs did not affect the diagnostic accuracy of detecting neck of femur fractures in our study. [ABSTRACT FROM AUTHOR]

The reproducibility of imaging models for predicting microvascular invasion (MVI) in patients with hepatocellular carcinoma (HCC) remains questionable due to inconsistent interpretation of image signs. Our aim was to screen for high-consensus MRI features to develop a repeatable model for predicting MVI. We included 219 patients with HCC who underwent surgical resection, and patients were divided into a training cohort (n = 145) and a validation cohort (n = 74). Morphological characteristics, signal features on hepatobiliary phases, and dynamic enhancement patterns were qualitatively interobserver evaluated. Interobserver agreement was assessed using Cohen's κ for selecting features with high interobserver agreement. Risk factors that were significant in stepwise multivariate analysis and that could be measured with good interobserver agreement were used to construct a predictive model, which was assessed in the validation cohort. The diagnostic performance of the model was evaluated based on area under the receiver operating characteristic curve (AUC). Multivariate analysis identified nonsmooth tumor margin, absence of radiologic capsule, and intratumoral artery as independent risk factors of MVI. These MRI-based features showed good or nearly perfect interobserver agreement between radiologists (κ > 0.6). The predictive model predicted MVI well in the training (AUC 0.734) and validation cohorts (AUC 0.759) and fitted well to calibration curves. MRI features included nonsmooth tumor margin, absence of radiologic capsule, and intratumoral artery that can be assessed with high interobserver agreement can predict MVI in HCC patients. The predictive model described here may be useful to radiologists, regardless of experience level. [ABSTRACT FROM AUTHOR]

This study aimed to develop a comprehensive classification system for fractures of the lateral process of the talus (LPTF) based on CT, and to evaluate its prognostic value, reliability and reproducibility. We retrospectively reviewed 42 patients involving LPTF with an average follow-up of 35.9 months for clinical and radiographic evaluations. In order to develop a comprehensive classification, a panel of experienced orthopedic surgeons discussed the cases. All fractures were classified according to Hawkins, McCrory-Bladin and new proposed classifications by 6 observers. The analysis of interobserver and intraobserver agreements was measured using kappa statistics. The new classification included 2 types based on presence of concomitant injuries or not, with type I consisting of 3 subtypes and type II of 5 subtypes. Average AOFAS score was 91.5 in the type Ia of new classification, 86 in type Ib, 90.5 in type Ic, 89 in type IIa, 76.7 in type IIb, 76.6 in type IIc, 91.3 in type IId, and 83.5 in type IIe. Interobserver and intraobserver reliability of the new classification system were almost perfect (κ = 0.776 and 0.837, respectively), showing a higher interobserver and intraobserver reliability compared to the Hawkins classification (κ 0.572 and 0.649, respectively) as well as McCrory-Bladin classification (κ = 0.582 and 0.685, respectively). The new classification system is a comprehensive one that takes into account concomitant injuries and shows good prognostic value with clinical outcomes. It is more reliable and reproducible and could be a useful tool for decision-making on treatment options for LPTF. [ABSTRACT FROM AUTHOR]

Introduction: Placental pathology is key for investigating adverse pregnancy outcomes, however, lack of standardization in reporting has limited clinical utility. We evaluated a novel placental pathology synoptic report, comparing its robustness to narrative reports, and assessed interobserver agreement. Methods: 100 singleton placentas were included. Histology slides were examined by 2 senior perinatal pathologists and 2 pathology residents using a synoptic report (32 lesions). Historical narrative reports were compared to synoptic reports. Kappa scores were calculated for interobserver agreement between senior, resident, and senior vs resident pathologists. Results: Synoptic reporting detected 169 (51.4%) lesion instances initially not included in historical reports. Amongst senior pathologists, 64% of all lesions examined demonstrated fair-to-excellent agreement (Kappa ≥0.41), with only 26% of Kappas ≥0.41 amongst those examined by resident pathologists. Well-characterized lesions (e.g., chorioamnionitis) demonstrated higher agreement, with lower agreement for uncommon lesions and those previously shown to have poor consensus. Discussion: Synoptic reporting is one proposed method to address issues in placenta pathology reporting. The synoptic report generally identifies more lesions compared to the narrative report, however clinical significance remains unclear. Interobserver agreement is likely related to differential in experience. Further efforts to improve overall standardization of placenta pathology reporting are needed. [ABSTRACT FROM AUTHOR]

Histomorpholgy is one of the mainstays of acute Graft-versus-host disease (GvHD) diagnosis. However, concerns about reproducibility and the most appropriate grading system question its usefulness. Our aim was to assess histomorphological parameters and previously reported grading systems for GvHD regarding reproducibility and validity. Moreover, we propose that sum scores, derived by combining separately scored morphological parameters into a total score, might provide a simplified but equally effective means to grade GvHD. A total of 123 colon biopsies were assessed across four pathologists for intestinal GvHD using a Round-Robin test and results were correlated with clinical findings. Interobserver reproducibility was high for histological parameters that were evaluated as indicators of acute GvHD. Published grading systems were moderately reproducible (ICC 0.679–0.769) while simplified sum scores, in comparison, showed better interrater reliability (ICC 0.818–0.896). All grading systems and sum scores were associated with clinical signs of GvHD and in part with therapy response and survival. However, they were not able to stratify patients according to the clinical severity of GvHD. In a hot-spot analysis 1 crypt apoptotic body (CAB) in 10 crypts was a reasonable cut-off value for minimal diagnostic criteria of GvHD. In conclusion, histology can contribute to the diagnosis of GvHD and is reproducible. Published grading systems are able to reflect clinical findings as are simplified sum scores, which showed improved reproducibility and might be easier to handle as they are based on adding up histological parameters rather than transferring histological findings into a separate grading system. Sum scores will have to be further tested in a prospective setting. [ABSTRACT FROM AUTHOR]

Objective. To perform validation study of the E. Pola classification (2017) and to assess expert consensus on the diagnosis and treatment of infectious lesions of the spine in the national professional community. Material and Methods. A clinical and radiological database on 15 cases of infectious spondylitis, as well as the information about original article by Pola and a Russian translation of the classification and tactical tables from this article, were distributed to 408 orthopedic traumatologists, neurosurgeons and radiologists who have experience in treating patients with spinal pathology and whose data are available in the registers of the relevant professional associations of the Russian Federation. The coincidence/difference in the responses concerning the definition of lesion types and the choice of treatment tactics, as well as proposals for the use of classification were assessed. Results. Answers were obtained from 37 respondents from 11 regions of the Russian Federation. The general interobserver agreement index (Fleiss kappa) for all types of spondylodiscitis was 0.388 (95 % CI 0.374–0.402), including for lesion types: type A – 0.480 (95 % CI 0.460–0.499, type B – 0.300 (95 % CI 0.281–0.320), and type C – 0.399 (95 % CI 0.380–0.419). Agreement levels were higher among radiologists (type A – 0.486, type B – 0.484, and type C – 0.477), orthopedic traumatologists (type A – 0.474, type B – 0.380, and type C – 0.479), and specialists with clinical experience less than 10 years (type A – 0.550, type B – 0.318, and type C – 0.437). The pooled data for all 12 lesion subtypes showed general poor agreement (k = 0.247, CI 0.240–0.253), satisfactory level was found for B3.2 type (k = 0.561, CI 0.542–0.581), good agreement (k > 0.61) was achieved between orthopedic traumatologists for type B3.2 and between radiologists for B3.1 and B3.2 lesion types. Respondents refused to use basic treatment options for type A in 15.1 %, type B in 7.5 % and type C in 3.2 % of answers, while indicating the need for interventions through anterior approach in 24.7 %, 43.0 % and 46.2 %, respectively. Limitations of the classification use depending on the localization and etiology of spondylitis were noted. Authors recommended taking into account the presence of systemic inflammatory response syndrome, mandatory CT scanning, clarification of spinal instability criteria, and the addition of anterior surgical interventions to the treatment algorithm. Conclusion. The Pola classification of spondylodiscitis is currently considered the most successful for tactical algorithms and implementation in broad clinical practice for spondylodiscitis. However, at the stages of its clinical application, there is an unsatisfactory interobserver expert consensus on the types of lesions, and there are limitations related to the etiology, localization and severity of the disease. A modified classification taking into account the identified limitations and including anterior procedures in the tactical options is advisable.

Background/objectives: Accurate and uniform interpretation and reporting of metastatic prostate cancer (PCa) lesions on prostate-specific membrane antigen (PSMA) positron emission tomography/computed tomography (PET/CT) are indispensable. 18F-PSMA-1007 is increasingly used because of its favorable imaging characteristics. However, increased non-specific skeletal uptake may be an important pitfall of this radioligand. Therefore, we aimed to assess the interobserver variation in reporting skeletal 18F-PSMA-1007 uptake on PET/CT. Design/methods: In total, 33 18F-PSMA-1007 PET/CT scans of 21 patients with primary PCa and 12 patients with biochemical recurrence were included, and a total of 85 skeletal lesions were evaluated by three independent observers. The primary endpoint was the interobserver variability of the likelihood of malignancy of the skeletal lesions on both patient and lesion level (kappa analysis). Results: Observers qualified most lesions as not malignant (81–91%) and the overall mean interobserver agreement was moderate on both patient (κ: 0.54) and lesion level (κ: 0.55). In 52 lesions without corresponding CT substrate, the rating resulted in not malignant in 95–100%. Availability of additional imaging (60% of lesions) did not improve interobserver agreement (κ: 0.39 on lesion level) and resulted in unchanged rating for all observers in 78%. Conclusion: This interobserver analysis of skeletal 18F-PSMA-1007 uptake resulted in moderate agreement, in line with rates reported in literature. Importantly, the presence of non-specific skeletal uptake without CT substrate, as a potential shortcoming of 18F-PSMA-1007, did not impair interobserver agreement. [ABSTRACT FROM AUTHOR]

Background and Purpose: Intracranial collateral capacity is conducive to imply parenchymal perfusion of affected territory after acute vessel occlusion. The Tan collateral score is commonly used to assess the intracranial collateral capacity; however, this score is coarsely grained and interobserver agreement is low, which reduces prognostic value and clinical utility. We introduce and evaluate an alternative extended Tan score based on the conventional Tan scale and assess the agreement with a quantitative score. Methods: We included 100 consecutive patients with a proven acute single large vessel occlusion of the proximal anterior circulation. Collaterals were graded with the conventional and extended Tan score and an automated quantitative score. The extended Tan score is a finer 6‑scale manual score based on the conventional 4‑point Tan scale. The quantitative score is calculated by an automatic software package (StrokeViewer). Interobserver agreement of the manual scores was assessed with the weighted kappa. The Spearman correlation coefficient was calculated to determine the agreement between the manual and automated collateral scores. Results: The interobserver agreement was higher for the extended score than for the conventional score with a weighted kappa of 0.70 and 0.65, respectively. For the extended and conventional score, the Spearman correlation coefficient for the agreement with the automated score was 0.78 and 0.76, respectively. Conclusion: Because of the good interobserver agreement and good agreement with quantitative assessment, the extended collateral score is a strong candidate to improve prognostic value of collateral assessment and implementation in clinical practice. [ABSTRACT FROM AUTHOR]