Search

Undiagnosed and undertreated posterior malleolus fractures lead to early ankle instability and arthritis. A preoperative CT scan could improve the management of those fractures. This study assessed the benefits of a systematic ankle CT scanner to diagnose and manage posterior malleolus fracture. A monocentric retrospective cohort study was conducted. Sixty consecutive patients with bimalleolar fractures were operated and underwent a preoperative CT scan. The mean age was 50.0 years old (18.6 years old) with a mean body mass index of 20.3 (kg/m2) (11.4 kg/m2) and 71.7% (43/60) of women. The primary outcome was the rate of posterior malleolus fragment diagnosed on X-rays and on CT scan. Secondly, interobserver and interobserver’s agreement were compared between conventional X-rays and CT scan. Thirty-five (58.3%) posterior fragment fractures were observed on X-rays and 53 (88.3%) on the preoperative CT scan (p

Objectives To assess the reliability of the current computed tomography (CT) based technique for determining femoral anteversion, and quantify the prevalence and magnitude of side-to-side differences. Design Cross-sectional cohort study. Setting Academic trauma center. Patients We reviewed CT scans from 120 patients with bilateral full-length axial cuts of both femurs. Two hundred forty femurs with no fractures or other identifying features in their femora were included. Ten unique data sets were created to measure anteversion of the left and right sides. Main outcome measurements Intraobserver and interobserver reliability were calculated using intraclass correlation coefficients (ICC) and pooled absolute differences. The mean absolute difference between the sides was determined using a fixed-effects model. Results Interobserver reliability was high (ICC: 0.85, 95% confidence interval [CI]: 0.83-0.88). The pooled mean absolute magnitude of variation between reviewers was small at 1.6 degrees (95% CI: 1.4-1.8 degrees) per scan. The intraobserver reproducibility was high (ICC: 0.91, 95% CI: 0.88-0.93) with a mean error of 2.7 degrees (95% CI: 2.2-3.1 degrees) per repeat viewing of the same scan by the same person. The magnitude of side-to-side variation was 2.0 degrees (95% CI: 1.5-2.6 degrees). Twenty-one subjects (18%, 95% CI: 12-25%) had a mean side-to-side calculated femoral anteversion difference of ≥10 degrees, while 6 (5%, 95% CI: 2-10) subjects had a calculated mean side-to-side difference ≥15 degrees. Conclusions CT based femoral anteversion measurement techniques demonstrate good precision. Only 1 in 20 patients had side-to-side differences of 15 degrees or more. Level of evidence Therapeutic Level III. See Instructions for Authors for a complete description of levels of evidence.

INTRODUCTION To extra validate and evaluate the reproducibility of a commercial deep convolutional neural network (DCNN) algorithm for pulmonary nodules on chest radiographs (CRs) and to compare its performance with radiologists. METHODS This retrospective study enrolled 434 CRs (normal to abnormal ratio, 246:188) from 378 patients that visited a tertiary hospital. DCNN performance was compared with two radiology residents and two thoracic radiologists. Abnormality assessment (using the area under the receiver operating ch3cteristics (AUROC)) and nodule detection (using jackknife alternative free-response ROC (JAFROC)) were compared among three groups (DCNN only, radiologist without DCNN and radiologist with DCNN). A subset of 56 paired cases, having two CRs taken within a 7-day period, were assessed for intraobserver reproducibility using the intraclass correlation coefficient. Independent characteristics of pulmonary nodules detected by DCNN were assessed by multiple logistic regression analysis. RESULTS The AUROC for abnormality detection for the three groups were 0.87, 0.93 and 0.96, respectively (P

Background Most patients with spinal tumors suffer no symptoms or have mild symptoms, but about 14% of patients have refractory pain caused by mechanical instability, or symptoms of spinal cord damage caused by epidural spinal cord compression. The Spinal Instability Neoplastic Score (SINS) and Kostuik classification are commonly used to evaluate spinal stability, and help to make a more detailed operation plan. The objectives of this study are to evaluate the reliability and reproducibility of the SINS and Kostuik classification, and to explore their clinical application value. Methods All 80 patients with spinal tumors were enrolled. Six spine surgeons who have certain clinical experience were selected. Patients were scored according to the SINS scoring system and classification was determined according to the Kostuik system. We used Fleiss and Cohen κ values to check the coefficient consistency for multifactors. We used Cohen κ value to check the interobserver reliability and intraobserver reproducibility. After 12 weeks, we repeated the analysis. Results The interobserver reliability and intraobserver reproducibility of the SINS scoring system were near perfect with values of 0.831 and 0.874, respectively. The interobserver reliability and intraobserver reproducibility of the Kostuik classification system were moderate with values of 0.505 and 0.595, respectively. Conclusions Compared with the Kostuik classification system, the SINS scoring system has better interobserver reliability and intraobserver reproducibility, which can be widely used in clinical practice and has great significance in the decision-making of spinal tumor treatment. Although the Kostuik classification system is often used in clinical practice, it shows inferior reliability and reproducibility in our study.

Aims: To analyse the intra- and interobserver variability of two elastographic methods of quantification available on the same machine, the technical factors that may influence variability as well as the intra- and interobserver variability for the same indices between two different ultrasound machines in an in vitro experimental setting.Material and methods: Three different types of silicone experimental devices (ED) were conceived for the purpose of this study. Two observers performed repeated measurements on two ultrasound machines. Strain elastography, with strain ratio determination between the ED was performed on both machines. Shear wave ratio was also assessed. The data obtained were used to calculate intra- and interobservervariability. Reproducibility was assessed in relation to the size of the elastographic region of interest (ROI) and to the difference in stiffness between the ED, through the value of the ICCs (Intraclass Correlation Coefficient).Results: Strain ratio had high inter- and intraobserver reproducibility, regardless of the machine used, on a large number of determinations.The choice of a small ROI diameter (5 mm) over a large ROI diameter (15mm) increased reproducibility (ICC = 0.87 vs 0.78, p=0.000). It is observed that, by Shear Wave Elastography, only when analysing structures with a large difference in hardness, significance is obtained in terms of interobserver reproducibility (ICC = 0.75, p=0.000).Conclusions: On a large number of determinations, both techniques are inter- and intraobserver reproducible. It is preferable to opt for a smaller ROI diameter in order to increase interobserver reproducibility. SWE Ratio provides significant reproducibility only when analysing structureswith large difference in hardness.

Objective: To evaluate the intra and interobserver variation in the Sanders classification of calcaneal fractures and the clinical-radiological correlation of postoperative X-ray images and computed tomography (CT) scans. Methods: We sent pre- and postoperative images in the form of a questionnaire to 18 foot and ankle surgeons with varying experience and examined evaluations of the postoperative reduction and Sanders classification quality criteria of 12 calcaneal fractures. The kappa (Ƙ) values were calculated and compared to those in the literature, and the quality of the reduction was compared to the patient's American Orthopaedic Foot and Ankle Society Ankle-Hindfoot Scale (AOFAS-AHS) score. Results: The mean intraobserver Ƙ of the Sanders classification was 0.49. Disregarding the subclasses, the intraobserver Ƙ was 0.55, and when type III and IV fractures were grouped, the intraobserver Ƙ was 0.57. The interobserver Ƙ values in these same three conditions were 0.22, 0.20, and 0.21, respectively. We also observed that the group of less experienced surgeons showed better intraobserver Ƙ values than the more experienced surgeons. In the analysis of the reduction quality based on X-ray images and the AOFAS-AHS score of the patient, we found a value of p=0.043. Conclusion: The Ƙ values were consistent with previous studies, confirming moderate intraobserver reproducibility and acceptable interobserver reliability. We also confirmed the presence of a significant relationship between the reduction quality based on X-ray images and the AOFAS-AHS score of the patient. Level of Evidence III; Diagnostic Studies; Nonconsecutive patients, no uniformly applied reference gold standard.

Objective: Many recent studies are pointing out the heterogeneity between pathologists in the classification of malignant pleural mesotheliomas. Besides, they reported the prognostic impact of classifying epithelioid mesotheliomas according to the predominant architectural features and the nuclear grade. The authors assessed the interobserver and the intraobserver agreement of subtyping mesotheliomas between 2 pathologists used to thoracic pathology. Material and Method: The observers reviewed all the slides of the malignant pleural mesotheliomas diagnosed during the period ranging from 2004 to 2017. The Cohen Kappa was performed in order to evaluate the agreement between both observers into classifying mesotheliomas, subtyping and grading epithelioid mesotheliomas. Two rounds of examination were planned with a delay period of one month. After the first round, the reviewers discussed the different difficulties and challenges they faced. All the statistic tests were performed using the SPSS software version 12.0. Results: After the first round, a fair agreement between both observers was reported. After the second round, an improvement of the concordance rate with a good agreement in subtyping epithelioid mesotheliomas was noticed. Concerning the grading of mesotheliomas, the interobserver agreement was poor even after the second round examination. The intraobserver reproducibility of epithelioid mesothelioma subtyping was fair or moderate for both reviewers. The intraobserver agreement was poor concerning the grading of epithelioid mesothelioma. Conclusion: Integrating subtyping and grading of epithelioid mesotheliomas into a new classification necessitates an important training of the pathologists. The architectural features' definitions have to be clarified in order to avoid using own subjective opinions and habits by pathologists.

Purpose: The aim of this study was to evaluate the intraobserver reproducibility of demarcation line depth measurement in keratoconic patients after epithelium-off corneal collagen cross linking and assess the interobserver variability/agreement among examiners of various experience levels. Methods: 56 eyes of 56 patients undergoing corneal collagen cross linking for progressive keratoconus were enrolled. After 4 weeks, all patients underwent an anterior segment optical coherence tomography (AS-OCT; CASIA SS-1000; Tomey, Nagoya, Japan) in the cross-linked eye by four masked examiners (two medical students (S1 and S2) and two corneal fellows (F1 and F2)) in order to identify and measure the demarcation line depth in experienced and non-experienced users. The intraclass correlation coefficient and the coefficient of variation were calculated. Agreement between raters was evaluated using Bland–Altman plots, intraclass correlation coefficient and weighted-kappa statistics comparing raters in pairs. Results: The average demarcation line depth of all measurements was 254.34 ± 72.3 μm, varying from 84 to 459 μm. The intraclass correlation coefficient evaluating the reproducibility of measurements for F1 was 0.9379 (95% confidence interval (CI) =0.9035–0.9619), for the second (F2), it was 0.9837 (95% confidence interval = 0.9743–0.9901), while intraclass correlation coefficient between medical students was calculated 0.844. The overall intraclass correlation coefficient among all four observers was 0.8706 (95% confidence interval = 0.8061–0.9185). The coefficient of variation for repeated measurements was 5.981 μm (95% confidence interval = 3.966–7.471) and 3.312 μm (95% confidence interval = 2.468–3.981) for F1 and F2 raters, respectively. The percentage of demarcation line detection was 90.32%. Conclusion: The reproducibility of demarcation line measures although very good (intraclass correlation coefficient > 0.9), yielded a difference between the two experienced raters. Furthermore, the novice raters did not reach an excellent level of agreement with the expert ones showing greater variability in their recordings.

BACKGROUND: QRS narrowing after CRT is a predictor of patient outcome. Further narrowing can be obtained by interventricular pacing delay (VVd) optimization, raising interest to inter and intraobserver variation in manual measurements of QRS duration.METHODS: (a) Variation in intrinsic rhythm QRS duration in CRT patients with LBBB: In 40 intrinsic 12-lead ECGs, six observers measured QRS duration defined as widest QRS in any lead. In 20 of these ECGs, two observers repeated the measurements. (b) Variation in paced QRS duration at different VVd settings and agreement in selecting the narrowest QRS: In 20 CRT patients, five paced ECGs were recorded at different VVds. The most frequently selected VVd(s) estimated to cause the narrowest QRS in each patient defined the optimal VVd. Two observers repeated the measurements and VVd selections.RESULTS: Absolute interobserver difference in measured QRS duration in intrinsic rhythm ECGs was mean 2 ms, range (-40; 40 ms), mean limits of agreement (LoA): -21; 25 ms. Absolute interobserver difference in measured QRS duration in paced ECGs was mean 3 ms, range (-50; 60 ms), mean LoA: -20; 27 ms. There was no difference in LoA between intrinsic and paced QRS duration (lower limit p = 0.68; upper limit p = 0.44). The optimal VVd was included in 17/20 (85%) of the VVd selections by six observers. Interobserver variation was comparable with the intraobserver variation.CONCLUSIONS: Interobserver variation and intraobserver variation in manually measured paced and intrinsic rhythm QRS duration are clinically acceptable and comparable in a cohort of CRT patients. Inter and intraobserver reproducibility for selecting the optimal VVd is good and warrants manual VVd optimization for QRS narrowing in CRT.

Background: The purpose of this study is to test the hypothesis of the new classification system of distal end radius fractures (Barzullah working classification) proposed by one of the author in a prospective cohort study, among the orthopaedic residents. Methods: The initial post-injury radiographs of 300 patients with distal radius fractures in a tertiary centre were classified by two junior residents (JR1 and JR2) and two senior residents (SR1 and SR2) in the emergency department over a period of two years. The collected data was analysed statistically by using Cohan's kappa for measuring Intraobserver reproducibility and Fleiss kappa for measuring Interobserver agreement. Results: The mean kappa value for Interobserver agreement was 0.53 (moderate agreement) at the end of one year and the mean kappa value at the end of study period was 0.64 (substantial agreement). The mean kappa value for Intraobserver reproducibility of JR1 was 0.45 (moderate agreement), JR2 was 0.39 (fair agreement), SR1 was 0.62 (substantial agreement) and SR2 was 0.67 (substantial agreement). Conclusions: Barzullah working classification of distal radius fractures presented in this study has good characteristics compared to those of already studied classification systems among orthopaedic residents.

The aim of this study was to assess inter- and intraobserver agreement of the traditional systems (Ruedi-Allgower, AO [Arbeitsgemeinschaft fur Osteosynthesefragen], and Topliss) and the newly proposed Leonetti classification system of pilon fractures. We studied all patients at our center who underwent pilon fracture surgery over a 2-year period: 68 patients (70 legs) were included. Four observers independently classified each pilon fracture according to the Ruedi-Allgower, AO, Topliss, and Leonetti systems by evaluating radiographs and computed tomography images on 2 occasions. The inter- and intraobserver agreements were calculated using the Fleiss kappa test. Interobserver reliability was good for AO types (A, B, and C) and Ruedi-Allgower (κ = 0.71 and 0.61, respectively), whereas the interobserver reliability was moderate for AO groups (A1, A2, A3, B1, B2, B3, C1, C2, and C3), Topliss families, Topliss subfamilies, Leonetti types, and Leonetti subtypes. Intraobserver reproducibility was excellent for the Ruedi-Allgower classification, AO types, and Topliss families and good for AO groups, Topliss subfamilies, and Leonetti types and subtypes. Ruedi-Allgower and AO classification systems are the most reliable among those currently used for pilon fractures, but with lower agreement at the AO group level. The use of Topliss and Leonetti classification systems is not recommended because of less favorable results.

BACKGROUND: Traditionally, distal radius fractures (DRFs) have been described using eponyms, e.g. Colles, Smith, Barton, Chauffeur. During the last half of the 20th century several classification systems for DRF have emerged. We evaluated the inter- and intra-observer agreement of the AO/OTA, Frykman and Older classification systems.METHODS: Four observers, an intern, an orthopaedic registrar, an orthopaedic consultant and a radiology consultant, independently evaluated DRF radiograms and classified the fractures according to the AO/OTA, Frykman and Older classification systems. After an interval of 6 months, radiograms of 30 randomly chosen patients were re-evaluated by the same observers.RESULTS: Radiograms of 573 DRF patients were evaluated in the study. The inter-observer reliability of the AO/OTA fracture types (A, B and C) was 'weak' (kappa = 0.45). The agreement dropped to 'minimal' (kappa = 0.24) regarding the AO/OTA groups (A2, A3, B1, B2, B3, C1, C2 and C3). The reliability of the Frykman classification system was 'weak' (kappa = 0.41), and we observed the lowest inter-observer reliability for the Older classification system (kappa = 0.10). The kappa values for the intra-observer reproducibility of the AO/OTA fracture types (A, B and C) ranged from 0.58 to 0.87. For the AO/OTA groups (A2, A3, B1, B2, B3, C1, C2 and C3) the reproducibility was lower ranging from 'minimal' to 'weak'. The intra-observer reproducibility of the Frykman system was 'weak' to 'moderate' and even worse for the Older classification system.CONCLUSION: Based on these findings the AO/OTA classification system seems to be most reliable for routine use, however, with lower kappa values concerning the agreement for the groups. The Frykman and Older classification systems cannot be recommended because of less convincing results.

Objective the principal objective of this study was to assess the quality of blood loss estimates by midwives and student midwives. The secondary objectives were: to assess the intraobserver agreement of visual blood estimates and the rate of underestimation of blood loss by participants, and to estimate the sensitivity, specificity, and negative likelihood ratio of these estimates for clinically pertinent blood losses (≥ 500mL and ≥ 1000mL). Design multicenter cross-sectional study. Setting thirty-three French maternity units and 35 French midwifery schools participated in this study. Participants volunteer French midwifery students ( n = 463) and practicing midwives ( n = 578). Intervention an online survey showed 16 randomly ordered photographs of 8 different simulated blood quantities (100, 150, 200, 300, 500, 850, 1000, and 1500mL) with a reference 50-mL image in each photo and asked participants to estimate the blood loss. The visual blood loss estimates were compared with Fisher's exact test. Intraobserver agreement for these estimates was assessed with a weighted kappa coefficient, and the negative predictive values (probability of no hemorrhage when visual estimate was negative) were calculated from prevalence rates in the literature. Findings of the 16,656 estimates obtained, 34.1% were accurate, 37.2% underestimated the quantity presented, and 28.7% overestimated it. Analyses of the intraobserver reproducibility between the two estimates of the same photograph showed that agreement was highest (weighted kappa ≥ 0.8) for the highest values (1000mL, 1500mL). For each volume considered, students underestimated blood loss more frequently than midwives. In both groups, the negative predictive values regarding postpartum hemorrhage (PPH) diagnosis (severe or not) were greater than 98%. Key conclusions and implications for practice student midwives tended to underestimate the quantity of blood loss more frequently than the midwives. Postpartum hemorrhage (≥ 500mL) was always identified, but severe postpartum hemorrhage (≥ 1000mL) was identified in fewer than half the cases. These results should be taken into account in training both student midwives and practicing professionals.

To measure the inter- and intraobserver repeatability and reproducibility of choroidal thickness measurements taken by the enhanced depth imaging of spectral-domain optical coherence tomography (EDI-OCT) in randomly selected subjects using two different protocols. Twenty subjects of the Thessaloniki Eye Study database were randomly selected. The participants underwent EDI-OCT, and the choroidal thickness was measured on EDI images using two different protocols. All images were assessed by two examiners independently in two sessions in different days. The interobserver intraclass correlation coefficient (ICC) for average choroidal thickness was 0.944. The average ICC for central, Cmin, and Cmax choroidal thickness was 0.899, 0.863, and 0.955, respectively. The interobserver ICC for average choroidal volume was 0.932. Intraobserver repeatability ICC for grader 1 ranged between 0.925 and 0.9720 and for grader 2 between 0.913 and 0.994. Choroidal thickness measurements by EDI-OCT showed a high inter- and intraobserver reproducibility.

Reliable assessment of islet viability, mass, and purity must be met prior to transplanting an islet preparation into patients with type 1 diabetes. The standard method for quantifying human islet preparations is by direct microscopic analysis of dithizone-stained islet samples, but this technique may be susceptible to inter-/intraobserver variability, which may induce false positive/negative islet counts. Here we describe a simple, reliable, automated digital image analysis (ADIA) technique for accurately quantifying islets into total islet number, islet equivalent number (IEQ), and islet purity before islet transplantation. Islets were isolated and purified from n = 42 human pancreata according to the automated method of Ricordi et al. For each preparation, three islet samples were stained with dithizone and expressed as IEQ number. Islets were analyzed manually by microscopy or automatically quantified using Nikon's inverted Eclipse Ti microscope with built-in NIS-Elements Advanced Research (AR) software. The AIDA method significantly enhanced the number of islet preparations eligible for engraftment compared to the standard manual method ( p < 0.001). Comparisons of individual methods showed good correlations between mean values of IEQ number ( r2 = 0.91) and total islet number ( r2 = 0.88) and thus increased to r2 = 0.93 when islet surface area was estimated comparatively with IEQ number. The ADIA method showed very high intraobserver reproducibility compared to the standard manual method ( p < 0.001). However, islet purity was routinely estimated as significantly higher with the manual method versus the ADIA method ( p < 0.001). The ADIA method also detected small islets between 10 and 50 μm in size. Automated digital image analysis utilizing the Nikon Instruments software is an unbiased, simple, and reliable teaching tool to comprehensively assess the individual size of each islet cell preparation prior to transplantation. Implementation of this technology to improve engraftment may help to advance the therapeutic efficacy and accessibility of islet transplantation across centers.

Purpose To prospectively evaluate the short-term reproducibility of intravoxel incoherent motion (IVIM) parameters and apparent diffusion coefficient (ADC) in lung cancer patients. Materials and methods In all, 50 patients (50 lesions) underwent free-breathing diffusion-weighted imaging (DWI) (b = 0, 300, 800 s/mm2 ) and IVIM (10 b-values, 0-1000 s/mm2 ) scans twice (0.5-1-hour interval) at 3T. Regions of interests (ROIs) were drawn on ADC maps and IVIM images to derive the mean ADC value and IVIM parameters D, D*, and f. Intra- and interobserver, test-retest reproducibility were assessed with intraclass correlation coefficients (ICCs), within coefficient-of-variations (WCVs), and Bland-Altman analysis. The effects of type, size, and location of lung lesions were compared with WCVs. Results D and ADC showed good intraobserver reproducibility and interobserver agreement, while D* and f showed relatively larger variability (WCV 20.89-34.97%). The test-retest reproducibility of D and ADC were good (ICC 0.763-0.837; WCV 11.12-12.55%), while those of D* and f were relatively poor (ICC 0.604-0.842; WCV 36.54-72.62%). D and ADC had decreased reproducibility for lesions 2 cm (WCV 42.64%). D* had even worse reproducibility in peripheral lung cancers (WCV 84.11%) and lesions in the lower lung zones (WCV 80.84%). Conclusion If the change in ADC, D, D*, and f values is less than ∼31%, 34%, 170%, and 130%, respectively, it may be caused by measurement error. The type, size, and location of lung lesions have an effect on measurement errors. Level of evidence 1 Technical Efficacy Stage: 1 J. Magn. Reson. Imaging 2018;47:1003-1012.

Background: It has been shown that cam deformities are located at a more anterosuperior location than was previously described. Purpose: To establish, in a large group of asymptomatic participants, the normative range of the alpha angle in the anterosuperior location in both the oblique axial and radial views of magnetic resonance imaging (MRI). Study Design: Cross-sectional study; Level of evidence, 3. Methods: In 197 asymptomatic participants (394 asymptomatic hips) with a mean age of 29.4 years (range, 21.4-50.6 years), T1-weighted MRI scans were studied. The anterosuperior alpha angle measurement was performed by 2 observers using a previously described methodology and also using the radial view. The intraclass correlation coefficient (ICC) was determined for interobserver and intraobserver reliability. Descriptive statistics, the Student t test, correlation studies, and the Bland-Altman technique were used for data analysis. Results: The ICC for interobserver and intraobserver reproducibility was 0.74 (good agreement) and 0.84 (very good agreement), respectively. Anterosuperiorly, the mean (±SD) alpha angles in the oblique axial and radial views were 45.11° ± 8.52° and 50.30° ± 7.91°, respectively ( P < .0001). The upper limits of the 95% reference interval for the oblique axial and radial views were 63° and 66°, respectively. In the oblique axial view, the mean (±SD) alpha angle for male participants was 48.3° ± 7.5° compared with 42.6° ± 6.2° for female participants ( P < .0001), and in the radial view, it was 53.0° ± 7.1° compared with 48.1° ± 5.6°, respectively ( P < .0001). Linear regression analysis demonstrated an insignificant relationship between age and alpha angle, regardless of the imaging plane ( r2 = 0.06). Conclusion: We suggest using a higher threshold of 63° (in the oblique axial view) and 66° (in the radial view) at the 1:30 clockface position for the diagnosis of a cam-type deformity. This is significantly higher than 50° to 55° at the 3-o’clock position traditionally used based on the oblique axial view that has been initially described.

While neuropathy is common in the elderly, nerve conduction (NC) reproducibility in older adults is not well-established. We sought to evaluate intraobserver reproducibility of peroneal motor NC measures in a diverse sample of older adults.We measured peroneal motor NC amplitude and velocity in a subset of participants (mean age=82.9±2.7, n=62, 50% female, 51.6% black, 35.5% DM) in the Health, Aging, and Body Composition Study. Using coefficients of variation (CVs), intraclass correlation coefficients (ICCs), and Bland Altman Plots, we compared two sets of measurements taken by the same examiner hours apart on the same day.Low CVs (2.15-4.24%) and moderate to high ICCs (0.75-0.99) were observed. No systematic variation was found across measures. Despite small numbers in some subgroups, we found no differences in reproducibility by diabetes, race or study site.NC measures have moderate to high intraobsever reproducibility in older adults and are not affected by diabetes, race, or gender.These data provide evidence to support use of these measures in aging research.

WOS: 000324152600003, PubMed ID: 23748613, Objective: The aim of this study was to evaluate the interobserver reliability and intraobserver reproducibility of the Universal, AO, Fernandez and Frykman classifications for distal radius fractures. Methods: Fifty standard sets of posteroanterior and lateral roentgenograms of displaced distal radius fractures were classified two times by two groups of evaluators at 2-month intervals. The first group consisted of 10 orthopedic surgeons with a minimum of 5 years of experience. The second group consisted of 10 orthopedic residents in their first two years of practice. Interobserver reliability and intraobserver reproducibility were assessed using Cohen's kappa test. Results: None of the classifications achieved good - very good reliability levels. The Fernandez classification had a moderate and the others had a fair interobserver agreement kappa coefficient. All classifications had fair kappa intraobserver agreement although the Frykman and Fernandez classifications had better results. Conclusion: None of the classification systems were superior in terms of reliability and reproducibility. The reliability and reproducibility rates of all four classifications were insufficient.

OBJECTIVE This study aimed to assess which region of interest results in the best intraobserver reproducibility of mebrofenin clearance rate (MCR) processing. METHODS Mebrofenin clearance rate was calculated according to Ekman's formalism. Processing methods included smaller left ventricular (LV) versus larger regions, nearly the whole heart (WH), which were applied to either anterior (ANT) or geometric mean (GEO) data. Each variation was processed twice by an expert operator, and Pearson linear correlation (r) was used to test for reproducibility. RESULTS Studies from 50 patients (16 women) were available for processing. Mean (SD) for age, model for end-stage liver disease, and Child scores were 54 (10) years (range, 23-70 y), 13.1 (4.9) (range, 6-30), and 7.8 (2.1) (range, 5-14), respectively. The linear correlation equations (r, significance) between the 2 processing takes were y=0.34x+4.3 (r=0.5442, P

The objective of this study was to evaluate interobserver agreement and intraobserver reproducibility in thyroid ultrasound elastography.Fifty-six patients (56 nodules) were enrolled for this prospective study between December 2010 and March 2011. All patients were scheduled for thyroid surgery because their nodules had been found by fine-needle aspiration biopsies to be malignant, suspicious for malignancy, or follicular/Hürthle cell neoplasm. On each patient, three endocrinologists performed ultrasound elastography examinations using a commercial ultrasound machine. No external compression with the transducer was applied because pulsation from the carotid artery was used. Each endocrinologist repeated an elastography examination on the same thyroid nodule. An elasticity contrast index, which quantifies the local strain contrast within a nodule, was interactively determined after a nodule's boundary was delineated by the endocrinologist. A large elasticity contrast index value indicates an increased probability of the nodule being malignant. Pearson correlation coefficient was used to evaluate the interobserver and intraobserver agreement in the measured elasticity contrast index values, and p values0.05 were considered statistically significant.Significant interobserver and intraobserver agreement was found in thyroid ultrasound elastography. Pearson correlation coefficients between two observers were 0.79 (observers 1 and 2, p0.01), 0.77 (observers 1 and 3, p0.01), and 0.73 (observers 2 and 3, p0.01). Pearson correlation coefficients for intraobserver agreement were 0.87 (p0.01), 0.73 (p0.01), and 0.84 (p0.01) for observers 1, 2 and 3, respectively.Good interobserver and intraobserver agreement exists in thyroid ultrasound elastography. Compared with external compression elastography, we found that thyroid elastography with intrinsic compression can produce reliable results.

Image analysis of the HER2 immunohistochemical (IHC) stain can help determine which breast cancer patients may benefit from HER2-targeted therapy. We studied the concordance of HER2 IHC and fluorescence in situ hybridization (FISH) as well as reproducibility of surgical pathologist (SP) and cytotechnologist (CT) interpretations using manual and image analysis methodologies on 154 IHC cases. Concordances with FISH were good for IHC negative (0, 1+) cases (range, 97%-100%) and positive (3+) cases (range, 87%-100%). Image analysis had fewer equivocal (2+) results (10.4%) than CT (14.9%) and SP (16.2%) manual methods, with higher concordances to FISH (31%, 26%, and 20% for image analysis, CT manual, and SP manual, respectively). CT manual (κ = 0.747) and image analysis (κ = 0.779) methods had better interobserver reproducibility than SP manual (κ = 0.697). CT image analysis had better intraobserver reproducibility (κ = 0.882) than CT (κ = 0.828) and SP (κ = 0.766) manual methods. HER2 IHC analysis performed by image analysis can produce accurate results with improved reproducibility.

Objective: To report the agreement between gray-scale intravascular ultrasound (GS-IVUS) and optical coherence tomography (OCT) in assessing the bioresorbable vascular scaffolds (BVS) structures and their respective reproducibility. Background: BVS are composed of an erodible polymer. Ultrasound and light signals backscattered from polymeric material differs from metallic stents using GS-IVUS and OCT. Methods: Forty-five patients included in the ABSORB trial were treated with a 3.0 x 18 mm BVS and imaged with GS-IVUS 20 MHz and OCT post-implantation. Qualitative (ISA, side-branch struts, protrusion, and dissections) and quantitative (number of struts, lumen, and scaffold area) measurements were assessed by two investigators. The agreement and the inter- and intraobserver reproducibility were investigated using the kappa (?) and the interclass correlation coefficient (ICC). Results: GS-IVUS and OCT agreement was predominantly poor at a lesion, frame, and strut level analysis (? and ICC 0.75) except for the assessment of tissue protrusion (? and ICC between 0.47 and 0.94). GS-IVUS reproducibility was poormoderate (ICC = 0.5) in assessing the number of struts but excellent with OCT (ICC > 0.85). The reproducibility to assess lumen and scaffold areas was excellent using both techniques (ICC > 0.85). Conclusions: GS-IVUS has a poor capacity to detect qualitative findings post-BVS implantation and its reproducibility is low compared with OCT. The use of GS-IVUS should be limited when assessing lumen and scaffold areas. (C) 2011 Wiley Periodicals, Inc.

BACKGROUND AND PURPOSE: QUASAR is a particular application of the ASL method and facilitates the user-independent quantification of brain perfusion. The purpose of this study was to assess the intermodality agreement of TBF measurements obtained with ASL and DSC MR imaging and the inter- and intraobserver reproducibility of glioma TBF measurements acquired by ASL at 3T. MATERIALS AND METHODS: Two observers independently measured TBF in 24 patients with histologically proved glioma. ASL MR imaging with QUASAR and DSC MR imaging were performed on 3T scanners. The observers placed 5 regions of interest in the solid tumor on rCBF maps derived from ASL and DSC MR images and 1 region of interest in the contralateral brain and recorded the measured values. Maximum and average sTBF values were calculated. Intermodality and intra- and interobsever agreement were determined by using 95% Bland-Altman limits of agreement and ICCs. RESULTS: The intermodality agreement for maximum sTBF was good to excellent on DSC and ASL images; ICCs ranged from 0.718 to 0.884. The 95% limits of agreement ranged from 59.2% to 65.4% of the mean. ICCs for intra- and interobserver agreement for maximum sTBF ranged from 0.843 to 0.850 and from 0.626 to 0.665, respectively. The reproducibility of maximum sTBF measurements obtained by methods was similar. CONCLUSIONS: In the evaluation of sTBF in gliomas, ASL with QUASAR at 3T yielded measurements and reproducibility similar to those of DSC perfusion MR imaging.

The objective of this study was to quantitatively evaluate the correlation between left and right masticatory muscle volumes in normal subjects.Contiguous 1 mm MR scans were obtained of 12 normal adult subjects aged 20-25 years using a Siemens 1.5 T MR scanner. The volumes of the human masticatory muscles (masseter, lateral and medial pterygoid) were measured from the scans using our previously proposed method. To test for inter- and intraobserver reproducibility, measurements were performed by two users on two separate occasions, with a span of 2 weeks between them and with the previous results blinded. Good inter- and intraobserver reproducibility was achieved in our study.The mean volumes for left and right masseters, and lateral and medial pterygoids were 29.54 cm3, 29.65 cm3, 9.47 cm3, 10.23 cm3, 8.69 cm3 and 8.92 cm3, respectively. The Pearson correlation coefficients between the volumes of the left and right masseters, lateral and medial pterygoids are 0.969, 0.906 and 0.924, respectively.The computed volumes of the masticatory muscles show a strong correlation between the volumes of the left and right masseters, and lateral and medial pterygoids for normal adult subjects. The total masticatory muscle volume on the left and right sides of normal subjects is similar.

The aim of this study was to investigate the efficacy of a dedicated software tool for automated and semiautomated volume measurement in contrast-enhanced (CE) magnetic resonance mammography (MRM). Ninety-six breast lesions with histopathological workup (27 benign, 69 malignant) were re-evaluated by different volume measurement techniques. Volumes of all lesions were extracted automatically (AVM) and semiautomatically (SAVM) from CE 3D MRM and compared with manual 3D contour segmentation (manual volume measurement, MVM, reference measurement technique) and volume estimates based on maximum diameter measurement (MDM). Compared with MVM as reference method MDM, AVM and SAVM underestimated lesion volumes by 63.8%, 30.9% and 21.5%, respectively, with significantly different accuracy for benign (102.4%, 18.4% and 11.4%) and malignant (54.9%, 33.0% and 23.1%) lesions (p0.05). Inter- and intraobserver reproducibility was best for AVM (mean difference +/- 2SD, 1.0 +/- 9.7% and 1.8 +/- 12.1%) followed by SAVM (4.3 +/- 25.7% and 4.3 +/- 7.9%), MVM (2.3 +/- 38.2% and 8.6 +/- 31.8%) and MDM (33.9 +/- 128.4% and 9.3 +/- 55.9%). SAVM is more accurate for volume assessment of breast lesions than MDM and AVM. Volume measurement is less accurate for malignant than benign lesions.

Objective: To establish optimal exposure parameters for lateral oblique radiographs of rat mandibles using an intraoral X-ray machine. Methods: A positioning apparatus, previously tested for its reproducibility, was used to obtain radiographs of four heads of formaldehyde-preserved Wistar rats. Radiographs were exposed at 50 kV and 8 mA using four size 2 films (Insight, Ektaspeed Plus, Ultraspeed and D-Speed; Eastman Kodak Co., Rochester, NY), two focal distances (30 cm and 60 cm) and seven exposure times (0.6 s, 0.7 s, 0.8 s, 1.0 s, 1.5 s, 2.0 s and 2.5 s). The radiographs were evaluated by two examiners and scored for image quality: 1, very poor; 2, poor; 3, fair; 4, good; and 5, excellent. The evaluations were repeated at 30 days. Results: Intraobserver reproducibility was substantial (kappa 5 0.798 and 0.667). Also, the two examiners showed substantial agreement (kappa 5 0.726). There was a significant difference (a 5 1%) between the scores for the films under study. At a 30 cm distance, Espeed films had mean scores of 4 and 5 at 0.8 s and 1 s exposure times, and D-speed films, at 1.5 s, 2 s and 2.5 s exposure times. At a 60 cm distance, the best results were found for Espeed films at 2.0 s and 2.5 s exposure times. Conclusion: The films under study did not show any significant difference in the quality of rat mandible images as long as exposure times were adequate to their sensitivity and focal distance.

We investigated the intraobserver reproducibility of myocardial blood flow (MBF) measurements with PET at rest and during cold pressor test (CPT), and the interobserver agreement.Twenty normal volunteers were studied. Using (13)N-ammonia, MBF was measured at rest and during CPT and measurement was repeated in a 1-day session (short-term reproducibility; SR). After a follow-up of 2 weeks, MBF was measured again at rest and during CPT and compared with the initial baseline measurement (long-term reproducibility; LR). In addition, adenosine-induced hyperemic MBF increases were assessed.Assessment of the SR did not show a significant absolute difference in MBF at rest, MBF during CPT or the endothelium-related change in MBF from rest to CPT (DeltaMBF) (0.09 +/- 0.10, 0.11 +/- 0.09, and 0.08 +/- 0.05 ml/g/min; p = NS), and they were linearly correlated (r = 0.72, r = 0.76 and r = 0.84; p0.0001). Corresponding values for standard error of the estimate (SEE), as indicative for the range of MBF measurement error, were 0.14, 0.14, and 0.09 ml/g/min. The LR yielded relatively higher but non-significant absolute differences in the MBF at rest, MBF during CPT and DeltaMBF (0.10 +/- 0.10, 0.14 +/- 0.10, and 0.19 +/- 0.10 ml/g/min; p = NS), and paired MBFs significantly correlated (r = 0.75, r = 0.71, and r = 0.60; p0.001). Corresponding SEEs were 0.13, 0.15, and 0.16 ml/g/min. The interobserver analysis yielded a high correlation for MBF at rest, MBF during CPT, and hyperemic MBF (r = 0.96, SEE=0.04; r = 0.78, SEE=0.11; and r = 0.87, SEE=0.28; p0.0001, respectively), and also a good interobserver correlation for DeltaMBF (r = 0.62, SEE=0.09; p0.003).Short- and long-term MBF responses to CPT, as an index for endothelium-related coronary vasomotion, can be measured reproducibly with (13)N-ammonia PET. In addition, the high interobserver reproducibility for repeat analysis of MBF values suggests the measurements to be largely operator independent.

In this study, gender differences in the anterior cruciate ligament (ACL) were assessed with high resolution MRI. Using a quadrature extremity coil at 1.5T, volumes of the separate bundles of the ACL (anteromedial [AMB] and posterolateral [PLB]) were measured with shaded surface three-dimensional (3D) reconstruction in 63 knees (33 male, 30 female). Bundle volumes were measured from consecutive fat-suppressed fast spin-echo proton-density coronal MR images and intraobserver reproducibility was recorded. The data were divided into subgroups based on gender, age, height, weight, and body mass index (BMI) for statistical analysis. Results of the study revealed the mean ACL volume to be significantly different for males (1.07 cc) and females (0.77 cc) (P = 0.0025), yet when adjusting for body height differences, these were no longer significantly different. Mean AMB volume was smaller than the PLB volume for females (0.33 cc vs. 0.44 cc; P < 0.0001) and males (0.49 cc vs. 0.58 cc; P < 0.0001). Correlation coefficients were highest for height (r = 0.597) and weight (r = 0.5371) and regression analysis revealed height to be the most significant factor affecting ACL volume. Intraobserver measurements were reproducible (r = 0.90). From this data, we conclude that gender differences in ACL volume are present, but may be accounted for by height differences between males and females.

OBJECTIVES: We sought to assess with magnetic resonance imaging (MRI) the influence of strain type and gender on left ventricular (LV) global function and mass in 3 inbred mouse strains with a normal cardiac phenotype. MATERIALS AND METHODS: A total of 30 mice from 3 inbred strains (C57BL/6, 29S2/SvPasCrl, and C3HFeJ) were studied on a 7.05-T MR scanner using ECG-triggered cine sequences. LV mass and volumes were calculated with inclusion and exclusion of papillary muscles (PMs) in the LV wall. RESULTS: Significant differences were found with strain and gender (P < 0.001), with strain-effect but no gender-effect for ejection fraction (EF), end-diastolic volume (EDV), and end-systolic volume (ESV). There were no differences in LV mass between strains but lower values in female mice except in the C3H strain. The exclusion of PMs led to the relative underestimation of EF (-6.1%) and of LV mass (-6.4 mg) and the relative overestimation of EDV (6.3 microL) and ESV (5.3 microL). Inter- and intraobserver reproducibility was better when PMs were included. CONCLUSION: The use of MRI demonstrates cardiac interstrain and gender-related phenotypic diversities that are essential factors to consider when building genomic databases and designing studies.

BACKGROUND: Static shear wave elastography (SWE) is used to detect breast lesions, but slice and plane selections result in discrepancies. OBJECTIVE: To evaluate the intraobserver reproducibility of continuous SWE, and whether quantitative elasticities in orthogonal planes perform better in the differential diagnosis of breast lesions. METHOD: One hundred and twenty-two breast lesions scheduled for ultrasound-guided biopsy were recruited. Continuous SWE scans were conducted in orthogonal planes separately. Quantitative elasticities and histopathology results were collected. Reproducibility in the same plane and diagnostic performance in different planes were evaluated. RESULTS: The maximum and mean elasticities of the hardest portion, and standard deviation of whole lesion, had high inter-class correlation coefficients (0.87 to 0.95) and large areas under receiver operation characteristic curve (0.887 to 0.899). Without loss of accuracy, sensitivities had increased in orthogonal planes compared with single plane (from 73.17% up to 82.93% at most). Mean elasticity of whole lesion and lesion-to-parenchyma ratio were significantly less reproducible and less accurate. CONCLUSION: Continuous SWE is highly reproducible for the same observer. The maximum and mean elasticities of the hardest portion and standard deviation of whole lesion are most reliable. Furthermore, the sensitivities of the three parameters are improved in orthogonal planes without loss of accuracies.

The aim of the study was to evaluate the intraobserver reproducibility and to determine the elasticity characteristics of focal liver lesions (FLLs) by shear wave elastography (SWE).One hundred thirty-six FLLs in 118 patients were examined with SWE for quantitative and qualitative assessment of stiffness. Three SWE images were obtained for each lesion and liver parenchyma by 1 radiologist. Intraobserver reproducibility was assessed by intraclass correlation coefficients (ICCs). Patient and lesion factors that can affect the reproducibility were evaluated. For characterization of the lesion elasticity, the difference in stiffness between the groups of lesions was evaluated.The mean (SD) diameter and depth of the lesions were 3.98 (2.07) and 4.4 (1.59) cm, respectively. The ICC of intraobserver reproducibility was 0.763. Deep-seated lesions (≥6 cm; ICC, 0.621) showed significantly lower intraobserver reproducibility compared with superficial lesions (ICC, 0.793; P = 0.047). Stiffness values of malignant lesions (n = 85, 60.41 [47.81] kPa) were significantly higher than those of benign lesions (n = 51, 22.05 [17.24] kPa, P0.0001). Mean (SD) stiffness of hepatocellular carcinoma (45.72 [35.65] kPa) was significantly lower than that of metastasis (67.43 [43.39] kPa) and was significantly higher than benign FLLs (22.05 [17.24] kPa). However, mean (SD) lesion-parenchyma ratio of hepatocellular carcinoma (3.76 [4]) was not significantly different from that of benign FLLs (3.7 [3.77]).Overall, intraobserver reproducibility of SWE in evaluation of FLLs was excellent, but it can be affected by lesion depth. In addition, SWE is helpful in elasticity characterization of FLLs.

Objective: To assess interobserver and intraobserver reproducibility of the cervical vertebrae maturation method (CVMM) among three panels of judges with different levels of orthodontic experience (OE). Materials and Methods: Fifty individual lateral cephalograms of good quality with complete visualization of cervical vertebrae 1 to 4 were selected. Thirty clinicians, divided according to their OE into three groups (junior group, JU, OE ≤ 1 year; postgraduate group, PG, 2 ≤ OE ≤ 4 years; specialist group, SP, OE ≥ 7 years), evaluated the cephalograms in two sessions (T1 and T2) at 3 weeks apart. Kendall's W and weighted Cohen's kappa (κ) coefficients were performed to assess interobserver and intraobserver agreement. The level of significance was set as P < .05. For both the interobserver and the intraobserver datasets, the percentage of perfect agreement (PPA) and the number of stages apart for each disagreement were calculated. Results: Kendall's W at T1 was SP = 0.61, PG = 0.70, and JU = 0.87; at T2 it was SP = 0.78, PG = 0.85, and JU = 0.86. The percentage of total interobserver perfect agreement (Inter-PPA) was 42.3% at T1 and 46.3% at T2. The JU group had the highest Cohen's κ coefficient at 0.78, while the PG and SP had coefficients of 0.64 each. The percentage of total intraobserver perfect agreement (Intra-PPA) was 54.2%. Conclusions: The reproducibility of the method was not improved by the level of orthodontic experience. The group with the lowest level of orthodontic experience had the best performance.

International audience; BACKGROUND:Assessment of disease activity in UC is important for designing an optimal therapeutic strategy. No single histology score is considered optimum. The aim of this study was to compare intraobserver reproducibility and the interobserver agreement of available histological UC activity indexes.METHODS:One hundred and two biopsy specimens (collected between 2003 and 2014) were scored blindly by three pathologists by determining Geboes, Riley, Gramlich and Gupta indexes and global visual evaluation (GVE). Intraobserver reproducibility and interobserver agreements for index and items of index were studied by intraclass correlation coefficient for quantitative parameter and by κ values and Krippendorff index for qualitative parameters. Relationship between indexes was studied by computation of Pearson's and Spearman's correlation coefficients.RESULTS:Geboes, Riley, Gramlich and Gupta indexes and GVE showed good intraobserver reproducibility and a good interobserver agreement. Histological items that showed the best interobserver agreement were 'erosion/ulceration or surface epithelial integrity' and 'acute inflammatory cells infiltrate/neutrophils in lamina propria'. The five scores were strongly correlated.CONCLUSIONS:Correlation between indexes is strong. Intraobserver reproducibility and interobserver agreement for all indexes is very good. Histological items that showed the best interobserver agreement are 'erosion/ulceration' and 'acute inflammatory cells infiltrate/neutrophils in lamina propria'.

Purpose: Elastography is a promising method for the identification and differentiation of malignant tissue in several organ systems. The primary aim was to evaluate the inter- and intraobserver reproducibility of endorectal strain elastography differentiation of adenomas and adenocarcinomas. The secondary aim was to compare the performance of strain elastography to endorectal ultrasonography (ERUS) examinations. Materials and Methods: Consecutive inclusion of 95 ERUS examinations and 110 elastography video loops with ERUS overlay mode. Video loops were randomized and evaluated by eight observers on two separate occasions. Observers were blinded to all clinical information except the circumferential location of the tumor. A continuous visual analog scale (VAS) and a categorical scale (W-score) were used for elastography evaluation. ERUS loops were T-staged according to the TNM classification system. Histopathological evaluation of surgical resection specimen was used as the reference standard. Results: Strain elastography visual evaluation yielded intraobserver variability from 0.86 to 0.97 and interobserver variability of 0.99. VAS strain elastography differentiation of adenomas (pT0) and adenocarcinomas (pT1 – 4) yielded sensitivity, specificity, accuracy, positive and negative predictive values of 0.94, 0.71, 0.89, 0.92 and 0.78, respectively. The corresponding ERUS values were 0.83, 0.64, 0.79, 0.88 and 0.54, respectively. Conclusion: Visual evaluation of elastography loops is highly reproducible in an offline setting with blinded observers, and correlates significantly with pT-stages. Strain elastography performs better than ERUS and might consequently improve staging.

Purpose To assess intraobserver and interobserver variability of anterior segment optical coherence tomography (AS-OCT) as an objective diagnostic tool to quantify the anterior chamber angle and opening width. Setting University Eye Clinic, Lubeck, Germany. Methods The anterior chamber angle and opening width were assessed in 18 eyes of 9 healthy volunteers by 2 observers. Intraobserver reproducibility was evaluated by calculating an intraclass correlation coefficient (ICC) in a mixed model. Each observer had a separate model using information from 5 scans. Interobserver variability was determined by Bland-Altman analysis. The ICC was calculated in a mixed model using a residual maximum likelihood method. The results of 3 and 5 repeated scans were evaluated to indicate the change to 1 measurement application. Results The mean anterior chamber angle measurement was 35.9 degrees ± 5.7 (SD) for observer A and 36.2 ± 5.7 degrees for observer B. The ICC was 0.94 and 0.91, respectively. The mean opening width was 315 ± 62 μm for observer A and 317 ± 60 μm for observer B. The ICC was 0.97 and 0.93, respectively. Interobserver comparisons showed a mean difference between anterior chamber angle measurements of −0.27 ± 1.6 degrees, a limit of agreement (LOA) interval from −3.52 to 2.98 degrees, and an ICC estimate of 0.96. The mean difference in opening width measurements was 2.40 ± 12.40 μm, the LOA from −27.20 to 22.40 μm, and the estimated ICC 0.96. Using 1 instead of the mean of 5 measurements, the LOA range increased by 3.46 degrees for the anterior chamber angle and 30.0 μm for the opening width. Conclusion Anterior chamber angle and opening width measurements by OCT showed low intraobserver and interobserver variability, indicating OCT is a valuable technique for quantitative assessment that provides reproducible measurements and objective documentation by different examiners.

The objective of this study was to test the interobserver and intraobserver reproducibility of videographic gait analysis in paediatric cerebral palsy patients following botulinum toxin type-A injections. Standardized videos according to gait-specific functional criteria were assessed for 1 h. For intraobserver reproducibility, 13 of 17 items showed good/moderate correlation, one mediocre and three poor correlation. For interobserver reproducibility, 12 of 17 items showed excellent, good or moderate agreement, five items showed poor agreement. Overall, 9 of 17 items showed good intraobserver or interobserver reproducibility. Mean interobserver scores for sagittal plane items were slightly lower than mean intraobserver scores (kappa=0.509 and 0.536, respectively). In conclusion, video analysis of children with cerebral palsy based on functional criteria is useful.

Background The objective of this investigation was to determine the inter- and intraobserver agreement when assessing embryo quality. Methods This investigation included 4002 cleaved embryos from 7535 oocytes retrieved in 688 patients undergoing IVF cycles in a multicentre trial. Embryos were evaluated locally at the inverted microscope at 28, 44 and 68 h (+/-1 h) post-insemination. Digital images of the embryos were assessed centrally by three blinded embryologists. To assess reproducibility, 215 randomly selected cleaved embryos from 33 patients were re-evaluated by the three central embryologists. Results The interobserver agreement among the central embryologists (using the same method of evaluation; 2D images) was good for classification of top-quality embryos (kappa 0.71-0.73), excellent for classification of normally developed embryos (kappa 0.83-0.86) and good-excellent for classification of transferable embryos (kappa 0.78-0.82). The interobserver agreement between local and consolidated central assessment (different methods of evaluation, inverted microscopy versus 2D images) was good for all three embryo classifications (kappa 0.64-0.79). The intraobserver reproducibility for all three overall embryo classifications was excellent for the consolidated central assessment (kappa 0.80-0.91). Conclusion Embryo quality can be determined with a good degree of interobserver agreement independently of the method of evaluation. Embryologists classify embryos with excellent intraobserver reproducibility.

Objectives. To assess intraobserver reproducibility of the endometrial volume (EV) and 3D power Doppler indices (vascularization index, VI; flow index, FI; and vascularization flow index, VFI) of the endometrium and subendometrial area using three-dimensional power Doppler angiography (3D-PDA). Methods. Twenty-five women on the hCG day after controlled ovarian stimulation and 15 patients presenting with uterine bleeding and suspicious endometrial thickening (10 endometrial cancers and 5 endometrial hyperplasias) were scanned. Eighty volume data sets were analyzed using the VOCAL imaging program. EV and VI, FI and VFI of the endometrium and subendometrium (5 mm shell) were manually calculated in the longitudinal and coronal planes with 15° and 9° rotation steps. Intraclass correlation coefficient (ICC) and 95% confidence intervals were used to assess reliability. Results. EV measurements were highly reproducible (ICC ≥ 0.97) without significant differences between planes and rotation steps. Endometrial and subendometrial VI, FI, and VFI presented ICCs above 0.90 with the exception of the subendometrial FI (ICC ≥ 0.80). There were no significant differences according to measurement plane and rotation step except for subendometrial VFI. Nevertheless, 3D power Doppler indices calculated in the coronal plane and 9° rotation step obtained the highest ICC. ICCs for 3D-PDA indices from the tumoral endometria were significantly higher than those calculated from the stimulated endometria. Conclusions. Endometrial volume and endometrial and subendometrial 3D power Doppler indices have an acceptable reproducibility, significantly higher in tumoral endometria. The reliability of measurements does not seem to be significantly influenced by the rotation plane and degrees of rotation. These results support that 3D-PDA and VOCAL are reliable methods to evaluate the physiological and pathological changes of the endometrium.

Importance It is important to evaluate intraobserver and interobserver agreement using visual field (VF) testing and optical coherence tomography (OCT) software in order to understand whether the use of this software is sufficient to detect glaucoma progression and to make decisions regarding its treatment. Objective To evaluate agreement in VF and OCT software among 5 glaucoma specialists. Design, Setting and Participants The printout pages from VF progression software and OCT progression software from 100 patients were randomized, and the 5 glaucoma specialists subjectively and independently evaluated them for glaucoma. Each image was classified as having no progression, questionable progression, or progression. The principal investigator classified the patients previously as without variability (normal) or with high variability among tests (difficult). Using both software, the specialists also evaluated whether the glaucoma damage had progressed and if treatment change was needed. One month later, the same observers reevaluated the patients in a different order to determine intraobserver reproducibility. Main Outcomes and Measures Intraobserver and interobserver agreement was estimated using κ statistics and Gwet second-order agreement coefficient. The agreement was compared with other factors. Results Of the 100 observed patients, half were male and all were white; the mean (SD) age was 69.7 (14.1) years. Intraobserver agreement was substantial to almost perfect for VF software (overall κ [95% CI], 0.59 [0.46-0.72] to 0.87 [0.79-0.96]) and similar for OCT software (overall κ [95% CI], 0.59 [0.46-0.71] to 0.85 [0.76-0.94]). Interobserver agreement among the 5 glaucoma specialists with the VF progression software was moderate (κ, 0.48; 95% CI, 0.41-0.55) and similar to OCT progression software (κ, 0.52; 95% CI, 0.44-0.59). Interobserver agreement was substantial in images classified as having no progression but only fair in those classified as having questionable glaucoma progression or glaucoma progression. Interobserver agreement was fair regarding questions about glaucoma progression (κ, 0.39; 95% CI, 0.32-0.48) and consideration about treatment changes (κ, 0.39; 95% CI, 0.32-0.48). The factors associated with agreement were the glaucoma stage and case difficulty. Conclusions and Relevance There was substantial intraobserver agreement but moderate interobserver agreement among glaucoma specialists using 2 glaucoma progression software packages. These data suggest that these glaucoma progression software packages are insufficient to obtain high interobserver agreement in both devices except in patients with no progression. The low agreement regarding progression or treatment changes suggests that both software programs used in isolation are insufficient for decision making.

Agreement study.To perform an independent interobserver and intraobserver agreement evaluation of the new AOSpine Thoracolumbar Spine Injury Classification System.The new AOSpine Thoracolumbar Spine Injury Classification System was recently published. It showed substantial reliability and reproducibility among the surgeons who developed it; however, an independent evaluation has not been performed.Anteroposterior and lateral radiographs, and computed tomographic scans of 70 patients with acute traumatic thoracolumbar injuries were selected and classified using the morphological grading of the new AOSpine Thoracolumbar Spine Injury Classification System by 6 evaluators (3 spine surgeons and 3 orthopedic surgery residents). After a 6-week interval, the 70 cases were presented in a random sequence to the same evaluators for repeat evaluation. The Kappa coefficient (κ) was used to determine the interobserver and intraobserver agreement.The interobserver reliability was substantial when considering the fracture type (A, B, or C), with a κ= 0.62 (0.57-0.66). The interobserver agreement when considering the subtypes was moderate; κ= 0.55 (0.52-0.57). The intraobserver reproducibility was also substantial, with 85.95% full intraobserver reproducibility considering the fracture type, with κ= 0.77 (0.72-0.83), and was also substantial when considering subtypes with 75.71% full agreement and κ= 0.71 (0.67-0.76). No significant differences were observed between spine surgeons and orthopedic residents in the overall interobserver reliability and intraobserver reproducibility, or in the inter- and intraobserver agreement of specific A, B, or C types of injuries.This classification allows adequate agreement among different observers and by the same observer on separate occasions. Future prospective studies should evaluate whether this classification improves clinical decision making.

Purpose To assess the intraobserver reproducibility of shear wave elastography (SWE) in the prostate. Materials and methods This study was institutional review board approved with waiver of informed consent. Eighty men (mean age, 66.2±9.2 years) with suspected prostate cancer underwent SWE. Young modulus (kPa) was measured at 24 locations in the prostate (superficial and deep locations in paramedian and lateral aspects at the base, mid-gland, and apex levels). The intraobserver reproducibility of two repeated measurements was determined using intraclass correlation coefficients (ICC) and was compared among measurement location, prostate volume, age, and prostate-specific antigen level. Results The overall intraobserver reproducibility was excellent (ICC=0.876). In addition, intraobserver reproducibility was excellent for all specified subgroups according to location, prostate volume, and clinical variables (ICC=0.826–0.917). With regard to location, SWE measurements showed substantially higher ICC values in the mid-gland than in the base and apex, in the paramedian prostate than in the lateral prostate, and in superficial locations than in deeper locations. No substantial differences in ICC values were observed according to the prostate volume and clinical variables. Conclusion Intraobserver reproducibility of SWE measurements in the prostate gland was excellent. There was variability in the intraobserver reproducibility according to location within the prostate, and the operator should be aware of this and take extra caution when performing SWE in these areas.

The aim of the study was to compare pelvic incidence (PI) and pelvic tilt (PT) measurements using the bicoxofemoral axis obtained from either femoral heads or acetabular domes on lateral digital radiographs of the spine. Standing lateral radiographs of the spine of patients without hip pathologies were analyzed. PI and PT were measured on 50 radiographs using the femoral heads first followed by measurements performed with the acetabular domes to define the bicoxofemoral axis. Agreement between the methods was quantified by intraclass correlation coefficient (ICC) and median error for a single measurement (SEM). Intraobserver reproducibility and interobserver reliability of both methods of identification of bicoxofemoral axis and its impact on PI and PT measurements were tested on 31 radiographs and quantified by ICC and SEM. There was an excellent agreement in PI as well as in PT between measurements performed using whether the femoral heads or the acetabular domes (ICC: 0.99; SEM: 0.56° for PI and ICC: 0.99; SEM: 0.2° for PT). Excellent intraobserver reproducibility was revealed for both methods (ICC: 0.99 and SEM: ≤0.17° for PI and ICC: 0.99; SEM: ≤0.18° for PT). Both methods presented excellent interobserver reliability (ICC: 0.99 and SEM: ≤0.54° for PI and ICC: ≥0.98; SEM: ≤0.9° for PT). We suggest that either the femoral heads or the acetabular domes may be used for reliable PI and PT measurements on the lateral standing long-cassette digital radiographs of the spine.

The purpose of this study was to investigate whether the identification of Sever's disease is reliable with radiographs alone. Eighty foot radiographs (50 boys with calcaneal apophysitis and 30 healthy boys) were included in this study. Two consultant orthopaedic surgeons were instructed to make a diagnosis without clinical information on the patients. Radiologic assessments were performed in random order by each observer on two separate occasions, at least 3 weeks later. kappa-statistics were used to establish a relative level of agreement between observers for the two readings and between separate readings by the same observer. Observer A made 22 true (27.5%) diagnoses, whereas observer B made 56 true (70%) diagnoses at the first assessment. Interobserver agreement was rated as slight (kappa-value, 0.190). Observer A made 40 true (50%) diagnoses, whereas observer B made 52 true (65%) diagnoses at the second assessment. Interobserver agreement was rated as slight (kappa-value, 0.039). Intraobserver reproducibility was rated as fair for both observers (kappa-value, 0.369 for observer A and 0.253 for observer B). The results of this study showed that the radiologic identification of calcaneal apophysitis without the absence of clinical information was not reliable. Radiologic findings that were attributed to Sever's disease showed a wide variation between independent observers and between separate readings by the same observer. The diagnosis of calcaneal apophysitis is a clinical decision and radiographic assessment seems to be unnecessary.

To assess the potential of Doppler perfusion index (DPI) measurement as a routine diagnostic tool in the detection of occult colorectal liver metastases.By using color doppler ultrasound, two independent sonologists performed DPI measurements blindly in 20 patients aged 30-82 years; interobserver reproducibility was assessed. A second group of 20 patients aged 37-88 years were examined to assess the level of intraobserver reproducibility of DPI measurements attained by one sonologist. For each patient in this group, the DPI was measured three times in succession, and the variability between measurements was analyzed. Calculations of the intraclass correlation coefficient and the coefficient of variation (CV) were used to determine the levels of reproducibility. The data were also analyzed by using the Student paired t test, with significance established at P less than .05.The interobserver CV and intraobserver CV were 20% and 16%, respectively. The two sonologists who examined the first group of patients agreed independently on the DPI status in 18 of 20 (90%) patients.In this study, both the intraobserver reproducibility and the interobserver reproducibility of DPI measurements were clinically acceptable.

The purpose of this study was to assess the interobserver reliability and intraobserver reproducibility of the AO/ASIF and Rüedi and Allgöwer classifications for fractures of the distal tibia, and to determine the benefit of a computed tomography (CT) scan and experience on observer agreement for several fracture characteristics, including classification.The radiographs of forty-three fractures of the distal tibia, fourteen of which had CT scans, were assessed by groups of experienced and less-experienced observers. Each case was classified according to the AO/ASIF and Rüedi and Allgöwer systems. Several other fracture characteristics also were assessed. The kappa coefficient of agreement was calculated and used to compare the interobserver reliability and intraobserver reproducibility of the classification systems and to determine the benefit of experience and CT scans. The intraclass correlation coefficient was used to assess noncategoric data.Interobserver and intraobserver agreements were good when classifying fractures into AO/ASIF types and significantly better than that for the Rüedi and Allgöwer system. However, agreement was poor when classifying the fractures into AO/ASIF groups. For most assessments, the experienced group tended to have higher levels of interobserver agreement, but not intraobserver agreement. Viewing the CT scans improved agreement on the percentage of articular surface involved, but it did not improve interobserver reliability or intraobserver reproducibility for either of the classification systems.The AO/ASIF classification for fractures of the distal tibia has good observer agreement at the type level, but poor agreement at the group level. Experience tends to improve interobserver agreement, but not intraobserver agreement. Viewing CT scans does not improve agreement on classification, but it tends to improve agreement on articular surface involvement.

The purpose of this study was to analyze the interobserver and intraobserver variability in plain radiography in the diagnosis of diabetic foot osteomyelitis. A prospective observational study was performed from October 1, 2009, to July 31, 2011, on patients with diabetic foot ulcers, with clinically suspected osteomyelitis who were admitted to the Diabetic Foot Unit of the Complutense University of Madrid. Two professional groups examined 123 plain X-rays, each group comprising 3 different levels of clinical experience. To analyze intraobserver variability, 2 months later plain X-rays were reanalyzed by one of the clinical groups. When using only plain radiography for the diagnosis of osteomyelitis in the diabetic foot, low concordance rates were observed for clinicians with a similar level of experience: experienced clinicians ( K11AB = .35, P < .001), moderately experienced clinicians ( K22AB = .39, P < .001), and inexperienced clinicians ( K33AB = .40, P < .001). Intraobserver agreement was highest in experienced clinicians ( K11A = .75, P < .001), followed by moderately experienced clinicians ( K22A = .61, P < .001) and inexperienced clinicians ( K33A = .57, P < .001). Plain radiography for the diagnosis of diabetic foot osteomyelitis is operator dependent and shows low association strength, even among experienced clinicians, when interpreted in isolation without knowing the clinical characteristics of the lesion.

Background: The skin score, a subjective assessment of skin elasticity, is widely used in patients with systemic sclerosis. Although this scoring method is regarded as a validated and accepted tool, the interobserver and intraobserver reproducibility is relatively poor. Objective: Our purpose was to investigate whether the recently developed SEM 474 cutometer, which exerts a controlled vacuum force to the skin, can measure skin elasticity more objectively than the skin score. Methods: Skin elasticity was measured in 74 different body areas in patients with systemic sclerosis and compared with the skin score obtained from the same areas. Results: The cutometer produced quantitative and reproducible data. A large-diameter (8 mm) measuring probe was superior to a small probe. The interobserver intraclass correlation coefficient (ICC) was 0.92; the intraobserver ICC was 0.94. A linear correlation was found with the clinical skin score; the Spearman rank correlation test was 0.69. Conclusion: The correlation with the skin score was reasonable, despite the observation that regional differences in skin elasticity were detected by the cutometer but not by the human observer, who automatically compensates for these factors and integrates them into the skin score. The high interobserver and intraobserver ICC makes the cutometer more suitable for quantifying changes in skin thickness than the subjective skin score.

In this study, we tested the precision of landmark positioning for a set of landmarks that can be used for the edentulous cleft lip and palate maxilla of the infant, by analyzing intraobserver and interobserver repositioning and measuring on a series of 121 (unilateral and bilateral) study casts. To date, no data on interobserver and only minimal data on intraobserver reproducibility are available. We found intraobserver reproducibility acceptable with total measurement errors ranging from 0.51 to 1.54 mm. Interobserver reproducibility was only slightly less with total measurement errors ranging from 0.63 to 1.57 mm. Total measurement errors were found to be relatively high for some variables. Both the intra- and Interobserver analyses show insight into expected precision of landmark positioning during placement of these points on casts. A learning effect for precise positioning has been demonstrated in both analyses. The points with the highest precision overall are Q and Q’, followed by the linear measurements PL and P'L’. Quality of regular study casts (impressions) is an important factor, with room for improvement. Reproducible landmark positioning on the cleft lip and palate infant's maxilla, can only be a reality if the quality of the cast is optimal and the investigator is experienced. Intraobserver and interobserver reproducibility are in the same range, which justifies the comparison of results from different studies and relieves future investigators of the need to have all measurements within a study conducted by the same investigator. Aspects of the biologic meaning of landmarks are also discussed.

We applied the silver staining of nucleolar organizer regions (AgNOR) technique to the pretreatment biopsies of 50 cases of advanced prostate cancer. Three different counting methods were utilized in the enumeration of AgNORs. All methods yielded statistically significant differences of mean AgNOR counts of groups defined by high and low WHO, and by Gleason grades. However, there was overlap among groups, and further analysis of counts by grouping of patients according to their stage, response to treatment, and prognosis was not conclusive. Replicate counts were performed in 10 cases. While intraobserver reproducibility was high by all methods, only the second counting method yielded nonsignificant interobserver variability. There was a significant intratumoral heterogeneity of AgNOR scores. Lack of technical standardization, low reproducibility, and lack of correlation with prognosis limit the use of AgNOR counts in advanced carcinoma of the prostate. &1995 Wiley-Liss, Inc.