Search

The accurate classification of bone tumours is crucial for guiding clinical decisions regarding treatment and follow-up. However, differentiating between various tumour types is challenging due to the rarity of certain entities, high intra-class variability, and limited training data in clinical practice. This study proposes a multimodal deep learning model that integrates clinical metadata and X-ray imaging to improve the classification of primary bone tumours. The dataset comprises 1,785 radiographs from 804 patients collected between 2000 and 2020, including metadata such as age, affected bone site, tumour position, and gender. Ten tumour types were selected, with histopathology or tumour board decisions serving as the reference standard., Methods: Our model is based on the NesT image classification model and a multilayer perceptron with a joint fusion architecture. Descriptive statistics included incidence and percentage ratios for discrete parameters, and mean, standard deviation, median, and interquartile range for continuous parameters., Results: The mean age of the patients was 33.62 ± 18.60 years, with 54.73% being male. Our multimodal deep learning model achieved 69.7% accuracy in classifying primary bone tumours, outperforming the Vision Transformer model by five percentage points. SHAP values indicated that age had the most substantial influence among the considered metadata., Conclusion: The joint fusion approach developed in this study, integrating clinical metadata and imaging data, outperformed state-of-the-art models in classifying primary bone tumours. The use of SHAP values provided insights into the impact of different metadata on the model's performance, highlighting the significant role of age. This approach has potential implications for improving diagnostic accuracy and understanding the influence of clinical factors in tumour classification., (© 2024. The Author(s).)

Objectives: To develop a deep learning methodology that distinguishes early from late stages of avascular necrosis of the hip (AVN) to determine treatment decisions., Methods: Three convolutional neural networks (CNNs) VGG-16, Inception ResnetV2, InceptionV3 were trained with transfer learning (ImageNet) and finetuned with a retrospectively collected cohort of (n = 104) MRI examinations of AVN patients, to differentiate between early (ARCO 1-2) and late (ARCO 3-4) stages. A consensus CNN ensemble decision was recorded as the agreement of at least two CNNs. CNN and ensemble performance was benchmarked on an independent cohort of 49 patients from another country and was compared to the performance of two MSK radiologists. CNN performance was expressed with areas under the curve (AUC), the respective 95% confidence intervals (CIs) and precision, and recall and f1-scores. AUCs were compared with DeLong's test., Results: On internal testing, Inception-ResnetV2 achieved the highest individual performance with an AUC of 99.7% (95%CI 99-100%), followed by InceptionV3 and VGG-16 with AUCs of 99.3% (95%CI 98.4-100%) and 97.3% (95%CI 95.5-99.2%) respectively. The CNN ensemble the same AUCs Inception ResnetV2. On external validation, model performance dropped with VGG-16 achieving the highest individual AUC of 78.9% (95%CI 51.6-79.6%) The best external performance was achieved by the model ensemble with an AUC of 85.5% (95%CI 72.2-93.9%). No significant difference was found between the CNN ensemble and expert MSK radiologists (p = 0.22 and 0.092 respectively)., Conclusion: An externally validated CNN ensemble accurately distinguishes between the early and late stages of AVN and has comparable performance to expert MSK radiologists., Clinical Relevance Statement: This paper introduces the use of deep learning for the differentiation between early and late avascular necrosis of the hip, assisting in a complex clinical decision that can determine the choice between conservative and surgical treatment., Key Points: • A convolutional neural network ensemble achieved excellent performance in distinguishing between early and late avascular necrosis. • The performance of the deep learning method was similar to the performance of expert readers., (© 2023. The Author(s).)

Purpose: To evaluate the diagnostic performance of CT-like MR images reconstructed with an algorithm combining compressed sense (CS) with deep learning (DL) in patients with suspected osseous shoulder injury compared to conventional CS-reconstructed images., Methods: Thirty-two patients (12 women, mean age 46 ± 14.9 years) with suspected traumatic shoulder injury were prospectively enrolled into the study. All patients received MR imaging of the shoulder, including a CT-like 3D T1-weighted gradient-echo (T1 GRE) sequence and in case of suspected fracture a conventional CT. An automated DL-based algorithm, combining CS and DL (CS DL) was used to reconstruct images of the same k-space data as used for CS reconstructions. Two musculoskeletal radiologists assessed the images for osseous pathologies, image quality and visibility of anatomical landmarks using a 5-point Likert scale. Moreover, signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) were calculated., Results: Compared to CT, all acute fractures (n = 23) and osseous pathologies were detected accurately on the CS only and CS DL images with almost perfect agreement between the CS DL and CS only images (κ 0.95 (95 %confidence interval 0.82-1.00). Image quality as well as the visibility of the fracture lines, bone fragments and glenoid borders were overall rated significantly higher for the CS DL reconstructions than the CS only images (CS DL range 3.7-4.9 and CS only range 3.2-3.8, P = 0.01-0.04). Significantly higher SNR and CNR values were observed for the CS DL reconstructions (P = 0.02-0.03)., Conclusion: Evaluation of traumatic shoulder pathologies is feasible using a DL-based algorithm for reconstruction of high-resolution CT-like MR imaging., Competing Interests: Declaration of competing interest The authors declare the following financial interests/personal relationships which may be considered as potential competing interests: [Co-author Kilian Weiss was employed by Philips GmbH Market DACH but was not involved in handling or analysis of data. If there are other authors, they declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.]., (Copyright © 2023. Published by Elsevier B.V.)

Objectives: To evaluate the diagnostic performance of an automated reconstruction algorithm combining MR imaging acquired using compressed SENSE (CS) with deep learning (DL) in order to reconstruct denoised high-quality images from undersampled MR images in patients with shoulder pain., Methods: Prospectively, thirty-eight patients (14 women, mean age 40.0 ± 15.2 years) with shoulder pain underwent morphological MRI using a pseudo-random, density-weighted k-space scheme with an acceleration factor of 2.5 using CS only. An automated DL-based algorithm (CS DL) was used to create reconstructions of the same k-space data as used for CS reconstructions. Images were analyzed by two radiologists and assessed for pathologies, image quality, and visibility of anatomical landmarks using a 4-point Likert scale., Results: Overall agreement for the detection of pathologies between the CS DL reconstructions and CS images was substantial to almost perfect (κ 0.95 (95% confidence interval 0.82-1.00)). Image quality and the visibility of the rotator cuff, articular cartilage, and axillary recess were overall rated significantly higher for CS DL images compared to CS (p < 0.03). Contrast-to-noise ratios were significantly higher for cartilage/fluid (CS DL 198 ± 24.3, CS 130 ± 32.2, p = 0.02) and ligament/fluid (CS DL 184 ± 17.3, CS 141 ± 23.5, p = 0.03) and SNR values were significantly higher for ligaments and muscle of the CS DL reconstructions (p < 0.04)., Conclusion: Evaluation of shoulder pathologies was feasible using a DL-based algorithm for MRI reconstruction and denoising. In clinical routine, CS DL may be beneficial in particular for reducing image noise and may be useful for the detection and better discrimination of discrete pathologies. Assessment of shoulder pathologies was feasible with improved image quality as well as higher SNR using a compressed sensing deep learning-based framework for image reconstructions and denoising., Key Points: • Automated deep learning-based reconstructions showed a significant increase in signal-to-noise ratio and contrast-to-noise ratio (p < 0.04) with only a slight increase of reconstruction time of 40 s compared to CS. • All pathologies were accurately detected with no loss of diagnostic information or prolongation of the scan time. • Significant improvements of the image quality as well as the visibility of the rotator cuff, articular cartilage, and axillary recess were detected., (© 2023. The Author(s).)

Objectives: To evaluate a compressed sensing artificial intelligence framework (CSAI) to accelerate MRI acquisition of the ankle., Methods: Thirty patients were scanned at 3T. Axial T2-w, coronal T1-w, and coronal/sagittal intermediate-w scans with fat saturation were acquired using compressed sensing only (12:44 min, CS), CSAI with an acceleration factor of 4.6-5.3 (6:45 min, CSAI2x), and CSAI with an acceleration factor of 6.9-7.7 (4:46 min, CSAI3x). Moreover, a high-resolution axial T2-w scan was obtained using CSAI with a similar scan duration compared to CS. Depiction and presence of abnormalities were graded. Signal-to-noise and contrast-to-noise were calculated. Wilcoxon signed-rank test and Cohen's kappa were used to compare CSAI with CS sequences., Results: The correlation was perfect between CS and CSAI2x (κ = 1.0) and excellent for CS and CSAI3x (κ = 0.86-1.0). No significant differences were found for the depiction of structures between CS and CSAI2x and the same abnormalities were detected in both protocols. For CSAI3x the depiction was graded lower (p ≤ 0.001), though most abnormalities were also detected. For CSAI2x contrast-to-noise fluid/muscle was higher compared to CS (p ≤ 0.05), while no differences were found for other tissues. Signal-to-noise and contrast-to-noise were higher for CSAI3x compared to CS (p ≤ 0.05). The high - resolution axial T2-w sequence specifically improved the depiction of tendons and the tibial nerve (p ≤ 0.005)., Conclusions: Acquisition times can be reduced by 47% using CSAI compared to CS without decreasing diagnostic image quality. Reducing acquisition times by 63% is feasible but should be reserved for specific patients. The depiction of specific structures is improved using a high-resolution axial T2-w CSAI scan., Key Points: • Prospective study showed that CSAI enables reduction in acquisition times by 47% without decreasing diagnostic image quality. • Reducing acquisition times by 63% still produces images with an acceptable diagnostic accuracy but should be reserved for specific patients. • CSAI may be implemented to scan at a higher resolution compared to standard CS images without increasing acquisition times., (© 2022. The Author(s).)

Background An artificial intelligence model that assesses primary bone tumors on radiographs may assist in the diagnostic workflow. Purpose To develop a multitask deep learning (DL) model for simultaneous bounding box placement, segmentation, and classification of primary bone tumors on radiographs. Materials and Methods This retrospective study analyzed bone tumors on radiographs acquired prior to treatment and obtained from patient data from January 2000 to June 2020. Benign or malignant bone tumors were diagnosed in all patients by using the histopathologic findings as the reference standard. By using split-sample validation, 70% of the patients were assigned to the training set, 15% were assigned to the validation set, and 15% were assigned to the test set. The final performance was evaluated on an external test set by using geographic validation, with accuracy, sensitivity, specificity, and 95% CIs being used for classification, the intersection over union (IoU) being used for bounding box placements, and the Dice score being used for segmentations. Results Radiographs from 934 patients (mean age, 33 years ± 19 [standard deviation]; 419 women) were evaluated in the internal data set, which included 667 benign bone tumors and 267 malignant bone tumors. Six hundred fifty-four patients were in the training set, 140 were in the validation set, and 140 were in the test set. One hundred eleven patients were in the external test set. The multitask DL model achieved 80.2% (89 of 111; 95% CI: 72.8, 87.6) accuracy, 62.9% (22 of 35; 95% CI: 47, 79) sensitivity, and 88.2% (67 of 76; CI: 81, 96) specificity in the classification of bone tumors as malignant or benign. The model achieved an IoU of 0.52 ± 0.34 for bounding box placements and a mean Dice score of 0.60 ± 0.37 for segmentations. The model accuracy was higher than that of two radiologic residents (71.2% and 64.9%; P = .002 and P < .001, respectively) and was comparable with that of two musculoskeletal fellowship-trained radiologists (83.8% and 82.9%; P = .13 and P = .25, respectively) in classifying a tumor as malignant or benign. Conclusion The developed multitask deep learning model allowed for accurate and simultaneous bounding box placement, segmentation, and classification of primary bone tumors on radiographs. © RSNA, 2021 Online supplemental material is available for this article. See also the editorial by Carrino in this issue.