Search

Textural features can be useful in differentiating between benign and malignant breast lesions on mammograms. Unlike previous computerized schemes, which relied largely on shape and margin features based on manual contours of masses, textural features can be determined from regions of interest (ROIs) without precise lesion segmentation. In this study, therefore, we investigated an ROI-based feature, namely, radial local ternary patterns (RLTP), which takes into account the direction of edge patterns with respect to the center of masses for classification of ROIs for benign and malignant masses. Using an artificial neural network (ANN), support vector machine (SVM) and random forest (RF) classifiers, the classification abilities of RLTP were compared with those of the regular local ternary patterns (LTP), rotation invariant uniform (RIU2) LTP, texture features based on the gray level co-occurrence matrix (GLCM), and wavelet features. The performance was evaluated with 376 ROIs including 181 malignant and 195 benign masses. The highest areas under the receiver operating characteristic curves among three classifiers were 0.90, 0.77, 0.78, 0.86, and 0.83 for RLTP, LTP, RIU2-LTP, GLCM, and wavelet features, respectively. The results indicate the usefulness of the proposed texture features for distinguishing between benign and malignant lesions and the superiority of the radial patterns compared with the conventional rotation invariant patterns., (Copyright © 2016 Elsevier Ltd. All rights reserved.)

Presentation of similar reference images can be useful for diagnosis of new lesions. A similarity map which can visually present the overview of the relationship between the lesions with different types may provide the supplemental information to the reference images. A new method for constructing the similarity map by multidimensional scaling (MDS) for breast masses on mammograms was investigated. Nine pathologic types were included; three regions of interests each from the nine groups were employed in this study. Subjective similarity ratings by expert readers were obtained for all possible 351 pairs of masses. Using the average ratings, MDS similarity map was created. Each axis of the MDS configuration was fitted by the linear model with 13 image features to reconstruct the similarity map. Dissimilarity based on the distance in the reconstructed space was determined and compared with the subjective rating. The MDS map consistently represented the similarity between cysts and fibroadenomas, invasive lobular carcinomas and scirrhous carcinomas, and ductal carcinomas in situ, solid-tubular carcinomas, and papillotubular carcinomas with the experts' data. The correlation between the average subjective ratings and the dissimilarities based on the distance in the reconstructed feature space was much greater (-0.87) than that of the dissimilarities based on the distance in the conventional feature space (-0.65). The new similarity map by MDS can be useful for visualizing the relationship between breast masses with different pathologic types. It has potential usefulness in selecting the similarity measures and providing the supplemental information.

Computer-aided diagnosis has potential in improving radiologists' diagnosis, and presentation of similar images as a reference may provide additional useful information for distinction between benign and malignant lesions. In this study, we evaluated the usefulness of presentation of reference images in observer performance studies and compared the results obtained by groups of observers practicing in the United States and Japan. The results showed that the presentation of the reference images was generally effective for both groups, as the areas under the receiver operating characteristic curves improved from 0.915 to 0.924 for the group in the US and from 0.913 to 0.925 for the group in Japan, although the differences were marginally (p = 0.047) and not (p = 0.13) statistically significant, respectively. There was a slight difference between the two groups in the way that the observers reacted to some benign cases, which might be due to differences in the population of screenees and in the socio-clinical environment. In the future, it may be worthwhile to investigate the development of a customized system for physicians in different socio-clinical environments.

The effect of the presentation of similar images for distinction between benign and malignant masses on mammograms was evaluated in the observer performance study. Images of masses were obtained from the Digital Database for Screening Mammography. We selected 50 benign and 50 malignant masses by a stratified randomization method. For each case, similar images were selected based on the size of masses and the similarity measures. Radiologists were shown images with unknown masses and asked to provide their confidence level that the lesions were malignant before and after the presentation of the similar images. Eleven observers, including three attending breast radiologists, three breast imaging fellows, and five residents, participated. The average areas under the receiver operating characteristic curves without and with the presentation of the similar images were almost equivalent. However, there were many cases in which the similar images caused beneficial effects to the observers, whereas there were a small number of cases in which the similar images had detrimental effects. From a detailed analysis of the reasons for these detrimental effects, we found that the similar images would not be useful for diagnosis of rare and very difficult cases, i.e., benign-looking malignant and malignant-looking benign cases. In addition, these cases should not be included in the reference database, because radiologists would be confused by these unusual cases. The results of this study could be very important and useful for the future development and improvement of a computer-aided diagnosis system.

Rationale and Objectives: To determine similarity measures for selection of pathology-known similar images that would be useful for radiologists as a reference guide in the diagnosis of new breast lesions on mammograms., Materials and Methods: The images were obtained from the Digital Database for Screening Mammography developed by the University of South Florida. For determination and evaluation of similarity measures, the "gold standard" of similarities for 300 pairs of masses was determined by 10 breast radiologists. For determining similarity measures that would agree with radiologists' similarity determination, an artificial neural network (ANN) was trained with the radiologists' subjective similarity ratings and the image features. The image features were determined subjectively using the Breast Imaging Reporting and Data System (BI-RADS) lesion descriptors and objectively by computerized image analysis. The similarity measures determined by the ANN were compared to the gold standard and evaluated in terms of the correlation coefficient., Results: The similarity measures determined using the BI-RADS descriptors only were not as useful as those determined by use of the image features only. When the BI-RADS margin ratings were combined with the image features, the correlation coefficient between the subjective ratings and the objective measures improved slightly (r = 0.76) compared to those based on the image features alone (r = 0.74)., Conclusions: The inclusion of the BI-RADS margin descriptors may be useful for determination of similarity measures, especially when it is difficult to obtain the manual outlines of the masses and if the BI-RADS descriptors were provided consistently by radiologists.

The presentation of images with lesions of known pathology that are similar to an unknown lesion may be helpful to radiologists in the diagnosis of challenging cases for improving the diagnostic accuracy and also for reducing variation among different radiologists. The authors have been developing a computerized scheme for automatically selecting similar images with clustered microcalcifications on mammograms from a large database. For similar images to be useful, they must be similar from the point of view of the diagnosing radiologists. In order to select such images, subjective similarity ratings were obtained for a number of pairs of clustered microcalcifications by breast radiologists for establishment of a "gold standard" of image similarity, and the gold standard was employed for determination and evaluation of the selection of similar images. The images used in this study were obtained from the Digital Database for Screening Mammography developed by the University of South Florida. The subjective similarity ratings for 300 pairs of images with clustered microcalcifications were determined by ten breast radiologists. The authors determined a number of image features which represent the characteristics of clustered microcalcifications that radiologists would use in their diagnosis. For determination of objective similarity measures, an artificial neural network (ANN) was employed. The ANN was trained with the average subjective similarity ratings as teacher and selected image features as input data. The ANN was trained to learn the relationship between the image features and the radiologists' similarity ratings; therefore, once the training was completed, the ANN was able to determine the similarity, called a psychophysical similarity measure, which was expected to be close to radiologists' impressions, for an unknown pair of clustered microcalcifications. By use of a leave-one-out test method, the best combination of features was selected. The correlation coefficient between the gold standard and the psychophysical similarity measure through the use of seven features was relatively high (r=0.71) and was comparable to the correlation coefficients between the ratings by one radiologist and the average ratings by nine radiologists (r=0.69 +/- 0.07). The correlation coefficient was improved compared to that of a distance-based method (r=0.58). The result indicated that similar images selected by the psychophysical similarity measure may be useful to radiologists in the diagnosis of clustered microcalcifications on mammograms.

Rationale and Objectives: We conducted an observer study to investigate whether radiologists can judge similarities in pairs of breast masses and lung nodules consistently and reproducibly., Materials and Methods: Institutional review board approval and informed observer consent were obtained. This study was compliant with the Health Insurance Portability and Accountability Act. We used eight pairs of breast masses on mammograms and eight pairs of lung nodules on computed tomographic images, for which subjective similarity ratings ranging from 0 to 1 were determined in our previous studies. From these, four sets of image pairs were created (ie, a set of eight mass pairs, a set of eight nodule pairs, and two mixed sets of four mass and four nodule pairs). Eight radiologists, including four breast radiologists and four chest radiologists, compared all combinations of the eight pairs in each set using a two-alternative forced-choice (2AFC) method to determine the similarity ranking scores by identifying which pair was more similar than the other pair based on the overall impression for diagnosis., Results: In the mass set and nodule set, the relationship between the average subjective similarity ratings and the average similarity ranking scores by 2AFC indicated very high correlations (r = 0.91 and 0.88). Moreover, in the two mixed sets, the correlations between the average subjective similarity ratings and the average similarity ranking scores were also very high (r = 0.90 and 0.98). Thus, radiologists were able to compare the similarities for pairs of lesions consistently, even in the unusual comparison of pairs of completely different types of lesions., Conclusion: The subjective similarity of a pair of lesions in medical images can be quantified consistently by a group of radiologists. The concept of similarity of lesions in medical images can be subjected to rigorous scientific research and investigation in the future.

This work presents the usefulness of texture features in the classification of breast lesions in 5,518 images of regions of interest, which were obtained from the Digital Database for Screening Mammography that included microcalcifications, masses, and normal cases. Sixteen texture features were used, i.e., 13 were based on the spatial gray-level dependence matrix and 3 on the wavelet transform. The nonparametric K-NN classifier was used in the classification stage. The results obtained from receiver operating characteristic analysis indicated that the texture features can be used for separating normal regions and lesions with masses and microcalcifications, yielding the area under the curve (AUC) values of 0.957 and 0.859, respectively. However, the texture features were not very effective for distinguishing between malignant and benign lesions because the AUC was 0.617 for masses and 0.607 for microcalcifications. The study showed that the texture features can be used for the detection of suspicious regions in mammograms.

The presentation of images that are similar to that of an unknown lesion seen on a mammogram may be helpful for radiologists to correctly diagnose that lesion. For similar images to be useful, they must be quite similar from the radiologists' point of view. We have been trying to quantify the radiologists' impression of similarity for pairs of lesions and to establish a "gold standard" for development and evaluation of a computerized scheme for selecting such similar images. However, it is considered difficult to reliably and accurately determine similarity ratings, because they are subjective. In this study, we compared the subjective similarities obtained by two different methods, an absolute rating method and a 2-alternative forced-choice (2AFC) method, to demonstrate that reliable similarity ratings can be determined by the responses of a group of radiologists. The absolute similarity ratings were previously obtained for pairs of masses and pairs of microcalcifications from five and nine radiologists, respectively. In this study, similarity ranking scores for eight pairs of masses and eight pairs of microcalcifications were determined by use of the 2AFC method. In the first session, the eight pairs of masses and eight pairs of microcalcifications were grouped and compared separately for determining the similarity ranking scores. In the second session, another similarity ranking score was determined by use of mixed pairs, i.e., by comparison of the similarity of a mass pair with that of a calcification pair. Four pairs of masses and four pairs of microcalcifications were grouped together to create two sets of eight pairs. The average absolute similarity ratings and the average similarity ranking scores showed very good correlations in the first study (Pearson's correlation coefficients: 0.94 and 0.98 for masses and microcalcifications, respectively). Moreover, in the second study, the correlations between the absolute ratings and the ranking scores were also very high (0.92 and 0.96), which implies that the observers were able to compare the similarity of a mass pair with that of a calcification pair consistently. These results provide evidence that the concept of similarity for pairs of images is robust, even across different lesion types, and that radiologists are able to reliably determine subjective similarity for pairs of breast lesions.

We investigated a psychophysical similarity measure for selection of images similar to those of unknown masses on mammograms, which may assist radiologists in the distinction between benign and malignant masses. Sixty pairs of masses were selected from 1445 mass images prepared for this study, which were obtained from the Digital Database for Screening Mammography by the University of South Florida. Five radiologists provided subjective similarity ratings for these 60 pairs of masses based on the overall impression for diagnosis. Radiologists' subjective ratings were marked on a continuous rating scale and quantified between 0 and 1, which correspond to pairs not similar at all and pairs almost identical, respectively. By use of the subjective ratings as "gold standard," similarity measures based on the Euclidean distance between pairs in feature space and the psychophysical measure were determined. For determination of the psychophysical similarity measure, an artificial neural network (ANN) was employed to learn the relationship between radiologists' average subjective similarity ratings and computer-extracted image features. To evaluate the usefulness of the similarity measures, the agreement with the radiologists' subjective similarity ratings was assessed in terms of correlation coefficients between the average subjective ratings and the similarity measures. A commonly used similarity measure based on the Euclidean distance was moderately correlated (r=0.644) with the radiologists' average subjective ratings, whereas the psychophysical measure by use of the ANN was highly correlated (r=0.798). The preliminary result indicates that a psychophysical similarity measure would be useful in the selection of images similar to those of unknown masses on mammograms.