75 results
Search Results
2. Hagnifinder: Recovering magnification information of digital histological images using deep learning.
- Author
-
Hongtai Zhang, Zaiyi Liu, Mingli Song, and Cheng Lu
- Subjects
DEEP learning ,CONVOLUTIONAL neural networks ,FEATURE extraction ,REGRESSION analysis ,PREDICTION models - Abstract
Background and objective: Training a robust cancer diagnostic or prognostic artificial intelligent model using histology images requires a large number of representative cases with labels or annotations, which are difficult to obtain. The histology snapshots available in published papers or case reports can be used to enrich the training dataset. However, the magnifications of these invaluable snapshots are generally unknown, which limits their usage. Therefore, a robust magnification predictor is required for utilizing those diverse snapshot repositories consisting of different diseases. This paper presents a magnification prediction model named Hagnifinder for H&E-stained histological images. Methods: Hagnifinder is a regression model based on a modified convolutional neural network (CNN) that contains 3 modules: Feature Extraction Module, Regression Module, and Adaptive Scaling Module (ASM). In the training phase, the Feature Extraction Module first extracts the image features. Secondly, the ASM is proposed to address the learned feature values uneven distribution problem. Finally, the Regression Module estimates the mapping between the regularized extracted features and the magnifications. We construct a new dataset for training a robust model, named Hagni40, consisting of 94 643 H&E-stained histology image patches at 40 different magnifications of 13 types of cancer based on The Cancer Genome Atlas. To verify the performance of the Hagnifinder, we measure the accuracy of the predictions by setting the maximum allowable difference values (0.5, 1, and 5) between the predicted magnification and the actual magnification. We compare Hagnifinder with state-of-the-art methods on a public dataset BreakHis and the Hagni40. Results: The Hagnifinder provides consistent prediction accuracy, with a mean accuracy of 98.9%, across 40 different magnifications and 13 different cancer types when Resnet50 is used as the feature extractor. Compared with the stateof-the-art methods focusing on 4-5 levels of magnification classification, the Hagnifinder achieves the best and most comparable performance in the BreakHis and Hagni40 datasets. Conclusions: The experimental results suggest that Hagnifinder can be a valuable tool for predicting the associated magnification of any given histology image. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
3. Organizational preparedness for the use of large language models in pathology informatics.
- Author
-
Hart, Steven N., Hoffman, Noah G., Gershkovich, Peter, Christenson, Chancey, McClintock, David S., Miller, Lauren J., Jackups, Ronald, Azimi, Vahid, Spies, Nicholas, and Brodsky, Victor
- Subjects
LANGUAGE models ,MEDICAL informatics ,ANATOMICAL pathology ,PREPAREDNESS ,CLINICAL pathology ,PATHOLOGY - Abstract
In this paper, we consider the current and potential role of the latest generation of Large Language Models (LLMs) in medical informatics, particularly within the realms of clinical and anatomic pathology. We aim to provide a thorough understanding of the considerations that arise when employing LLMs in healthcare settings, such as determining appropriate use cases and evaluating the advantages and limitations of these models. Furthermore, this paper will consider the infrastructural and organizational requirements necessary for the successful implementation and utilization of LLMs in healthcare environments. We will discuss the importance of addressing education, security, bias, and privacy concerns associated with LLMs in clinical informatics, as well as the need for a robust framework to overcome regulatory, compliance, and legal challenges. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
4. Removing non-nuclei information from histopathological images: A preprocessing step towards improving nuclei segmentation methods.
- Author
-
Moncayo, Ricardo, Martel, Anne L., and Romero, Eduardo
- Subjects
CELL nuclei ,COMPUTER-aided diagnosis ,K-means clustering ,HISTOPATHOLOGY ,HEMATOXYLIN & eosin staining ,DATABASES - Abstract
Disease interpretation by computer-aided diagnosis systems in digital pathology depends on reliable detection and segmentation of nuclei in hematoxylin and eosin (HE) images. These 2 tasks are challenging since appearance of both cell nuclei and background structures are very variable. This paper presents a method to improve nuclei detection and segmentation in HE images by removing tiles that only contain background information. The method divides each image into smaller patches and uses their projection to the noiselet space to capture different spatial features from non-nuclei background and nuclei structures. The noiselet features are clustered by a K-means algorithm and the resultant partition, defined by the cluster centroids, is herein named the noiselet code-book. A part of an image, a tile, is divided into patches and represented by the histogram of occurrences of the projected patches in the noiselet code-book. Finally, with these histograms, a classifier learns to differentiate between nuclei and non-nuclei tiles. By applying a conventional watershed-marked method to detect and segment nuclei, evaluation consisted in comparing pure watershed method against denoising-plus-watershed in an open database with 8 different types of tissues. The averaged F-score of nuclei detection improved from 0.830 to 0.86 and the dice score after segmentation increased from 0.701 to 0.723. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
5. Modelling digital health data: The ExaMode ontology for computational pathology.
- Author
-
Menotti, Laura, Silvello, Gianmaria, Atzori, Manfredo, Boytcheva, Svetla, Ciompi, Francesco, Di Nunzio, Giorgio Maria, Fraggetta, Filippo, Giachelle, Fabio, Irrera, Ornella, Marchesin, Stefano, Marini, Niccolò, Müller, Henning, and Primov, Todor
- Subjects
DIGITAL health ,ONTOLOGIES (Information retrieval) ,ONTOLOGY ,RDF (Document markup language) ,PATHOLOGY ,CELIAC disease ,DATA integration - Abstract
Computational pathology can significantly benefit from ontologies to standardize the employed nomenclature and help with knowledge extraction processes for high-quality annotated image datasets. The end goal is to reach a shared model for digital pathology to overcome data variability and integration problems. Indeed, data annotation in such a specific domain is still an unsolved challenge and datasets cannot be steadily reused in diverse contexts due to heterogeneity issues of the adopted labels, multilingualism, and different clinical practices. Material and methods: This paper presents the ExaMode ontology, modeling the histopathology process by considering 3 key cancer diseases (colon, cervical, and lung tumors) and celiac disease. The ExaMode ontology has been designed bottom-up in an iterative fashion with continuous feedback and validation from pathologists and clinicians. The ontology is organized into 5 semantic areas that defines an ontological template to model any disease of interest in histopathology. Results: The ExaMode ontology is currently being used as a common semantic layer in: (i) an entity linking tool for the automatic annotation of medical records; (ii) a web-based collaborative annotation tool for histopathology text reports; and (iii) a software platform for building holistic solutions integrating multimodal histopathology data. Discussion: The ontology ExaMode is a key means to store data in a graph database according to the RDF data model. The creation of an RDF dataset can help develop more accurate algorithms for image analysis, especially in the field of digital pathology. This approach allows for seamless data integration and a unified query access point, from which we can extract relevant clinical insights about the considered diseases using SPARQL queries. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
6. Handling DNA malfunctions by unsupervised machine learning model.
- Author
-
Khazaaleh, Mutaz Kh., Alsharaiah, Mohammad A., Alsharafat, Wafa, Abu-Shareha, Ahmad Adel, Haziemeh, Feras A., Al-Nawashi, Malek M., and alhija, Mwaffaq abu
- Subjects
MACHINE learning ,DNA damage ,BIOLOGICAL systems ,K-means clustering ,DNA structure - Abstract
The cell cycle is a rich field for research, especially, the DNA damage. DNA damage, which happened naturally or as a result of environmental influences causes change in the chemical structure of DNA. The extent of DNA damage has a significant impact on the fate of the cell in later stages. In this paper, we introduced an Unsupervised Machine learning Model for DNA Damage Diagnosis and Analysis. Mainly, we employed K-means clustering unsupervised machine learning algorithms. Unsupervised algorithms commonly draw conclusions from datasets by solely utilizing input vectors, disregarding any known or labeled outcomes. The model provided deep insight about DNA damage and exposes the protein levels for proteins when work together in sub-network model to deal with DNA damage occurrence, the unsupervised artificial model explained the sub-network biological model activities in regard to the changing in their concentrations in several clusters, they have been grouped in such as (0 - no damage, 1 - low, 2 - medium, 3 - high, and 4 - excess) DNA damage clusters. The results provided a rational and persuasive explanation for numerous important phenomena, including the oscillation of the protein p53, in a clear and understandable manner. Which is encouraging since it demonstrates that the K-means clustering approach can be easily applied to many similar biological systems, which aids in better understanding the key dynamics of these systems. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
7. Digital pathology operations at a tertiary cancer center: Infrastructure requirements and operational cost.
- Author
-
Ardon, Orly, Klein, Eric, Manzo, Allyne, Corsale, Lorraine, England, Christine, Mazzella, Allix, Geneslaw, Luke, Philip, John, Ntiamoah, Peter, Wright, Jeninne, Sirintrapun, Sahussapont Joseph, Lin, Oscar, Elenitoba-Johnson, Kojo, Reuter, Victor E., Hameed, Meera R., and Hanna, Matthew G.
- Subjects
OPERATING costs ,CLINICAL pathology ,PATHOLOGY - Abstract
Whole slide imaging is revolutionizing the field of pathology and is currently being used for clinical, educational, and research initiatives by an increasing number of institutions. Pathology departments have distinct needs for digital pathology systems, yet the cost of digital workflows is cited as a major barrier for widespread adoption by many organizations. Memorial Sloan Kettering Cancer Center (MSK) is an early adopter of whole slide imaging with incremental investments in resources that started more than 15 years ago. This experience and the large-scale scan operations led to the identification of required framework components of digital pathology operations. The cost of these components for the 2021 digital pathology operations at MSK were studied and calculated to enable an understanding of the operation and benchmark the accompanying costs. This paper describes the unique infrastructure cost and the costs associated with the digital pathology clinical operation use cases in a large, tertiary cancer center. These calculations can serve as a blueprint for other institutions to provide the necessary concepts and offer insights towards the financial requirements for digital pathology adoption by other institutions. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
8. Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation.
- Author
-
Ho, David Joon, Chui, M. Herman, Vanderbilt, Chad M., Jung, Jiwon, Robson, Mark E., Chan-Sik Park, Jin Roh, and Fuchs, Thomas J.
- Subjects
DEEP learning ,OVARIAN cancer ,BRCA genes ,HEMATOXYLIN & eosin staining ,DIAGNOSTIC imaging ,INTERACTIVE learning ,PIXELS - Abstract
Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict BRCA mutation. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
9. Data-driven color augmentation for H&E stained images in computational pathology.
- Author
-
Marini, Niccolò, Otalora, Sebastian, Wodzinski, Marek, Tomassini, Selene, Dragoni, Aldo Franco, Marchand-Maillet, Stephane, Dominguez Morales, Juan Pedro, Duran-Lopez, Lourdes, Vatrano, Simona, Müller, Henning, and Atzori, Manfredo
- Subjects
HEMATOXYLIN & eosin staining ,CONVOLUTIONAL neural networks ,COLOR ,TUMOR classification ,COLON cancer ,COLORING matter in food - Abstract
Computational pathology targets the automatic analysis of Whole Slide Images (WSI). WSIs are high-resolution digitized histopathology images, stained with chemical reagents to highlight specific tissue structures and scanned via whole slide scanners. The application of different parameters during WSI acquisition may lead to stain color heterogeneity, especially considering samples collected from several medical centers. Dealing with stain color heterogeneity often limits the robustness of methods developed to analyze WSIs, in particular Convolutional Neural Networks (CNN), the state-of-the-art algorithm for most computational pathology tasks. Stain color heterogeneity is still an unsolved problem, although several methods have been developed to alleviate it, such as Hue-Saturation-Contrast (HSC) color augmentation and stain augmentation methods. The goal of this paper is to present Data-Driven Color Augmentation (DDCA), a method to improve the efficiency of color augmentation methods by increasing the reliability of the samples used for training computational pathology models. During CNN training, a database including over 2 million H&E color variations collected from private and public datasets is used as a reference to discard augmented data with color distributions that do not correspond to realistic data. DDCA is applied to HSC color augmentation, stain augmentation and H&E-adversarial networks in colon and prostate cancer classification tasks. DDCA is then compared with 11 state-of-the-art baseline methods to handle color heterogeneity, showing that it can substantially improve classification performance on unseen data including heterogeneous color variations. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
10. Generative adversarial networks in digital pathology and histopathological image processing: A review.
- Author
-
Jose, Laya, Liu, Sidong, Russo, Carlo, Nadort, Annemarie, and Di Ieva, Antonio
- Subjects
GENERATIVE adversarial networks ,DIGITAL image processing ,IMAGE processing ,COLOR image processing ,DATA augmentation ,HISTOPATHOLOGY ,IMAGE enhancement (Imaging systems) ,STAINS & staining (Microscopy) - Abstract
Digital pathology is gaining prominence among the researchers with developments in advanced imaging modalities and new technologies. Generative adversarial networks (GANs) are a recent development in the field of artificial intelligence and since their inception, have boosted considerable interest in digital pathology. GANs and their extensions have opened several ways to tackle many challenging histopathological image processing problems such as color normalization, virtual staining, ink removal, image enhancement, automatic feature extraction, segmentation of nuclei, domain adaptation and data augmentation. This paper reviews recent advances in histopathological image processing using GANs with special emphasis on the future perspectives related to the use of such a technique. The papers included in this review were retrieved by conducting a keyword search on Google Scholar and manually selecting the papers on the subject of H&E stained digital pathology images for histopathological image processing. In the first part, we describe recent literature that use GANs in various image preprocessing tasks such as stain normalization, virtual staining, image enhancement, ink removal, and data augmentation. In the second part, we describe literature that use GANs for image analysis, such as nuclei detection, segmentation, and feature extraction. This review illustrates the role of GANs in digital pathology with the objective to trigger new research on the application of generative models in future research in digital pathology informatics. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
11. A pathologist-annotated dataset for validating artificial intelligence: A project description and pilot study.
- Author
-
Dudgeon, Sarah, Wen, Si, Hanna, Matthew, Gupta, Rajarsi, Amgad, Mohamed, Sheth, Manasi, Marble, Hetal, Huang, Richard, Herrmann, Markus, Szu, Clifford, Tong, Darick, Werness, Bruce, Szu, Evan, Larsimont, Denis, Madabhushi, Anant, Hytopoulos, Evangelos, Chen, Weijie, Singh, Rajendra, Hart, Steven, and Sharma, Ashish
- Subjects
ARTIFICIAL intelligence ,PILOT projects ,TUMOR-infiltrating immune cells ,COMPUTER-assisted image analysis (Medicine) ,MEDICAL equipment ,OPTICAL microscopes ,DIGITAL image correlation - Abstract
Purpose: Validating artificial intelligence algorithms for clinical use in medical images is a challenging endeavor due to a lack of standard reference data (ground truth). This topic typically occupies a small portion of the discussion in research papers since most of the efforts are focused on developing novel algorithms. In this work, we present a collaboration to create a validation dataset of pathologist annotations for algorithms that process whole slide images. We focus on data collection and evaluation of algorithm performance in the context of estimating the density of stromal tumor-infiltrating lymphocytes (sTILs) in breast cancer. Methods: We digitized 64 glass slides of hematoxylin- and eosin-stained invasive ductal carcinoma core biopsies prepared at a single clinical site. A collaborating pathologist selected 10 regions of interest (ROIs) per slide for evaluation. We created training materials and workflows to crowdsource pathologist image annotations on two modes: an optical microscope and two digital platforms. The microscope platform allows the same ROIs to be evaluated in both modes. The workflows collect the ROI type, a decision on whether the ROI is appropriate for estimating the density of sTILs, and if appropriate, the sTIL density value for that ROI. Results: In total, 19 pathologists made 1645 ROI evaluations during a data collection event and the following 2 weeks. The pilot study yielded an abundant number of cases with nominal sTIL infiltration. Furthermore, we found that the sTIL densities are correlated within a case, and there is notable pathologist variability. Consequently, we outline plans to improve our ROI and case sampling methods. We also outline statistical methods to account for ROI correlations within a case and pathologist variability when validating an algorithm. Conclusion: We have built workflows for efficient data collection and tested them in a pilot study. As we prepare for pivotal studies, we will investigate methods to use the dataset as an external validation tool for algorithms. We will also consider what it will take for the dataset to be fit for a regulatory purpose: study size, patient population, and pathologist training and qualifications. To this end, we will elicit feedback from the Food and Drug Administration via the Medical Device Development Tool program and from the broader digital pathology and AI community. Ultimately, we intend to share the dataset, statistical methods, and lessons learned. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
12. Deep learning approaches and applications in toxicologic histopathology: Current status and future perspectives.
- Author
-
Mehrvar, Shima, Himmel, Lauren, Babburi, Pradeep, Goldberg, Andrew, Guffroy, Magali, Janardhan, Kyathanahalli, Krempley, Amanda, and Bawa, Bhupinder
- Subjects
DEEP learning ,CLINICAL toxicology ,DECISION support systems ,HISTOPATHOLOGY ,CONVOLUTIONAL neural networks ,IMAGE analysis ,MACHINE learning - Abstract
Whole slide imaging enables the use of a wide array of digital image analysis tools that are revolutionizing pathology. Recent advances in digital pathology and deep convolutional neural networks have created an enormous opportunity to improve workflow efficiency, provide more quantitative, objective, and consistent assessments of pathology datasets, and develop decision support systems. Such innovations are already making their way into clinical practice. However, the progress of machine learning - in particular, deep learning (DL) - has been rather slower in nonclinical toxicology studies. Histopathology data from toxicology studies are critical during the drug development process that is required by regulatory bodies to assess drug-related toxicity in laboratory animals and its impact on human safety in clinical trials. Due to the high volume of slides routinely evaluated, low-throughput, or narrowly performing DL methods that may work well in small-scale diagnostic studies or for the identification of a single abnormality are tedious and impractical for toxicologic pathology. Furthermore, regulatory requirements around good laboratory practice are a major hurdle for the adoption of DL in toxicologic pathology. This paper reviews the major DL concepts, emerging applications, and examples of DL in toxicologic pathology image analysis. We end with a discussion of specific challenges and directions for future research. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF
13. Validation and implementation of Aperio LV1 remote live view telepathology system for intraoperative frozen section diagnosis.
- Author
-
Carll, Timothy, Siddiqui, Faiza, Agni, Meghana, Poon, Rachel, Nash, Cory, Gettings, Charlene, and Cipriani, Nicole
- Subjects
COVID-19 pandemic ,MICROSCOPY ,SURGICAL pathology ,TELECONFERENCING ,SURGERY - Abstract
Introduction: Telepathology (TP) allows for remote slide review with performance comparable to traditional light microscopy. Use of TP in the intraoperative setting allows for faster turnaround and greater user convenience by obviating the physical presence of the attending pathologist. We sought to perform a practical validation of an intraoperative TP system using the Leica Aperio LV1 scanner in tandem with Zoom teleconferencing software. Methods: A validation was performed in accordance with recommendations from CAP/ASCP, using a retrospectively identified sample of surgical pathology cases with a 1 year washout period. Only cases with frozen-final concordance were included. Validators underwent training in the operation of the instrument and conferencing interface, then reviewed the blinded slide set annotated with clinical information. Validator diagnoses were compared to original diagnoses for concordance. Results: 60 slides were chosen for inclusion. 8 validators completed the slide review, each requiring 2 h. The validation was completed in 2 weeks. Overall concordance was 96.4%. Intraobserver concordance was 97.3%. No major technical hurdles were encountered. Conclusion: Validation of the intraoperative TP system was completed rapidly and with high concordance, comparable to traditional light microscopy. Institutional teleconferencing implementation driven by the COVID pandemic facilitated ease of adoption. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
14. Whole slide imaging (WSI) scanner differences influence optical and computed properties of digitized prostate cancer histology.
- Author
-
Duenweg, Savannah R., Bobholz, Samuel A., Lowman, Allison K., Stebbins, Margaret A., Winiarz, Aleksandra, Nath, Biprojit, Kyereme, Fitzgerald, Iczkowski, Kenneth A., and LaViolette, Peter S.
- Subjects
OPTICAL properties ,PROSTATE cancer ,HISTOLOGY ,OPTICAL scanners ,OPACITY (Optics) ,IMAGE processing - Abstract
Purpose: Digital pathology is becoming an increasingly popular area of advancement in both research and clinically. Pathologists are now able to manage and interpret slides digitally, as well as collaborate with external pathologists with digital copies of slides. Differences in slide scanners include variation in resolution, image contrast, and optical properties, which may influence downstream image processing. This study tested the hypothesis that varying slide scanners would result in differences in computed pathomic features on prostate cancer whole mount slides. Design: This study collected 192 unique tissue slides from 30 patients following prostatectomy. Tissue samples were paraffin-embedded, stained for hematoxylin and eosin (H&E), and digitized using 3 different scanning microscopes at the highest available magnification rate, for a total of 3 digitized slides per tissue slide. These scanners included a (S1) Nikon microscope equipped with an automated sliding stage, an (S2) Olympus VS120 slide scanner, and a (S3) Huron TissueScope LE scanner. A color deconvolution algorithm was then used to optimize contrast by projecting the RGB image into color channels representing optical stain density. The resulting intensity standardized images were then computationally processed to segment tissue and calculate pathomic features including lumen, stroma, epithelium, and epithelial cell density, as well as second-order features including lumen area and roundness; epithelial area, roundness, and wall thickness; and cell fraction. For each tested feature, mean values of that feature per digitized slide were collected and compared across slide scanners using mixed effect models, fit to compare differences in the tested feature associated with all slide scanners for each slide, including a random effect of subject with a nested random effect of slide to account for repeated measures. Similar models were also computed for tissue densities to examine how differences in scanner impact downstream processing. Results: Each mean color channel intensity (i.e., Red, Green, Blue) differed between slide scanners (all P<.001). Of the color deconvolved images, only the hematoxylin channel was similar in all 3 scanners (all P>.05). Lumen and stroma densities between S3 and S1 slides, and epithelial cell density between S3 and S2 (P>.05) were comparable but all other comparisons were significantly different (P<.05). The second-order features were found to be comparable for all scanner comparisons, except for lumen area and epithelium area. Conclusion: This study demonstrates that both optical and computed properties of digitized histological samples are impacted by slide scanner differences. Future research is warranted to better understand which scanner properties influence the tissue segmentation process and to develop harmonization techniques for comparing data across multiple slide scanners. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
15. Validation of automated positive cell and region detection of immunohistochemically stained laryngeal tumor tissue using digital image analysis.
- Author
-
Smits, Hilde J. G., Swartz, Justin E., Philippens, Marielle E. P., de Bree, Remco, Kaanders, Johannes H. A. M., Koppes, Sjors A., Breimer, Gerben E., and Willems, Stefan M.
- Subjects
IMAGE analysis ,IMMUNOHISTOCHEMISTRY ,DIGITAL images ,HYPOXIA-inducible factors ,PATHOLOGISTS ,TISSUES - Abstract
Objectives: This study aimed to validate a digital image analysis (DIA) workflow for automatic positive cell detection and positive region delineation for immunohistochemical hypoxia markers with a nuclear (hypoxia-inducible factor 1α [HIF-1α]) and a cytoplasmic (pimonidazole [PIMO]) staining pattern. Materials and methods: 101 tissue fragments from 44 laryngeal tumor biopsies were immunohistochemically stained for HIF-1α and PIMO. QuPath was used to determine the percentage of positive cells and to delineate positive regions automatically. For HIF-1α, only cells with strong staining were considered positive. Three dedicated head and neck pathologists scored the percentage of positive cells using three categories (0: <1%; 1: 1%-33%; 2: >33%;). The pathologists also delineated the positive regions on 14 corresponding PIMO and HIF-1α-stained fragments. The consensus between observers was used as the reference standard and was compared to the automatic delineation. Results: Agreement between categorical positivity scores was 76.2% and 65.4% for PIMO and HIF-1α, respectively. In all cases of disagreement in HIF-1α fragments, the DIA underestimated the percentage of positive cells. As for the region detection, the DIA correctly detected most positive regions on PIMO fragments (false positive area=3.1%, false negative area=0.7%). In HIF-1α, the DIA missed some positive regions (false positive area=1.3%, false negative area=9.7%). Conclusions: Positive cell and region detection on biopsy material is feasible, but further optimization is needed before unsupervised use. Validation at varying DAB staining intensities is hampered by lack of reliability of the gold standard (i.e., visual human interpretation). Nevertheless, the DIA method has the potential to be used as a tool to assist pathologists in the analysis of IHC staining [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
16. XML-GBM lung: An explainable machine learning-based application for the diagnosis of lung cancer.
- Author
-
Rikta, Sarreha Tasmin, Mohi Uddin, Khandaker Mohammad, Biswas, Nitish, Mostafiz, Rafid, Sharmin, Fateha, and Dey, Samrat Kumar
- Subjects
LUNG cancer ,MACHINE learning ,CANCER diagnosis ,LUNGS ,OVERALL survival ,ERROR rates - Abstract
Lung cancer has been the leading cause of cancer-related deaths worldwide. Early detection and diagnosis of lung cancer can greatly improve the chances of survival for patients. Machine learning has been increasingly used in the medical sector for the detection of lung cancer, but the lack of interpretability of these models remains a significant challenge. Explainable machine learning (XML) is a new approach that aims to provide transparency and interpretability for machine learning models. The entire experiment has been performed in the lung cancer dataset obtained from Kaggle. The outcome of the predictive model with ROS (Random Oversampling) class balancing technique is used to comprehend the most relevant clinical features that contributed to the prediction of lung cancer using a machine learning explainable technique termed SHAP (SHapley Additive exPlanation). The results show the robustness of GBM's capacity to detect lung cancer, with 98.76% accuracy, 98.79% precision, 98.76% recall, 98.76% F-Measure, and 0.16% error rate, respectively. Finally, a mobile app is developed incorporating the best model to show the efficacy of our approach. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
17. 702Using an anomaly detection approach for the segmentation of colorectal cancer tumors in whole slide images.
- Author
-
Qiangqiang Gu, Meroueh, Chady, Levernier, Jacob, Kroneman, Trynda, Flotte, Thomas, and Hart, Steven
- Subjects
COLORECTAL cancer ,COLON tumors ,GENETIC testing ,SURVIVAL rate ,INTRUSION detection systems (Computer security) - Abstract
Colorectal cancer (CRC) is the second most commonly diagnosed cancer in the United States. Genetic testing is critical in assisting in the early detection of CRC and selection of individualized treatment plans, which have shown to improve the survival rate of CRC patients. The tissue slide review (TSR), a tumor tissue macro-dissection procedure, is a required pre-analytical step to perform genetic testing. Due to the subjective nature of the process, major discrepancies in CRC diagnostics by pathologists are reported, and metrics for quality are often only qualitative. Progressive context encoder anomaly detection (P-CEAD) is an anomaly detection approach to detect tumor tissue from whole slide images (WSIs), since tumor tissue is by its nature, an anomaly. P-CEAD-based CRC tumor segmentation achieves a 71% 26% sensitivity, 92% 7% specificity, and 63% 23% F1 score. The proposed approach provides an automated CRC tumor segmentation pipeline with a quantitatively reproducible quality compared with the conventional manual tumor segmentation procedure. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
18. Transformer-based personalized attention mechanism for medical images with clinical records.
- Author
-
Yusuke Takagi, Noriaki Hashimoto, Hiroki Masuda, Hiroaki Miyoshi, Koichi Ohshima, Hidekata Hontani, and Ichiro Takeuchi
- Subjects
DIAGNOSTIC imaging ,MEDICAL records ,TRANSFORMER models ,PIXELS ,DIAGNOSIS ,MEDICAL practice ,DIGITAL images - Abstract
In medical image diagnosis, identifying the attention region, i.e., the region of interest for which the diagnosis is made, is an important task. Various methods have been developed to automatically identify target regions from given medical images. However, in actual medical practice, the diagnosis is made based on both the images and various clinical records. Consequently, pathologists examine medical images with prior knowledge of the patients and the attention regions may change depending on the clinical records. In this study, we propose a method, called the Personalized Attention Mechanism (PersAM) method, by which the attention regions in medical images according to the clinical records. The primary idea underlying the PersAM method is the encoding of the relationships between medical images and clinical records using a variant of the Transformer architecture. To demonstrate the effectiveness of the PersAM method, we applied it to a large-scale digital pathology problem involving identifying the subtypes of 842 malignant lymphoma patients based on their gigapixel whole-slide images and clinical records. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
19. The Nomadic Digital Pathologist. Validation of a simple, dual slide scanner with remote reporting for a regional upper gastrointestinal specialist multidisciplinary meeting.
- Author
-
Bracey, Tim S
- Subjects
PATHOLOGISTS ,GASTROINTESTINAL cancer ,CANCER hospitals ,SURGICAL excision ,COVID-19 pandemic - Abstract
Background: This article describes how a simple slide scanner with remote viewing software enabled a remote “nomadic” pathologist to continue his role as specialist lead for a regional gastrointestinal multidisciplinary team meeting (MDTM) after relocating to another site in the 5 hospital Southwest UK Peninsula cancer network just prior to the COVID-19 pandemic. Materials and methods: The author used digital pathology (DP) to supplement a conventional workflow as a way of minimising delay in reporting and reviewing slides for a regional specialist Oesophagogastric MDTM (the OGSMDT). The specialist centre at University Hospital Plymouth (UHP) is 58 miles from the author’s new workplace at Royal Cornwall Hospital (RCHT). Slides from the 44 cases (10% of this specialist annual workload) in this validation study were reported or reviewed digitally using the slide scanner. All were listed for the OGSMDT due to being clinically suspicious for upper gastrointestinal malignancy, having been processed at UHP, or one of the other hospitals in the cancer network. Results: The scanner allowed the author who was only on site at UHP 1 day per week to prevent delays in reporting/ reviewing glass slides, using remote DP. Confidence in digital diagnosis was assessed using the Royal College of Pathologists recommendations. The author was the primary pathologist signing out 31, and second opinion for the remaining 13 cases. These comprised a mixture of biopsies as well as endoscopic and surgical excision specimens. The DP system enabled the author to report the cases digitally with an equivalent degree of confidence to glass slides and no significant discrepancies were identified between the author’s digital and final glass slide diagnosis. Conclusions: The scanner was found to be safe and effective for remote reporting and review for OGSMDT cases. It was recognised that DP was advantageous to enable this role to continue remotely but that a fully integrated digital reporting system capable of high-capacity scanning would be preferable to the simple system used. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
20. Unsupervised many-to-many stain translation for histological image augmentation to improve classification accuracy.
- Author
-
Berijanian, Maryam, Schaadt, Nadine S., Huang, Boqiang, Lotz, Johannes, Feuerhake, Friedrich, and Merhof, Dorit
- Subjects
ARTIFICIAL neural networks ,IMAGE recognition (Computer vision) ,DEEP learning ,BREAST ,DYES & dyeing - Abstract
Background: Deep learning tasks, which require large numbers of images, are widely applied in digital pathology. This poses challenges especially for supervised tasks since manual image annotation is an expensive and laborious process. This situation deteriorates even more in the case of a large variability of images. Coping with this problem requires methods such as image augmentation and synthetic image generation. In this regard, unsupervised stain translation via GANs has gained much attention recently, but a separate network must be trained for each pair of source and target domains. This work enables unsupervised many-to-many translation of histopathological stains with a single network while seeking to maintain the shape and structure of the tissues. Methods: StarGAN-v2 is adapted for unsupervised many-to-many stain translation of histopathology images of breast tissues. An edge detector is incorporated to motivate the network to maintain the shape and structure of the tissues and to have an edge-preserving translation. Additionally, a subjective test is conducted on medical and technical experts in the field of digital pathology to evaluate the quality of generated images and to verify that they are indistinguishable from real images. As a proof of concept, breast cancer classifiers are trained with and without the generated images to quantify the effect of image augmentation using the synthetized images on classification accuracy. Results: The results show that adding an edge detector helps to improve the quality of translated images and to preserve the general structure of tissues. Quality control and subjective tests on our medical and technical experts show that the real and artificial images cannot be distinguished, thereby confirming that the synthetic images are technically plausible. Moreover, this research shows that, by augmenting the training dataset with the outputs of the proposed stain translation method, the accuracy of breast cancer classifier with ResNet-50 and VGG-16 improves by 8.0% and 9.3%, respectively. Conclusions: This research indicates that a translation from an arbitrary source stain to other stains can be performed effectively within the proposed framework. The generated images are realistic and could be employed to train deep neural networks to improve their performance and cope with the problem of insufficient numbers of annotated images. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
21. Segmentation of polyps based on pyramid vision transformers and residual block for real-time endoscopy imaging.
- Author
-
Nachmani, Roi, Nidal, Issa, Robinson, Dror, Yassin, Mustafa, and Abookasis, David
- Subjects
TRANSFORMER models ,CONVOLUTIONAL neural networks ,POLYPS ,COLON polyps ,MACHINE learning - Abstract
Polyp segmentation is an important task in early identification of colon polyps for prevention of colorectal cancer. Numerous methods of machine learning have been utilized in an attempt to solve this task with varying levels of success. A successful polyp segmentation method which is both accurate and fast could make a huge impact on colonoscopy exams, aiding in real-time detection, as well as enabling faster and cheaper offline analysis. Thus, recent studies have worked to produce networks that are more accurate and faster than the previous generation of networks (e.g., NanoNet). Here, we propose ResPVT architecture for polyp segmentation. This platform uses transformers as a backbone and far surpasses all previous networks not only in accuracy but also with a much higher frame rate which may drastically reduce costs in both real time and offline analysis and enable the widespread application of this technology. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
22. Pathology Visions 2022 Overview.
- Subjects
DEEP learning ,PATHOLOGY ,ARTIFICIAL intelligence ,MEDICAL sciences ,MEDICAL libraries ,MEDICAL personnel - Published
- 2023
- Full Text
- View/download PDF
23. The ChatGPT conundrum: Human-generated scientific manuscripts misidentified as AI creations by AI text detection tool.
- Author
-
Rashidi, Hooman H., Fennell, Brandon D., Albahra, Samer, Hu, Bo, and Gorbett, Tom
- Subjects
CHATBOTS ,CHATGPT ,ARTIFICIAL intelligence ,GENERATIVE artificial intelligence ,LANGUAGE models - Abstract
AI Chat Bots such as ChatGPT are revolutionizing our AI capabilities, especially in text generation, to help expedite many tasks, but they introduce new dilemmas. The detection of AI-generated text has become a subject of great debate considering the AI text detector’s known and unexpected limitations. Thus far, much research in this area has focused on the detection of AI-generated text; however, the goal of this study was to evaluate the opposite scenario, an AI-text detection tool's ability to discriminate human-generated text. Thousands of abstracts from several of the most wellknown scientific journals were used to test the predictive capabilities of these detection tools, assessing abstracts from 1980 to 2023. We found that the AI text detector erroneously identified up to 8% of the known real abstracts as AI-generated text. This further highlights the current limitations of such detection tools and argues for novel detectors or combined approaches that can address this shortcoming and minimize its unanticipated consequences as we navigate this new AI landscape. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
24. Predicting breast cancer-specific survival in metaplastic breast cancer patients using machine learning algorithms.
- Author
-
Yufan Feng, McGuire, Natasha, Walton, Alexandra, Consortium, AP-MBC, Fox, Stephen, Papa, Antonella, Lakhani, Sunil R., and McCart Reed, Amy E.
- Subjects
RANDOM forest algorithms ,BREAST cancer ,CANCER patients ,MACHINE learning ,DECISION trees ,FORECASTING - Abstract
Metaplastic breast cancer (MpBC) is a rare and aggressive subtype of breast cancer, with data emerging on prognostic factors and survival prediction. This study aimed to develop machine learning models to predict breast cancer-specific survival (BCSS) in MpBC patients, utilizing a dataset of 160 patients with clinical, pathological, and biological variables. An in-depth variable selection process was carried out using gain ratio and correlation-based methods, resulting in 10 variables for model estimation. Five models (decision tree with bagging; logistic regression; multilayer perceptron; naïve Bayes; and, random forest algorithms) were evaluated using 10-fold cross-validation. Despite the constraints posed by the absence of therapeutic information, the random forest model exhibited the highest performance in predicting BCSS, with an ROC area of 0.808. This study emphasizes the potential of machine learning algorithms in predicting prognosis for complex and heterogeneous cancer subtypes using clinical datasets, and their potential to contribute to patient management. Further research that incorporates additional variables, such as treatment response, and more advanced machine learning techniques will likely enhance the predictive power of MpBC prognostic models. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
25. Pathology Informatics Summit 2023 David L. Lawrence Convention Center May 22-May 25 Pittsburgh, PA.
- Subjects
DEEP learning ,BREAST ,MEDICAL sciences ,PATHOLOGY ,CONVENTION facilities ,MACHINE learning ,MEDICAL care - Published
- 2023
- Full Text
- View/download PDF
26. Pathology Informatics Summit 2022 David L. Lawrence Convention Center May 9-12 Pittsburgh, PA.
- Author
-
Hernandez, Patricia, Kwon, Jennie H., Dubberke, Erik R., and Jackups, Ronald
- Subjects
MEDICAL informatics ,DEEP learning ,PATHOLOGY ,CONVENTION facilities ,MACHINE learning ,HEALTH Insurance Portability & Accountability Act ,RESPIRATION - Published
- 2023
- Full Text
- View/download PDF
27. Investigation of semi- and self-supervised learning methods in the histopathological domain.
- Author
-
Voigt, Benjamin, Fischer, Oliver, Schilling, Bruno, Krumnow, Christian, and Herta, Christian
- Subjects
SUPERVISED learning ,HISTOPATHOLOGY ,MACHINE learning ,DEEP learning - Abstract
Training models with semi- or self-supervised learning methods is one way to reduce annotation effort since they rely on unlabeled or sparsely labeled datasets. Such approaches are particularly promising for domains with a time-consuming annotation process requiring specialized expertise and where high-quality labeled machine learning datasets are scarce, like in computational pathology. Even though some of these methods have been used in the histopathological domain, there is, so far, no comprehensive study comparing different approaches. Therefore, this work compares feature extractors models trained with state-of-the-art semi- or self-supervised learning methods PAWS, SimCLR, and SimSiam within a unified framework. We show that such models, across different architectures and network configurations, have a positive performance impact on histopathological classification tasks, even in low data regimes. Moreover, our observations suggest that features learned from a particular dataset, i.e., tissue type, are only in-domain transferable to a certain extent. Finally, we share our experience using each method in computational pathology and provide recommendations for its use. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
28. HistoPerm: A permutation-based view generation approach for improving histopathologic feature representation learnin.
- Author
-
DiPalma, Joseph, Torresani, Lorenzo, and Hassanpour, Saeed
- Subjects
RENAL cell carcinoma ,IMAGE recognition (Computer vision) ,CELIAC disease ,PERMUTATIONS ,DEEP learning ,IMAGE analysis - Abstract
Deep learning has been effective for histology image analysis in digital pathology. However, many current deep learning approaches require large, strongly- or weakly labeled images and regions of interest, which can be time-consuming and resource-intensive to obtain. To address this challenge, we present HistoPerm, a view generation method for representation learning using joint embedding architectures that enhances representation learning for histology images. HistoPerm permutes augmented views of patches extracted from whole-slide histology images to improve classification performance. We evaluated the effectiveness of HistoPerm on 2 histology image datasets for Celiac disease and Renal Cell Carcinoma, using 3 widely used joint embedding architecture-based representation learning methods: BYOL, SimCLR, and VICReg. Our results show that HistoPerm consistently improves patch- and slide-level classification performance in terms of accuracy, F1-score, and AUC. Specifically, for patch-level classification accuracy on the Celiac disease dataset, HistoPerm boosts BYOL and VICReg by 8% and SimCLR by 3%. On the Renal Cell Carcinoma dataset, patch-level classification accuracy is increased by 2% for BYOL and VICReg, and by 1% for SimCLR. In addition, on the Celiac disease dataset, models with HistoPerm outperform the fully supervised baseline model by 6%, 5%, and 2% for BYOL, SimCLR, and VICReg, respectively. For the Renal Cell Carcinoma dataset, HistoPerm lowers the classification accuracy gap for the models up to 10% relative to the fully supervised baseline. These findings suggest that HistoPerm can be a valuable tool for improving representation learning of histopathology features when access to labeled data is limited and can lead to whole-slide classification results that are comparable to or superior to fully supervised methods. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
29. Improving Lyme disease testing with data driven test design in pediatrics.
- Author
-
Elkhadrawi, Mahmoud, Lopez-Nunez, Oscar, Akcakaya, Murat, and Wheeler, Sarah E.
- Subjects
LYME disease ,BLOOD testing ,MACHINE learning ,MEDICAL screening ,TEST design ,SUPPORT vector machines ,COMPUTATIONAL neuroscience - Abstract
Diagnostic advances have not kept pace with the expansion of Lyme disease caused by Borrelia burgdorferi and transmitted by ticks. Lyme disease clinical manifestations can overlap with many other diagnoses making Lyme disease a critical part of many differential diagnoses in endemic areas. Current diagnostic blood tests rely on a 2-tiered algorithm for which the second step is either a time-consuming western blot or a whole cell lysate immunoassay. Neither of these second step tests allow for rapid results of this critical rule out test. We hypothesized that using western blot confirmation information, we could create computational models to propose recombinant second-tier tests that would allow for more rapid, automated, and specific testing algorithms. We propose here a framework for assessing retrospective data to determine putative recombinant assay components. A retrospective pediatric cohort of 2755 samples submitted for Lyme disease screening was assessed using support vector machine learning algorithms to optimize tier 1 diagnostic thresholds for the Vidas IgG II assay and determine optimal tier 2 components for both a positive and negative confirmation test. In cases where the tier 1 screen was negative, but clinical suspicion was high, we found that 1 protein (L58) could be used to reduce false-negative results. For second-tier testing of screen positive cases, we found that 6 proteins could be used to reduce false-positive results (L18, L39M, L39, L41, L45, and L58) with a final machine learning classifier or 2 proteins using a final rules-based approach (L41, L18). This led to an overall accuracy of 92.36% for the proposed algorithm without a final machine learning classifier and 92.12% with integration of the machine learning classifier in the final algorithm when compared to the IgG western blot as the gold-standard. Use of this framework across multiple assays and institutions will allow for a data-driven approach to assay development to provide laboratories and patients with the improvements in turnaround time needed for this testing. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
30. Impact of a switch to immediate release on the patient viewing of diagnostic test results in an online portal at an academic medical center.
- Author
-
Wood, Kelly E., Pham, Hanh T., Carter, Knute D., Nepple, Kenneth G., Blum, James M., and Krasowski, Matthew D.
- Subjects
PATIENT portals ,MEDICAL records ,ACADEMIC medical centers ,DIAGNOSIS methods ,CHILD patients ,ELECTRONIC health records - Abstract
Patient portals allow patients to access their personal health information. The 21st Century Cures Act in the United States sought to eliminate ‘information blocking’, requiring timely release upon request of electronic health information including diagnostic test results. Some health systems, including the one in the present study, chose a systematic switch to immediate release of all or nearly all diagnostic test results to patient portals as part of compliance with the Cures Act. Our primary objective was to study changes in the time to view test results by patients before and after implementation of Cures Act-related changes. This retrospective pre-post study included data from two 10-month time periods before and after implementation of Cures Act-related changes at an academic medical center. The study included all patients (adult and pediatric) with diagnostic testing (laboratory and imaging) performed in the outpatient, inpatient, or emergency department settings. Between February 9, 2020 and December 9, 2021, there was a total of 3 809 397 diagnostic tests from 204 605 unique patients (3 320 423 tests for adult patients; 488 974 for pediatric patients). Overall, 56.5% (115 627) of patients were female, 84.1% (172 048) white, and 96.5% (197 517) preferred English as primary language. The odds of viewing test results within 1 and 30 days after portal release increased monthly throughout both time periods before and after the Cures Act for all patients. The rate of increase was significantly higher after implementation only in the subgroup of tests belonging to adult patients with active MyChart accounts. Immediate release shifted a higher proportion of result/report release to weekends (3.2% pre-Cures vs 15.3% post-Cures), although patient viewing patterns by day of week and time of day were similar before and after immediate release changes. The switch to immediate release of diagnostic test results to the patient portal resulted in a higher fraction of results viewed within 1 day across outpatient, inpatient, and emergency department settings. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
31. Imaging bridges pathology and radiology.
- Author
-
Hansmann, Martin-Leo, Klauschen, Frederick, Samek, Wojciech, Müller, Klaus-Robert, Donnadieu, Emmanuel, Scharf, Sonja, Hartmann, Sylvia, Koch, Ina, Ackermann, Jörg, Pantanowitz, Liron, Schäfer, Hendrik, and Wurz, Patrick
- Subjects
PATHOLOGY ,NUCLEAR medicine ,LYMPHOID tissue ,RADIOLOGY ,MACHINE learning - Abstract
vIn recent years, medical disciplines have moved closer together and rigid borders have been increasingly dissolved. The synergetic advantage of combining multiple disciplines is particularly important for radiology, nuclear medicine, and pathology to perform integrative diagnostics. In this review, we discuss how medical subdisciplines can be reintegrated in the future using state-of-the-art methods of digitization, data science, and machine learning. Integration of methods is made possible by the digitalization of radiological and nuclear medical images, as well as pathological images. 3D histology can become a valuable tool, not only for integration into radiological images but also for the visualization of cellular interactions, the so-called connectomes. In human pathology, it has recently become possible to image and calculate the movements and contacts of immunostained cells in fresh tissue explants. Recording the movement of a living cell is proving to be informative and makes it possible to study dynamic connectomes in the diagnosis of lymphoid tissue. By applying computational methods including data science and machine learning, new perspectives for analyzing and understanding diseases become possible. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
32. High-fidelity detection, subtyping, and localization of five skin neoplasms using supervised and semi-supervised learning.
- Author
-
Requa, James, Godard, Tuatini, Mandal, Rajni, Balzer, Bonnie, Whittemore, Darren, George, Eva, Barcelona, Frenalyn, Lambert, Chalette, Lee, Jonathan, Lambert, Allison, Larson, April, and Osmond, Gregory
- Subjects
SKIN tumors ,BASAL cell carcinoma ,SKIN cancer - Abstract
Background: Skin cancers are the most common malignancies diagnosed worldwide. While the early detection and treatment of pre-cancerous and cancerous skin lesions can dramatically improve outcomes, factors such as a global shortage of pathologists, increased workloads, and high rates of diagnostic discordance underscore the need for techniques that improve pathology workflows. Although AI models are now being used to classify lesions from whole slide images (WSIs), diagnostic performance rarely surpasses that of expert pathologists. Objectives: The objective of the present study was to create an AI model to detect and classify skin lesions with a higher degree of sensitivity than previously demonstrated, with potential to match and eventually surpass expert pathologists to improve clinical workflows. Methods: We combined supervised learning (SL) with semi-supervised learning (SSL) to produce an end-to-end multilevel skin detection system that not only detects 5 main types of skin lesions with high sensitivity and specificity, but also subtypes, localizes, and provides margin status to evaluate the proximity of the lesion to non-epidermal margins. The Supervised Training Subset consisted of 2188 random WSIs collected by the PathologyWatch (PW) laboratory between 2013 and 2018, while the Weakly Supervised Subset consisted of 5161 WSIs from daily case specimens. The Validation Set consisted of 250 curated daily case WSIs obtained from the PW tissue archives and included 50 “mimickers”. The Testing Set (3821 WSIs) was composed of non-curated daily case specimens collected from July 20, 2021 to August 20, 2021 from PW laboratories. Results: The performance characteristics of our AI model (i.e., Mihm) were assessed retrospectively by running the Testing Set through the Mihm Evaluation Pipeline. Our results show that the sensitivity of Mihm in classifying melanocytic lesions, basal cell carcinoma, and atypical squamous lesions, verruca vulgaris, and seborrheic keratosis was 98.91% (95% CI: 98.27%, 99.55%), 97.24% (95% CI: 96.15%, 98.33%), 95.26% (95% CI: 93.79%, 96.73%), 93.50% (95% CI: 89.14%, 97.86%), and 86.91% (95% CI: 82.13%, 91.69%), respectively. Additionally, our multi-level (i.e., patch-level, ROI-level, and WSI-level) detection algorithm includes a qualitative feature that subtypes lesions, an AI overlay in the front-end digital display that localizes diagnostic ROIs, and reports on margin status by detecting overlap between lesions and non-epidermal tissue margins. Conclusions: Our AI model, developed in collaboration with dermatopathologists, detects 5 skin lesion types with higher sensitivity than previously published AI models, and provides end users with information such as subtyping, localization, and margin status in a front-end digital display. Our end-to-end system has the potential to improve pathology workflows by increasing diagnostic accuracy, expediting the course of patient care, and ultimately improving patient outcomes. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
33. H&E image analysis pipeline for quantifying morphological features.
- Author
-
Ariotta, Valeria, Lehtonen, Oskari, Salloum, Shams, Micoli, Giulia, Lavikka, Kari, Rantanen, Ville, Hynninen, Johanna, Virtanen, Anni, and Hautaniemi, Sampsa
- Subjects
IMAGE analysis ,FEATURE extraction ,HEMATOXYLIN & eosin staining ,CELL imaging ,PLOIDY ,INDUCED ovulation - Abstract
Detecting cell types from histopathological images is essential for various digital pathology applications. However, large number of cells in whole-slide images (WSIs) necessitates automated analysis pipelines for efficient cell type detection. Herein, we present hematoxylin and eosin (H&E) Image Processing pipeline (HEIP) for automatied analysis of scanned H&E-stained slides. HEIP is a flexible and modular open-source software that performs preprocessing, instance segmentation, and nuclei feature extraction. To evaluate the performance of HEIP, we applied it to extract cell types from ovarian high-grade serous carcinoma (HGSC) patient WSIs. HEIP showed high precision in instance segmentation, particularly for neoplastic and epithelial cells. We also show that there is a significant correlation between genomic ploidy values and morphological features, such as major axis of the nucleus. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
34. Digital pathology implementation in a private laboratory: The CEDAP experience.
- Author
-
Ferreira, Inês, Montenegro, Carlos Sachica, Coelho, Daniel, Pereira, Maria, da Mata, Sara, Carvalho, Sofia, Araújo, Ana Catarina, Abrantes, Carlos, Ruivo, José Mário, Garcia, Helena, and Oliveira, Rui Caetano
- Subjects
ERROR rates ,ARTIFICIAL intelligence ,PATHOLOGY ,PATHOLOGISTS ,LABORATORIES - Abstract
Introduction: The transition to digital pathology has been carried out by several laboratories across the globe, with some cases described in Portugal. In this article, we describe the transition to digital pathology in a high-volume private laboratory, considering the main challenges and opportunities. Material and methods: Our process started in 2020, with laboratory workflow adaptation and we are currently using a high-capacity scanner (Aperio GT450DX) to digitize slides at 20×. The visualization system, Aperio eSlide Manager WebViewer, is integrated into the Laboratory System. The validation process followed the Royal College of Pathologists Guidelines. Results: Regarding validation, the first phase detected an error rate of 6.8%, mostly due to digitization errors. Phase optimization and collaboration with technical services led to improvements in this process. In the second validation phase, most of the slides had the desired quality for evaluation, with only an error rate of 0.6%, corrected with a new scan. The interpathologist correlation had a total agreement rate of 96.87% and 3.13% partial agreement. Conclusion: The implementation and validation of digital pathology was a success, being ready for prime time. The total integration of all laboratory systems and the acquisition of new equipment will maximize their use, especially with the application of artificial intelligence algorithms. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
35. Efficient quality control of whole slide pathology images with human-in-the-loop training.
- Author
-
Patil, Abhijeet, Diwakar, Harsh, Sawant, Jay, Kurian, Nikhil Cherian, Yadav, Subhash, Rane, Swapnil, Bameta, Tripti, and Sethi, Amit
- Subjects
DEEP learning ,QUALITY control ,RECEIVER operating characteristic curves ,LYMPH node cancer ,PATHOLOGY ,LUNG cancer - Abstract
Histopathology whole slide images (WSIs) are being widely used to develop deep learning-based diagnostic solutions, especially for precision oncology. Most of these diagnostic softwares are vulnerable to biases and impurities in the training and test data which can lead to inaccurate diagnoses. For instance, WSIs contain multiple types of tissue regions, at least some of which might not be relevant to the diagnosis. We introduce HistoROI, a robust yet lightweight deep learning-based classifier to segregate WSI into 6 broad tissue regions-epithelium, stroma, lymphocytes, adipose, artifacts, and miscellaneous. HistoROI is trained using a novel human in-the-loop and active learning paradigm that ensures variations in training data for labeling efficient generalization. HistoROI consistently performs well across multiple organs, despite being trained on only a single dataset, demonstrating strong generalization. Further, we have examined the utility of HistoROI in improving the performance of downstream deep learning-based tasks using the CAMELYON breast cancer lymph node and TCGA lung cancer datasets. For the former dataset, the area under the receiver operating characteristic curve (AUC) for metastasis versus normal tissue of a neural network trained using weakly supervised learning increased from 0.88 to 0.92 by filtering the data using HistoROI. Similarly, the AUC increased from 0.88 to 0.93 for the classification between adenocarcinoma and squamous cell carcinoma on the lung cancer dataset. We also found that the performance of the HistoROI improves upon HistoQC for artifact detection on a test dataset of 93 annotated WSIs. The limitations of the proposed model are analyzed, and potential extensions are also discussed. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
36. Development of an interactive web dashboard to facilitate the reexamination of pathology reports for instances of underbilling of CPT code.
- Author
-
Greenburg, Jack, Yunrui Lu, Shuyang Lu, Kamau, Uhuru, Hamilton, Robert, Pettus, Jason, Preum, Sarah, Vaickus, Louis, and Levy, Joshua
- Subjects
WEB development ,NATURAL language processing ,WEB-based user interfaces ,PATHOLOGY ,HEALTH care industry billing - Abstract
Current Procedural Terminology Codes is a numerical coding system used to bill for medical procedures and services and crucially, represents a major reimbursement pathway. Given that pathology services represent a consequential source of hospital revenue, understanding instances where codes may have been misassigned or underbilled is critical. Several algorithms have been proposed that can identify improperly billed CPT codes in existing datasets of pathology reports. Estimation of the fiscal impacts of these reports requires a coder (i.e., billing staff) to review the original reports and manually code them again. As the re-assignment of codes using machine learning algorithms can be done quickly, the bottleneck in validating these reassignments is in this manual re-coding process, which can prove cumbersome. This work documents the development of a rapidly deployable dashboard for examination of reports that the original coder may have misbilled. Our dashboard features the following main components: (1) a bar plot to show the predicted probabilities for each CPT code, (2) an interpretation plot showing how each word in the report combines to form the overall prediction, and (3) a place for the user to input the CPT code they have chosen to assign. This dashboard utilizes the algorithms developed to accurately identify CPT codes to highlight the codes missed by the original coders. In order to demonstrate the function of this web application, we recruited pathologists to utilize it to highlight reports that had codes incorrectly assigned. We expect this application to accelerate the validation of re-assigned codes through facilitating rapid review of false-positive pathology reports. In the future, we will use this technology to review thousands of past cases in order to estimate the impact of underbilling has on departmental revenue. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
37. Differentiation of urothelial carcinoma in histopathology images using deep learning and visualiza.
- Author
-
Mundhada, Aniruddha, Sundaram, Sandhya, Swaminathan, Ramakrishnan, Cruze, Lawrence D', Govindarajan, Satyavratan, and Makaram, Navaneethakrishna
- Subjects
DEEP learning ,TRANSITIONAL cell carcinoma ,TRANSURETHRAL resection of bladder ,CONVOLUTIONAL neural networks ,ARTIFICIAL intelligence ,BLADDER - Abstract
Artificial Intelligence is a tool poised to transform healthcare, with use in diagnostics and therapeutics. The widespread use of digital pathology has been due to the advent of whole slide imaging. Cheaper storage for digital images, along with unprecedented progress in artificial intelligence, have paved the synergy of these two fields. This has pushed the limits of traditional diagnosis using light microscopy, from a more subjective to a more objective method of looking at cases, incorporating grading too. The grading of histopathological images of urothelial carcinoma of the urinary bladder is important with direct implications for surgical management and prognosis. In this study, the aim is to classify urothelial carcinoma into low and high grade based on the WHO 2016 classification. The hematoxylin and eosin-stained transurethral resection of bladder tumor (TURBT) samples of both low and high grade non-invasive papillary urothelial carcinoma were digitally scanned. Patches were extracted from these whole slide images to feed into a deep learning (Convolution Neural Network: CNN) model. Patches were segregated if they had tumor tissue and only included for model training if a threshold of 90% of tumor tissue per patch was seen. Various parameters of the deep learning model, known as hyperparameters, were optimized to get the best accuracy for grading or classification into low- and high-grade urothelial carcinoma. The model was robust with an overall accuracy of 90% after hyperparameter tuning. Visualization in the form of a class activation map using Grad-CAM was done. This indicates that such a model can be used as a companion diagnostic tool for grading of urothelial car cinoma. The probable causes of this accuracy are summarized along with the limitations of this study and future work possible. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
38. Diagnostic validation of a portable whole slide imaging scanner for lymphoma diagnosis in resource-constrained setting: A cross-sectional study.
- Author
-
Mremi, Alex, Achola, Caroline, Mbwambo, Daniel, Magorosa, Erick, Legason, Ismail D, Vavoulis, Dimitris, El Mouden, Claire, Schuh, Anna, and Mnango, Leah
- Subjects
CANCER diagnosis ,CROSS-sectional imaging ,RESOURCE-limited settings ,CROSS-sectional method ,HEMATOXYLIN & eosin staining ,SURGICAL pathology - Abstract
Background: Telepathology utilizing high-throughput static whole slide image scanners is proposed to address the challenge of limited pathology services in resource-restricted settings. However, the prohibitive equipment costs and sophisticated technologies coupled with large amounts of space to set up the devices make it impractical for use in resource-limited settings. Herein, we aimed to address this challenge by validating a portable whole slide imaging (WSI) device against glass slide microscopy (GSM) using lymph node biopsies from suspected lymphoma cases from Sub-Saharan Africa. Material and methods: This was part of a multicenter prospective case-control head-to-head comparison study of liquid biopsy against conventional pathology. For the portable WSI scanner validation, the study pathologists evaluated 105 surgical lymph node specimens initially confirmed by gold-standard pathology between February and December 2021. The tissues were processed according to standard protocols for Hematoxylin and Eosin (H&E) and Immunohistochemistry (IHC) staining by well-trained histotechnicians, then digitalized the H& E and IHC slides at each center. The digital images were anonymized and uploaded to a HIPAA-compliant server by the histotechnicians. Three study pathologists independently accessed and reviewed the images after a 6-week washout. The agreement between diagnoses established on GSM and WSI across the pathologists was described and measured using Cohens’ kappa coefficient (κ). Results: On GSM, 65.5% (n=84) of specimens were lymphoma; 25% were classified as benign, while 9.5% were metastatic. Morphological quality assessment on GSM and WSI established that 79.8% and 53.6% of cases were of high quality, respectively. When diagnoses by GSM were compared to WSI, the overall concordance for various diagnostic categories was 93%, 100%, and 86% for lymphoma, metastases, and benign conditions respectively. The sensitivity and specificity of WSI for the detection of lymphoma were 95.2% and 85.7%, respectively, with an overall inter-observer agreement (κ) of 0.86; 95% CI (0.70-0.95). Conclusions: We demonstrate that mobile whole slide imaging (WSI) is non-inferior to conventional glass slide microscopy (GSM) for the primary diagnosis of malignant infiltration of lymph node specimens. Our results further provide proof of concept that mobile WSI can be adapted to resource-restricted settings for primary surgical pathology and would significantly improve patient outcomes. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
39. Deep learning supported mitoses counting on whole slide images: A pilot study for validating breast cancer grading in the clinical workflow.
- Author
-
van Bergeijk, Stijn A., Stathonikos, Nikolas, ter Hoeve, Natalie D., Lafarge, Maxime W., Nguyen, Tri Q., van Diest, Paul J., and Veta, Mitko
- Subjects
DEEP learning ,MITOSIS ,BREAST cancer ,PILOT projects ,MICROSCOPY ,WORKFLOW - Abstract
Introduction: Breast cancer (BC) prognosis is largely influenced by histopathological grade, assessed according to the Nottingham modification of Bloom-Richardson (BR). Mitotic count (MC) is a component of histopathological grading but is prone to subjectivity. This study investigated whether mitoses counting in BC using digital whole slide images (WSI) compares better to light microscopy (LM) when assisted by artificial intelligence (AI), and to which extent differences in digital MC (AI assisted or not) result in BR grade variations. Methods: Fifty BC patients with paired core biopsies and resections were randomly selected. Component scores for BR grade were extracted from pathology reports. MC was assessed using LM, WSI, and AI. Different modalities (LM-MC, WSI-MC, and AI-MC) were analyzed for correlation with scatterplots and linear regression, and for agreement in final BR with Cohen’s κ. Results: MC modalities strongly correlated in both biopsies and resections: LM-MC and WSI-MC (R² 0.85 and 0.83, respectively), LM-MC and AI-MC (R² 0.85 and 0.95), and WSI-MC and AI-MC (R² 0.77 and 0.83). Agreement in BR between modalities was high in both biopsies and resections: LM-MC and WSI-MC (κ 0.93 and 0.83, respectively), LM-MC and AI-MC (κ 0.89 and 0.83), and WSI-MC and AI-MC (κ 0.96 and 0.73). Conclusion: This first validation study shows that WSI-MC may compare better to LM-MC when using AI. Agreement between BR grade based on the different mitoses counting modalities was high. These results suggest that mitoses counting on WSI can well be done, and validate the presented AI algorithm for pathologist supervised use in daily practice. Further research is required to advance our knowledge of AI-MC, but it appears at least non-inferior to LM-MC. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
40. Deep learning based registration of serial whole-slide histopathology images in different stains.
- Author
-
Roy, Mousumi, Fusheng Wang, Teodoro, George, Bhattarai, Shristi, Bhargava, Mahak, Rekha, T. Subbanna, Aneja, Ritu, and Jun Kong
- Subjects
DEEP learning ,IMAGE registration ,VECTOR fields ,HISTOPATHOLOGY ,HEMATOXYLIN & eosin staining ,RECORDING & registration ,MEDICAL research - Abstract
For routine pathology diagnosis and imaging-based biomedical research, Whole-slide image (WSI) analyses have been largely limited to a 2D tissue image space. For a more definitive tissue representation to support fine-resolution spatial and integrative analyses, it is critical to extend such tissue-based investigations to a 3D tissue space with spatially aligned serial tissue WSIs in different stains, such as Hematoxylin and Eosin (H&E) and Immunohistochemistry (IHC) biomarkers. However, such WSI registration is technically challenged by the overwhelming image scale, the complex histology structure change, and the significant difference in tissue appearances in different stains. The goal of this study is to register serial sections from multi-stain histopathology whole-slide image blocks. We propose a novel translation-based deep learning registration network CGNReg that spatially aligns serial WSIs stained in H&E and by IHC biomarkers without prior deformation information for the model training. First, synthetic IHC images are produced from H&E slides through a robust image synthesis algorithm. Next, the synthetic and the real IHC images are registered through a Fully Convolutional Network with multi-scaled deformable vector fields and a joint loss optimization. We perform the registration at the full image resolution, retaining the tissue details in the results. Evaluated with a dataset of 76 breast cancer patients with 1 H&E and 2 IHC serial WSIs for each patient, CGNReg presents promising performance as compared with multiple state-of-the-art systems in our evaluation. Our results suggest that CGNReg can produce promising registration results with serial WSIs in different stains, enabling integrative 3D tissue-based biomedical investigations. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
41. A web application to support the coordination of reflexive, interpretative toxicology testing.
- Author
-
Pablo, Abed, Laha, Thomas J., Breit, Nathan, Hoffman, Noah G., Hoofnagle, Andrew N., Baird, Geoffrey S., and Mathias, Patrick C.
- Subjects
TOXICITY testing ,WEB-based user interfaces ,FULL-time employment ,WEB development ,USER interfaces ,RECORDS management ,REQUIREMENTS engineering - Abstract
Background: Reflexive laboratory testing workflows can improve the assessment of patients receiving pain medications chronically, but complex workflows requiring pathologist input and interpretation may not be well-supported by traditional laboratory information systems. In this work, we describe the development of a web application that improves the efficiency of pathologists and laboratory staff in delivering actionable toxicology results. Method: Before designing the application, we set out to understand the entire workflow including the laboratory workflow and pathologist review. Additionally, we gathered requirements and specifications from stakeholders. Finally, to assess the performance of the implementation of the application, we surveyed stakeholders and documented the approximate amount of time that is required in each step of the workflow. Results: A web-based application was chosen for the ease of access for users. Relevant clinical data was routinely received and displayed in the application. The workflows in the laboratory and during the interpretation process served as the basis of the user interface. With the addition of auto-filing software, the return on investment was significant. The laboratory saved the equivalent of one full-time employee in time by automating file management and result entry. Discussion: Implementation of a purpose-built application to support reflex and interpretation workflows in a clinical pathology practice has led to a significant improvement in laboratory efficiency. Custom- and purpose-built applications can help reduce staff burnout, reduce transcription errors, and allow staff to focus on more critical issues around quality. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
42. Automated detection and delineation of lymph nodes in haematoxylin & eosin stained digitised slides.
- Author
-
Beuque, Manon, Magee, Derek R., Chatterjee, Avishek, Woodruff, Henry C., Langley, Ruth E., Allum, William, Nankivell, Matthew G., Cunningham, David, Lambin, Philippe, and Grabsch, Heike I.
- Subjects
LYMPH nodes ,FEATURE extraction ,HEMATOXYLIN & eosin staining ,ESOPHAGEAL cancer ,PROGNOSIS - Abstract
Treatment of patients with oesophageal and gastric cancer (OeGC) is guided by disease stage, patient performance status and preferences. Lymph node (LN) status is one of the strongest prognostic factors for OeGC patients. However, survival varies between patients with the same disease stage and LN status. We recently showed that LN size from patients with OeGC might also have prognostic value, thus making delineations of LNs essential for size estimation and the extraction of other imaging biomarkers. We hypothesized that a machine learning workflow is able to: (1) find digital H&E stained slides containing LNs, (2) create a scoring system providing degrees of certainty for the results, and (3) delineate LNs in those images. To train and validate the pipeline, we used 1695 H&E slides from the OE02 trial. The dataset was divided into training (80%) and validation (20%). The model was tested on an external dataset of 826 H&E slides from the OE05 trial. U-Net architecture was used to generate prediction maps from which predefined features were extracted. These features were subsequently used to train an XGBoost model to determine if a region truly contained a LN. With our innovative method, the balanced accuracies of the LN detection were 0.93 on the validation dataset (0.83 on the test dataset) compared to 0.81 (0.81) on the validation (test) datasets when using the standard method of thresholding U-Net predictions to arrive at a binary mask. Our method allowed for the creation of an “uncertain” category, and partly limited false-positive predictions on the external dataset. The mean Dice score was 0.73 (0.60) per-image and 0.66 (0.48) per-LN for the validation (test) datasets. Our pipeline detects images with LNs more accurately than conventional methods, and high-throughput delineation of LNs can facilitate future LN content analyses of large datasets. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
43. Bioinformatics evaluation of anticancer properties of GP63 protein-derived peptides on MMP2 protein of melanoma cancer.
- Author
-
Sharifi, Fatemeh, Sharifi, Iraj, Babaei, Zahra, Alahdin, Sodabeh, and Afgar, Ali
- Subjects
PEPTIDES ,PROTEIN-ligand interactions ,AMINO acids ,MELANOMA ,PROTEINS - Abstract
Background: GP63, also known as Leishmanolysin, is a multifunctional virulence factor abundant on the surface of Leishmania spp. small peptides with anticancer capabilities that are selective and toxic to cancer cells are known as anticancer peptides. We aimed to demonstrate the activity of GP63 and its anticancer properties on melanoma using a range of in silico tools and screening methods to identify predicted and designed anticancer peptides. Methods: Various in silico modeling methodologies are used to establish the three-dimensional (3D) structure of GP63. Refinement and re-evaluation of the modeled structures and the built models' quality evaluated using the different docking used to find the interacting amino acids between MMP2 and GP63 and its anticancer peptides. AntiCP2.0 is used for screening anticancer peptides. 2D interaction plots of protein-ligand complexes evaluated by Protein-Ligand Interaction Profiler server. It is for the first time that used anticancer peptides of GP63 and the predicted and designed peptides. Results: We used 3 peptides of GP63 based on the AntiCP 2.0 server with scores of 0.63, 0.53, and 0.49, and common peptides of GP63/MMP2 (continues peptide: mean the completely selected peptide after docking with non-anticancer effect, predicted with 0.58 score and designed peptides with 0.47 and 0.45 scores by AntiCP 2.0 server). Conclusions: The antileishmanial and anticancer peptide research topics exemplify the multidisciplinary nature of peptide research. The advancement of therapeutics targeting cancer and/or Leishmania requires an interconnected research strategy shown in this work. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
44. Classification of fungal genera from microscopic images using artificial intelligence.
- Author
-
Rahman, Md Arafatur, Clinch, Madelyn, Reynolds, Jordan, Dangott, Bryan, Meza Villegas, Diana M., Nassar, Aziza, Hata, D. Jane, and Akkus, Zeynettin
- Subjects
ARTIFICIAL intelligence ,CONVOLUTIONAL neural networks ,IDENTIFICATION of fungi ,FUNGI classification ,DEEP learning ,DATA augmentation - Abstract
Microscopic image examination is fundamental to clinical microbiology and often used as the first step to diagnose fungal infections. In this study, we present classification of pathogenic fungi from microscopic images using deep convolutional neural networks (CNN). We trained well-known CNN architectures such as DenseNet, Inception ResNet, InceptionV3, Xception, ResNet50, VGG16, and VGG19 to identify fungal species, and compared their performances. We collected 1079 images of 89 fungi genera and split our data into training, validation, and test datasets by 7:1:2 ratio. The DenseNet CNN model provided the best performance among other CNN architectures with overall accuracy of 65.35% for top 1 prediction and 75.19% accuracy for top 3 predictions for classification of 89 genera. The performance is further improved (>80%) after excluding rare genera with low sample occurrence and applying data augmentation techniques. For some particular fungal genera, we obtained 100% prediction accuracy. In summary, we present a deep learning approach that shows promising results in prediction of filamentous fungi identification from culture, which could be used to enhance diagnostic accuracy and decrease turnaround time to identification. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
45. Cell projection plots: A novel visualization of bone marrow aspirate cytology.
- Author
-
Dehkharghanian, Taher, Youqing Mu, Ross, Catherine, Sur, Monalisa, Tizhoosh, H. R., and Campbell, Clinton J. V.
- Subjects
CYTOLOGY ,BONE marrow ,COMPACT bone ,DATA visualization ,ARTIFICIAL intelligence ,PATHOLOGISTS - Abstract
Deep models for cell detection have demonstrated utility in bone marrow cytology, showing impressive results in terms of accuracy and computational efficiency. However, these models have yet to be implemented in the clinical diagnostic workflow. Additionally, the metrics used to evaluate cell detection models are not necessarily aligned with clinical goals and targets. In order to address these issues, we introduce novel, automatically generated visual summaries of bone marrow aspirate specimens called cell projection plots (CPPs). Encompassing relevant biological patterns such as neutrophil maturation, CPPs provide a compact summary of bone marrow aspirate cytology. To gauge clinical relevance, CPPs were inspected by 3 hematopathologists, who decided whether corresponding diagnostic synopses matched with generated CPPs. Pathologists were able to match CPPs to the correct synopsis with a matching degree of 85%. Our finding suggests CPPs can represent clinically relevant information from bone marrow aspirate specimens and may be used to efficiently summarize bone marrow cytology to pathologists. CPPs could be a step toward humancentered implementation of artificial intelligence (AI) in hematopathology, and a basis for a diagnostic-support tool for digital pathology workflows. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
46. Automated HL7v2 LRI informatics framework for streamlining genomics-EHR data integration.
- Author
-
Dolin, Robert H., Gupta, Rohan, Newsom, Kimberly, Heale, Bret S. E., Gothi, Shailesh, Starostik, Petr, and Chamala, Srikar
- Subjects
DATA integration ,GENETIC variation ,ELECTRONIC health records ,PDF (Computer file format) ,NUCLEOTIDE sequencing ,MEDICAL informatics ,PATHOLOGICAL laboratories - Abstract
While VCF formatted files are the lingua franca of next-generation sequencing, most EHRs do not provide native VCF support. As a result, labs often must send non-structured PDF reports to the EHR. On the other hand, while FHIR adoption is growing, most EHRs support HL7 interoperability standards, particularly those based on the HL7 Version 2 (HL7v2) standard. The HL7 Version 2 genomics component of the HL7 Laboratory Results Interface (HL7v2 LRI) standard specifies a formalism for the structured communication of genomic data from lab to EHR. We previously described an open-source tool (vcf2fhir) that converts VCF files into HL7 FHIR format. In this report, we describe how the utility has been extended to output HL7v2 LRI data that contains both variants and variant annotations (e.g., predicted phenotypes and therapeutic implications). Using this HL7v2 converter, we implemented an automated pipeline for moving structured genomic data from the clinical laboratory to EHR. We developed an open source hl7v2GenomicsExtractor that converts genomic interpretation report files into a series of HL7v2 observations conformant to HL7v2 LRI. We further enhanced the converter to produce output conformant to Epic's genomic import specification and to support alternative input formats. An automated pipeline for pushing standards-based structured genomic data directly into the EHR was successfully implemented, where genetic variant data and the clinical annotations are now both available to be viewed in the EHR through Epic's genomics module. Issues encountered in the development and deployment of the HL7v2 converter primarily revolved around data variability issues, primarily lack of a standardized representation of data elements within various genomic interpretation report files. The technical implementation of a HL7v2 message transformation to feed genomic variant and clinical annotation data into an EHR has been successful. In addition to genetic variant data, the implementation described here releases the valuable asset of clinically relevant genomic annotations provided by labs from static PDFs to calculable, structured data in EHR systems. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
47. Artificial intelligence-based triage of large bowel biopsies can improve workflow.
- Author
-
Mayall, Frederick George, Goodhead, Mark David, de Mendonça, Louis, Brownlie, Sarah Eleanor, Anees, Azka, and Perring, Stephen
- Subjects
ARTIFICIAL intelligence ,LARGE intestine ,INFORMATION technology ,FORCEPS ,MEDICAL triage ,TURNAROUND time - Abstract
Background: Large bowel biopsies are one of the commonest types of biopsy specimen. We describe a service evaluation study to test the feasibility of using artificial intelligence (AI) to triage large bowel biopsies from a reporting backlog and prioritize those that require more urgent reporting. Methods: The pathway was developed in the UK by National Health Service (NHS) laboratory staff working in a medium-sized general hospital. The AI platform was interfaced with the slide scanner software and the reporting platform’s software, so that pathologists could correct the AI label and reinforce the training set as they reported the cases. Results: The AI classifier achieved a sensitivity of 97.56% and specificity of 93.02% for the case-level-diagnosis of neoplasia (adenoma and adenocarcinoma) and for an AI diagnosis of any significant pathology (i.e., adenomas, adenocarcinomas, inflammation, hyperplastic polyps, and sessile serrated lesions) sensitivity was 95.65% and specificity 92.96%. The automated AI diagnostic classification pathway took approximately 175 s per slide to download and process the scanned whole slide image (WSI) and return an AI diagnostic classification. Biopsies with an AI diagnosis of neoplasia or inflammation were prioritized for reporting while the remainder followed the routine reporting pathway. The AI triaged pathway resulted in a significantly shorter reporting turnaround time for pathologist verified neoplastic cases (P < 0.001) and inflammation (P < 0.05). The project’s costs amounted to £14800, excluding laboratory staff salaries. More time and resources were spent on developing the interface between the AI platform and laboratory IT systems than on the development of the AI platform itself. Conclusions: NHS laboratory staff were able to implement an AI solution to accurately triage large bowel biopsies into several diagnostic classes and this improved reporting turnaround times for cases with neoplasia or with inflammation. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
48. Applications of discriminative and deep learning feature extraction methods for whole slide image analysis: A survey.
- Author
-
Al-Thelaya, Khaled, Gilal, Nauman Ullah, Alzubaidi, Mahmood, Majeed, Fahad, Agus, Marco, Schneider, Jens, and Househ, Mowafa
- Subjects
DEEP learning ,FEATURE extraction ,IMAGE analysis ,ARTIFICIAL intelligence ,DIGITAL technology ,RESEARCH personnel - Abstract
Digital pathology technologies, including whole slide imaging (WSI), have significantly improved modern clinical practices by facilitating storing, viewing, processing, and sharing digital scans of tissue glass slides. Researchers have proposed various artificial intelligence (AI) solutions for digital pathology applications, such as automated image analysis, to extract diagnostic information from WSI for improving pathology productivity, accuracy, and reproducibility. Feature extraction methods play a crucial role in transforming raw image data into meaningful representations for analysis, facilitating the characterization of tissue structures, cellular properties, and pathological patterns. These features have diverse applications in several digital pathology applications, such as cancer prognosis and diagnosis. Deep learning-based feature extraction methods have emerged as a promising approach to accurately represent WSI contents and have demonstrated superior performance in histology-related tasks. In this survey, we provide a comprehensive overview of feature extraction methods, including both manual and deep learning-based techniques, for the analysis of WSIs. We review relevant literature, analyze the discriminative and geometric features of WSIs (i.e., features suited to support the diagnostic process and extracted by “engineered” methods as opposed to AI), and explore predictive modeling techniques using AI and deep learning. This survey examines the advances, challenges, and opportunities in this rapidly evolving field, emphasizing the potential for accurate diagnosis, prognosis, and decision-making in digital pathology. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
49. Artificial intelligence-based multi-class histopathologic classification of kidney neoplasms.
- Author
-
Gondim, Dibson D., Al-Obaidy, Khaleel I., Idrees, Muhammad T., Eble, John N., and Liang Cheng
- Subjects
ARTIFICIAL intelligence ,KIDNEY tumors ,RENAL cell carcinoma ,CLASSIFICATION - Abstract
Artificial intelligence (AI)-based techniques are increasingly being explored as an emerging ancillary technique for improving accuracy and reproducibility of histopathological diagnosis. Renal cell carcinoma (RCC) is a malignancy responsible for 2% of cancer deaths worldwide. Given that RCC is a heterogenous disease, accurate histopathological classification is essential to separate aggressive subtypes from indolent ones and benign mimickers. There are early promising results using AI for RCC classification to distinguish between 2 and 3 subtypes of RCC. However, it is not clear how an AI-based model designed for multiple subtypes of RCCs, and benign mimickers would perform which is a scenario closer to the real practice of pathology. A computational model was created using 252 whole slide images (WSI) (clear cell RCC: 56, papillary RCC: 81, chromophobe RCC: 51, clear cell papillary RCC: 39, and, metanephric adenoma: 6). 298,071 patches were used to develop the AI-based image classifier. 298,071 patches (350 × 350-pixel) were used to develop the AI-based image classifier. The model was applied to a secondary dataset and demonstrated that 47/55 (85%) WSIs were correctly classified. This computational model showed excellent results except to distinguish clear cell RCC from clear cell papillary RCC. Further validation using multi-institutional large datasets and prospective studies are needed to determine the potential to translation to clinical practice. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
50. Application of digital pathology and machine learning in the liver, kidney and lung diseases.
- Author
-
Benjamin Wu and Moeckel, Gilbert
- Subjects
MACHINE learning ,LUNG diseases ,KIDNEY diseases ,LUNGS ,DEEP learning ,ARTIFICIAL intelligence - Abstract
The development of rapid and accurate Whole Slide Imaging (WSI) has paved the way for the application of Artificial Intelligence (AI) to digital pathology. The availability of WSI in the recent years allowed the rapid development of various AI technologies to blossom. WSI-based digital pathology combined with neural networks can automate arduous and time-consuming tasks of slide evaluation. Machine Learning (ML)-based AI has been demonstrated to outperform pathologists by eliminating inter- and intra-observer subjectivity, obtaining quantitative data from slide images, and extracting hidden image patterns that are relevant to disease subtype and progression. In this review, we outline the functionality of different AI technologies such as neural networks and deep learning and discover how aspects of different diseases make them benefit from the implementation of AI. AI has proven to be valuable in many different organs, with this review focusing on the liver, kidney, and lungs. We also discuss how AI and image analysis not only can grade diseases objectively but also discover aspects of diseases that have prognostic value. In the end, we review the current status of the integration of AI in pathology and share our vision on the future of digital pathology. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.