Search

This study developed an innovative approach that combines a colourimetric sensor array (CSA) composed of twelve pH-response dyes with advanced algorithms, aiming to detect amine gases and assess the freshness of chilled beef. With the assistance of multivariate statistical analysis, the sensor array can effectively distinguish five amine gases and enable rapid quantification of trimethylamine vapour with a limit of detection (LOD) of 8.02 ppb and visually monitor the fresh levels of chilled beef. Moreover, the utilization of deep learning models (ResNet34, VGG16, and GoogleNet) for chilled beef freshness evaluation achieved an overall accuracy of 98.0 %. Furthermore, t-distributed stochastic neighbour embedding (t-SNE) visualized the feature extraction process and provided explanations to understand the classification process of deep learning. The results demonstrated that applying deep learning techniques in the process of pattern recognition of CSA can help in realizing the rapid, robust, and accurate assessment of chilled beef freshness., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Background: Health-related patient-reported outcomes (HR-PROs) are crucial for assessing the quality of life among individuals experiencing low back pain. However, manual data entry from paper forms, while convenient for patients, imposes a considerable tallying burden on collectors. In this study, we developed a deep learning (DL) model capable of automatically reading these paper forms., Methods: We employed the Japanese Orthopaedic Association Back Pain Evaluation Questionnaire, a globally recognized assessment tool for low back pain. The questionnaire comprised 25 low back pain-related multiple-choice questions and three pain-related visual analog scales (VASs). We collected 1305 forms from an academic medical center as the training set, and 483 forms from a community medical center as the test set. The performance of our DL model for multiple-choice questions was evaluated using accuracy as a categorical classification task. The performance for VASs was evaluated using the correlation coefficient and absolute error as regression tasks., Result: In external validation, the mean accuracy of the categorical questions was 0.997. When outputs for categorical questions with low probability (threshold: 0.9996) were excluded, the accuracy reached 1.000 for the remaining 65 % of questions. Regarding the VASs, the average of the correlation coefficients was 0.989, with the mean absolute error being 0.25., Conclusion: Our DL model demonstrated remarkable accuracy and correlation coefficients when automatic reading paper-based HR-PROs during external validation., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Abstract Purpose Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms’ nutrient source. Mold not only can damage papers’ structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation.

One of the most popular and well-established forms of payment in use today is paper money. Handling paper money might be challenging for those with vision impairments. Assistive technology has been reinventing itself throughout time to better serve the elderly and disabled people. To detect paper currency and extract other useful information from them, image processing techniques and other advanced technologies, such as Artificial Intelligence, Deep Learning, etc., can be used. In this paper, we present a meticulously curated and comprehensive dataset named ‘NSTU-BDTAKA’ tailored for the simultaneous detection and recognition of a specific object of cultural significance - the Bangladeshi paper currency (in Bengali it is called ‘Taka’). This research aims to facilitate the development and evaluation of models for both taka detection and recognition tasks, offering a rich resource for researchers and practitioners alike. The dataset is divided into two distinct components: (i) taka detection, and (ii) taka recognition. The taka detection subset comprises 3,111 high-resolution images, each meticulously annotated with rectangular bounding boxes that encompass instances of the taka. These annotations serve as ground truth for training and validating object detection models, and we adopt the state-of-the-art YOLOv5 architecture for this purpose. In the taka recognition subset, the dataset has been extended to include a vast collection of 28,875 images, each showcasing various instances of the taka captured in diverse contexts and environments. The recognition dataset is designed to address the nuanced task of taka recognition providing researchers with a comprehensive set of images to train, validate, and test recognition models. This subset encompasses challenges such as variations in lighting, scale, orientation, and occlusion, further enhancing the robustness of developed recognition algorithms. The dataset NSTU-BDTAKA not only serves as a benchmark for taka detection and recognition but also fosters advancements in object detection and recognition methods that can be extrapolated to other cultural artifacts and objects. We envision that the dataset will catalyze research efforts in the field of computer vision, enabling the development of more accurate, robust, and efficient models for both detection and recognition tasks.

In recent years, the research pertaining to speech recognition technology in the Kazakh language has gained significant importance. This is due to the increasing demand for natural language processing applications in the region where Kazakh is predominantly spoken. Thus, there exists an urgent requirement for precise and dependable speech recognition systems. The research study examines the application of sophisticated deep learning methodologies, such as Natural Language Processing (NLP) and Hidden Markov Model (HMM), in facilitating speech recognition for the Kazakh language. Additionally, the investigation delves into how various techniques, including data preprocessing, acoustic modeling, and language modeling, can aid in devising effective speech recognition systems. The article deliberates on the feasible uses of speech recognition technology in the geographic area where Kazakh language is spoken and outlines its future research prospects. The investigation underscores the significance of persistent inquiry in this realm to confront distinctive obstacles encountered in creating speech recognition systems for languages with restricted resources. [ABSTRACT FROM AUTHOR]

The automatic semantic structuring of scientific text allows for more efficient reading of research articles and is an important indexing step for academic search engines. Sequential sentence classification is an essential structuring task and targets the categorisation of sentences based on their content and context. However, the potential of transfer learning for sentence classification across different scientific domains and text types, such as full papers and abstracts, has not yet been explored in prior work. In this paper, we present a systematic analysis of transfer learning for scientific sequential sentence classification. For this purpose, we derive seven research questions and present several contributions to address them: (1) We suggest a novel uniform deep learning architecture and multi-task learning for cross-domain sequential sentence classification in scientific text. (2) We tailor two transfer learning methods to deal with the given task, namely sequential transfer learning and multi-task learning. (3) We compare the results of the two best models using qualitative examples in a case study. (4) We provide an approach for the semi-automatic identification of semantically related classes across annotation schemes and analyse the results for four annotation schemes. The clusters and underlying semantic vectors are validated using k-means clustering. (5) Our comprehensive experimental results indicate that when using the proposed multi-task learning architecture, models trained on datasets from different scientific domains benefit from one another. Our approach significantly outperforms state of the art on full paper datasets while being on par for datasets consisting of abstracts. [ABSTRACT FROM AUTHOR]

Purpose: Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms' nutrient source. Mold not only can damage papers' structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods: Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion: In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation. [ABSTRACT FROM AUTHOR]

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future.

Background: In low-middle income countries, healthcare providers primarily use paper health records for capturing data. Paper health records are utilized predominately due to the prohibitive cost of acquisition and maintenance of automated data capture devices and electronic medical records. Data recorded on paper health records is not easily accessible in a digital format to healthcare providers. The lack of real time accessible digital data limits healthcare providers, researchers, and quality improvement champions to leverage data to improve patient outcomes. In this project, we demonstrate the novel use of computer vision software to digitize handwritten intraoperative data elements from smartphone photographs of paper anesthesia charts from the University Teaching Hospital of Kigali. We specifically report our approach to digitize checkbox data, symbol-denoted systolic and diastolic blood pressure, and physiological data. Methods: We implemented approaches for removing perspective distortions from smartphone photographs, removing shadows, and improving image readability through morphological operations. YOLOv8 models were used to deconstruct the anesthesia paper chart into specific data sections. Handwritten blood pressure symbols and physiological data were identified, and values were assigned using deep neural networks. Our work builds upon the contributions of previous research by improving upon their methods, updating the deep learning models to newer architectures, as well as consolidating them into a single piece of software. Results: The model for extracting the sections of the anesthesia paper chart achieved an average box precision of 0.99, an average box recall of 0.99, and an mAP0.5-95 of 0.97. Our software digitizes checkbox data with greater than 99% accuracy and digitizes blood pressure data with a mean average error of 1.0 and 1.36 mmHg for systolic and diastolic blood pressure respectively. Overall accuracy for physiological data which includes oxygen saturation, inspired oxygen concentration and end tidal carbon dioxide concentration was 85.2%. Conclusions: We demonstrate that under normal photography conditions we can digitize checkbox, blood pressure and physiological data to within human accuracy when provided legible handwriting. Our contributions provide improved access to digital data to healthcare practitioners in low-middle income countries. [ABSTRACT FROM AUTHOR]

Quantifiable predictability in the citation counts of articles is significant in scientometrics and informetrics. Many metrics based on the citation counts can evaluate the scientific impact of research articles and journals. Utilising time series models, an article's citation counts up to the y th year after publication can be predicted by those up to the previous years. However, the typically used models cannot predict the fat tail of the actual citation distributions. Thus, based on cumulative advantage of the citation behaviour, we propose a method to predict the accumulated citation counts, by using a random number sampled from a power-law distribution to modify the results given by a recurrent neural network (RNN), long short-term memory. Extensive experiments on the data set including 17 journals in information science verified the effectiveness of our method by the good fittings on distributions and evolutionary trends of the citation counts of articles. Our method has the potential to be extended to predict other popular assessment measures such as impact factor and h -index for journals. [ABSTRACT FROM AUTHOR]

Accurate breed identification in dairy cattle is essential for optimizing herd management and improving genetic standards. A smart method for correctly identifying phenotypically similar breeds can empower farmers to enhance herd productivity. A convolutional neural network (CNN) based model was developed for the identification of Sahiwal and Red Sindhi cows. To increase the classification accuracy, first, cows's pixels were segmented from the background using CNN model. Using this segmented image, a masked image was produced by retaining cows' pixels from the original image while eliminating the background. To improve the classification accuracy, models were trained on four different images of each cow: front view, side view, grayscale front view, and grayscale side view. The masked images of these views were fed to the multi-input CNN model which predicts the class of input images. The segmentation model achieved intersection-over-union (IoU) and F1-score values of 81.75% and 85.26%, respectively with an inference time of 296 ms. For the classification task, multiple variants of MobileNet and EfficientNet models were used as the backbone along with pre-trained weights. The MobileNet model achieved 80.0% accuracy for both breeds, while MobileNetV2 and MobileNetV3 reached 82.0% accuracy. CNN models with EfficientNet as backbones outperformed MobileNet models, with accuracy ranging from 84.0% to 86.0%. The F1-scores for these models were found to be above 83.0%, indicating effective breed classification with fewer false positives and negatives. Thus, the present study demonstrates that deep learning models can be used effectively to identify phenotypically similar-looking cattle breeds. To accurately identify zebu breeds, this study will reduce the dependence of farmers on experts., (© 2024. The Author(s), under exclusive licence to Springer Nature B.V.)

Purpose: In MRI, motion artifacts can significantly degrade image quality. Motion artifact correction methods using deep neural networks usually required extensive training on large datasets, making them time-consuming and resource-intensive. In this paper, an unsupervised deep learning-based motion artifact correction method for turbo-spin echo MRI is proposed using the deep image prior framework., Theory and Methods: The proposed approach takes advantage of the high impedance to motion artifacts offered by the neural network parameterization to remove motion artifacts in MR images. The framework consists of parameterization of MR image, automatic spatial transformation, and motion simulation model. The proposed method synthesizes motion-corrupted images from the motion-corrected images generated by the convolutional neural network, where an optimization process minimizes the objective function between the synthesized images and the acquired images., Results: In the simulation study of 280 slices from 14 subjects, the proposed method showed a significant increase in the averaged structural similarity index measure by 0.2737 in individual coil images and by 0.4550 in the root-sum-of-square images. In addition, the ablation study demonstrated the effectiveness of each proposed component in correcting motion artifacts compared to the corrected images produced by the baseline method. The experiments on real motion dataset has shown its clinical potential., Conclusion: The proposed method exhibited significant quantitative and qualitative improvements in correcting rigid and in-plane motion artifacts in MR images acquired using turbo spin-echo sequence., (© 2024 International Society for Magnetic Resonance in Medicine.)

Background: Notwithstanding the encouraging results of previous studies reporting on the efficiency of deep learning (DL) in COVID-19 prognostication, clinical adoption of the developed methodology still needs to be improved. To overcome this limitation, we set out to predict the prognosis of a large multi-institutional cohort of patients with COVID-19 using a DL-based model., Purpose: This study aimed to evaluate the performance of deep privacy-preserving federated learning (DPFL) in predicting COVID-19 outcomes using chest CT images., Methods: After applying inclusion and exclusion criteria, 3055 patients from 19 centers, including 1599 alive and 1456 deceased, were enrolled in this study. Data from all centers were split (randomly with stratification respective to each center and class) into a training/validation set (70%/10%) and a hold-out test set (20%). For the DL model, feature extraction was performed on 2D slices, and averaging was performed at the final layer to construct a 3D model for each scan. The DensNet model was used for feature extraction. The model was developed using centralized and FL approaches. For FL, we employed DPFL approaches. Membership inference attack was also evaluated in the FL strategy. For model evaluation, different metrics were reported in the hold-out test sets. In addition, models trained in two scenarios, centralized and FL, were compared using the DeLong test for statistical differences., Results: The centralized model achieved an accuracy of 0.76, while the DPFL model had an accuracy of 0.75. Both the centralized and DPFL models achieved a specificity of 0.77. The centralized model achieved a sensitivity of 0.74, while the DPFL model had a sensitivity of 0.73. A mean AUC of 0.82 and 0.81 with 95% confidence intervals of (95% CI: 0.79-0.85) and (95% CI: 0.77-0.84) were achieved by the centralized model and the DPFL model, respectively. The DeLong test did not prove statistically significant differences between the two models (p-value = 0.98). The AUC values for the inference attacks fluctuate between 0.49 and 0.51, with an average of 0.50 ± 0.003 and 95% CI for the mean AUC of 0.500 to 0.501., Conclusion: The performance of the proposed model was comparable to centralized models while operating on large and heterogeneous multi-institutional datasets. In addition, the model was resistant to inference attacks, ensuring the privacy of shared data during the training process., (© 2024 The Authors. Medical Physics published by Wiley Periodicals LLC on behalf of American Association of Physicists in Medicine.)

Background: The feasibility of diagnosing malnutrition using facial features has been validated. A tool to integrate all facial features associated with malnutrition for disease screening is still demanded. This work aims to develop and evaluate a deep learning (DL) framework to accurately determine malnutrition based on a 3D facial points cloud., Methods: A group of 482 patients were studied in this perspective work. The 3D facial data were obtained using a 3D camera and represented as a 3D facial points cloud. A DL model, PointNet++, was trained and evaluated using the points cloud as inputs and classified the malnutrition states. The performance was evaluated with the area under the receiver operating characteristic curve, accuracy, specificity, sensitivity, and F1 score., Results: Among the 482 patients, 150 patients (31.1%) were diagnosed as having moderate malnutrition and 54 patients (11.2%) as having severe malnutrition. The DL model achieved the performance with an area under the receiver operating characteristic curve of 0.7240 ± 0.0416., Conclusion: The DL model achieved encouraging performance in accurately classifying nutrition states based on a points cloud of 3D facial information of patients with malnutrition., (© 2024 American Society for Parenteral and Enteral Nutrition.)

Subject motion is a long-standing problem of magnetic resonance imaging (MRI), which can seriously deteriorate the image quality. Various prospective and retrospective methods have been proposed for MRI motion correction, among which deep learning approaches have achieved state-of-the-art motion correction performance. This survey paper aims to provide a comprehensive review of deep learning-based MRI motion correction methods. Neural networks used for motion artifacts reduction and motion estimation in the image domain or frequency domain are detailed. Furthermore, besides motion-corrected MRI reconstruction, how estimated motion is applied in other downstream tasks is briefly introduced, aiming to strengthen the interaction between different research areas. Finally, we identify current limitations and point out future directions of deep learning-based MRI motion correction., (© 2024. The Author(s), under exclusive licence to European Society for Magnetic Resonance in Medicine and Biology (ESMRMB).)

Background: Preclinical low-count positron emission tomography (LC-PET) imaging offers numerous advantages such as facilitating imaging logistics, enabling longitudinal studies of long- and short-lived isotopes as well as increasing scanner throughput. However, LC-PET is characterized by reduced photon-count levels resulting in low signal-to-noise ratio (SNR), segmentation difficulties, and quantification uncertainties., Purpose: We developed and evaluated a novel deep-learning (DL) architecture-Attention based Residual-Dilated Net (ARD-Net)-to generate standard-count PET (SC-PET) images from LC-PET images. The performance of the ARD-Net framework was evaluated for numerous low count realizations using fidelity-based qualitative metrics, task-based segmentation, and quantitative metrics., Method: Patient Derived tumor Xenograft (PDX) with tumors implanted in the mammary fat-pad were subjected to preclinical [ 18 F]-Fluorodeoxyglucose (FDG)-PET/CT imaging. SC-PET images were derived from a 10 min static FDG-PET acquisition, 50 min post administration of FDG, and were resampled to generate four distinct LC-PET realizations corresponding to 10%, 5%, 1.6%, and 0.8% of SC-PET count-level. ARD-Net was trained and optimized using 48 preclinical FDG-PET datasets, while 16 datasets were utilized to assess performance. Further, the performance of ARD-Net was benchmarked against two leading DL-based methods (Residual UNet, RU-Net; and Dilated Network, D-Net) and non-DL methods (Non-Local Means, NLM; and Block Matching 3D Filtering, BM3D). The performance of the framework was evaluated using traditional fidelity-based image quality metrics such as Structural Similarity Index Metric (SSIM) and Normalized Root Mean Square Error (NRMSE), as well as human observer-based tumor segmentation performance (Dice Score and volume bias) and quantitative analysis of Standardized Uptake Value (SUV) measurements. Additionally, radiomics-derived features were utilized as a measure of quality assurance (QA) in comparison to true SC-PET. Finally, a performance ensemble score (EPS) was developed by integrating fidelity-based and task-based metrics. Concordance Correlation Coefficient (CCC) was utilized to determine concordance between measures. The non-parametric Friedman Test with Bonferroni correction was used to compare the performance of ARD-Net against benchmarked methods with significance at adjusted p-value ≤0.01., Results: ARD-Net-generated SC-PET images exhibited significantly better (p ≤ 0.01 post Bonferroni correction) overall image fidelity scores in terms of SSIM and NRMSE at majority of photon-count levels compared to benchmarked DL and non-DL methods. In terms of task-based quantitative accuracy evaluated by SUV Mean  and SUV Peak, ARD-Net exhibited less than 5% median absolute bias for SUV Mean compared to true SC-PET and lower degree of variability compared to benchmarked DL and non-DL based methods in generating SC-PET. Additionally, ARD-Net-generated SC-PET images displayed higher degree of concordance to SC-PET images in terms of radiomics features compared to non-DL and other DL approaches. Finally, the ensemble score suggested that ARD-Net exhibited significantly superior performance compared to benchmarked algorithms (p ≤ 0.01 post Bonferroni correction)., Conclusion: ARD-Net provides a robust framework to generate SC-PET from LC-PET images. ARD-Net generated SC-PET images exhibited superior performance compared other DL and non-DL approaches in terms of image-fidelity based metrics, task-based segmentation metrics, and minimal bias in terms of task-based quantification performance for preclinical PET imaging., (© 2024 The Authors. Medical Physics published by Wiley Periodicals LLC on behalf of American Association of Physicists in Medicine.)

Segmentation of organs and lesions could be employed for the express purpose of dosimetry in nuclear medicine, assisted image interpretations, and mass image processing studies. Deep leaning created liver and liver lesion segmentation on clinical 3D MRI data has not been fully addressed in previous experiments. To this end, the required data were collected from 128 patients, including their T1w and T2w MRI images, and ground truth labels of the liver and liver lesions were generated. The collection of 110 T1w-T2w MRI image sets was divided, with 94 designated for training and 16 for validation. Furthermore, 18 more datasets were separately allocated for use as hold-out test datasets. The T1w and T2w MRI images were preprocessed into a two-channel format so that they were used as inputs to the deep learning model based on the Isensee 2017 network. To calculate the final Dice coefficient of the network performance on test datasets, the binary average of T1w and T2w predicted images was used. The deep learning model could segment all 18 test cases, with an average Dice coefficient of 88% for the liver and 53% for the liver tumor. Liver segmentation was carried out with rather a high accuracy; this could be achieved for liver dosimetry during systemic or selective radiation therapies as well as for attenuation correction in PET/MRI scanners. Nevertheless, the delineation of liver lesions was not optimal; therefore, tumor detection was not practical by the proposed method on clinical data., (© 2024. Australasian College of Physical Scientists and Engineers in Medicine.)

Crowd flow prediction has been studied for a variety of purposes, ranging from the private sector such as location selection of stores according to the characteristics of commercial districts and customer-tailored marketing to the public sector for social infrastructure design such as transportation networks. Its importance is even greater in light of the spread of contagious diseases such as COVID-19. In many cases, crowd flow can be divided into subgroups by common characteristics such as gender, age, location type, etc. If we use such hierarchical structure of the data effectively, we can improve prediction accuracy of crowd flow for subgroups. But the existing prediction models do not consider such hierarchical structure of the data. In this study, we propose a deep learning model based on global-local structure of the crowd flow data, which utilizes the overall(global) and subdivided by the types of sites(local) crowd flow data simultaneously to predict the crowd flow of each subgroup. The experiment result shows that the proposed model improves the prediction accuracy of each sub-divided subgroup by 5.2% (Table 5 Cat #9)-45.95% (Table 11 Cat #5), depending on the data set. This result comes from the comparison with the related works under the same condition that use target category data to predict each subgroup. In addition, when we refine the global data composition by considering the correlation between subgroups and excluding low correlated subgroups, the prediction accuracy is further improved by 5.6-48.65%., (© 2024. The Author(s).)

In this study, we developed a method for generating quasi-material decomposition (quasi-MD) images from single-energy computed tomography (SECT) images using a deep convolutional neural network (DCNN). Our aim was to improve the detection of cholesterol gallstones and to determine the clinical utility of quasi-MD images. Four thousand pairs of virtual monochromatic images (70 keV) and MD images (fat/water) of the same section, obtained via dual-energy computed tomography (DECT), were used to train the DCNN. The trained DCNN can automatically generate quasi-MD images from the SECT images. Additional SECT images were obtained from 70 patients (40 with and 30 without cholesterol gallstones) to generate quasi-MD images for testing. The presence of gallstones in this dataset was confirmed by ultrasonography. We conducted a receiver operating characteristic (ROC) observer study with three radiologists to validate the clinical utility of the quasi-MD images for detecting cholesterol gallstones. The mean area under the ROC curve for the detection of cholesterol gallstones improved from 0.867 to 0.921 (p = 0.001) when quasi-MD images were added to SECT images. The clinical utility of quasi-MD imaging for detecting cholesterol gallstones was showed. This study demonstrated that the lesion detection capability of images obtained from SECT can be improved using a DCNN trained with DECT images obtained using high-end computed tomography systems., (© 2024. The Author(s), under exclusive licence to Japanese Society of Radiological Technology and Japan Society of Medical Physics.)

Quality assessment in industrial applications is often carried out through visual inspection, usually performed or supported by human domain experts. However, the manual visual inspection of processes and products is error-prone and expensive. It is therefore not surprising that the automation of visual inspection in manufacturing and maintenance is heavily researched and discussed. The use of artificial intelligence as an approach to visual inspection in industrial applications has been considered for decades. Recent successes, driven by advances in deep learning, present a possible paradigm shift and have the potential to facilitate automated visual inspection, even under complex environmental conditions. For this reason, we explore the question of to what extent deep learning is already being used in the field of automated visual inspection and which potential improvements to the state of the art could be realized utilizing concepts from academic research. By conducting an extensive review of the openly accessible literature, we provide an overview of proposed and in-use deep-learning models presented in recent years. Our survey consists of 196 open-access publications, of which 31.7% are manufacturing use cases and 68.3% are maintenance use cases. Furthermore, the survey also shows that the majority of the models currently in use are based on convolutional neural networks, the current de facto standard for image classification, object recognition, or object segmentation tasks. Nevertheless, we see the emergence of vision transformer models that seem to outperform convolutional neural networks but require more resources, which also opens up new research opportunities for the future. Another finding is that in 97% of the publications, the authors use supervised learning techniques to train their models. However, with the median dataset size consisting of 2500 samples, deep-learning models cannot be trained from scratch, so it would be beneficial to use other training paradigms, such as self-supervised learning. In addition, we identified a gap of approximately three years between approaches from deep-learning-based computer vision being published and their introduction in industrial visual inspection applications. Based on our findings, we additionally discuss potential future developments in the area of automated visual inspection.

This document is a summary of a special issue of the journal Sensors, titled "Emerging AI+X-Based Sensor and Networking Technologies including Selected Papers from ICGHIT 2022–2023." The special issue features selected papers from the 10th and 11th International Conferences on Green and Human Information Technology (ICGHITs), which were held in Korea and Thailand. The conferences focused on the theme of "Emerging Artificial Intelligent (AI)+X technology" and "Hyper Automation + Human AI" respectively. The selected papers cover various topics such as network security, routing protocols, signal detection, and clustering mechanisms, all incorporating AI-based methods. The issue also includes papers on topics like secure authentication, distance estimation in RFID systems, energy optimization in smart homes, blockchain technology, and radar signal detection. The authors emphasize the importance of both technology and humanity in advancing green and information technologies. [Extracted from the article]

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

Purpose: The efficacy of adjuvant chemotherapy in elderly breast cancer patients is currently controversial. This study aims to provide personalized adjuvant chemotherapy recommendations using deep learning (DL)., Methods: Six models with various causal inference approaches were trained to make individualized chemotherapy recommendations. Patients who received actual treatment recommended by DL models were compared with those who did not. Inverse probability treatment weighting (IPTW) was used to reduce bias. Linear regression, IPTW-adjusted risk difference (RD), and SurvSHAP(t) were used to interpret the best model., Results: A total of 5352 elderly breast cancer patients were included. The median (interquartile range) follow-up time was 52 (30-80) months. Among all models, the balanced individual treatment effect for survival data (BITES) performed best. Treatment according to following BITES recommendations was associated with survival benefit, with a multivariate hazard ratio (HR) of 0.78 (95% confidence interval (CI): 0.64-0.94), IPTW-adjusted HR of 0.74 (95% CI: 0.59-0.93), RD of 12.40% (95% CI: 8.01-16.90%), IPTW-adjusted RD of 11.50% (95% CI: 7.16-15.80%), difference in restricted mean survival time (dRMST) of 12.44 (95% CI: 8.28-16.60) months, IPTW-adjusted dRMST of 7.81 (95% CI: 2.93-11.93) months, and p value of the IPTW-adjusted Log-rank test of 0.033. By interpreting BITES, the debiased impact of patient characteristics on adjuvant chemotherapy was quantified, which mainly included breast cancer subtype, tumor size, number of positive lymph nodes, TNM stages, histological grades, and surgical type., Conclusion: Our results emphasize the potential of DL models in guiding adjuvant chemotherapy decisions for elderly breast cancer patients., (© 2024. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Objectives: This study aimed to use a deep learning (DL) approach for the automatic identification of the ridge deficiency around dental implants based on an image slice from cone-beam computerized tomography (CBCT)., Materials and Methods: Single slices crossing the central long-axis of 630 mandibular and 845 maxillary virtually placed implants (4-5 mm diameter, 10 mm length) in 412 patients were used. The ridges were classified based on the intraoral bone-implant support and sinus floor location. The slices were either preprocessed by alveolar ridge homogenizing prior to DL (preprocessed) or left unpreprocessed. A convolutional neural network with ResNet-50 architecture was employed for DL., Results: The model achieved an accuracy of >98.5% on the unpreprocessed image slices and was found to be superior to the accuracy observed on the preprocessed slices. On the mandible, model accuracy was 98.91 ± 1.45%, and F1 score, a measure of a model's accuracy in binary classification tasks, was lowest (97.30%) on the ridge with a combined horizontal-vertical defect. On the maxilla, model accuracy was 98.82 ± 1.11%, and the ridge presenting an implant collar-sinus floor distance of 5-10 mm with a dehiscence defect had the lowest F1 score (95.86%). To achieve >90% model accuracy, ≥441 mandibular slices or ≥592 maxillary slices were required., Conclusions: The ridge deficiency around dental implants can be identified using DL from CBCT image slices without the need for preprocessed homogenization. The model will be further strengthened by implementing more clinical expertise in dental implant treatment planning and incorporating multiple slices to classify 3-dimensional implant-ridge relationships., (© 2023 Wiley Periodicals LLC.)

In recent years, a variety of deep learning networks for cardiac MRI (CMR) segmentation have been developed and analyzed. However, nearly all of them are focused on cine CMR under breathold. In this work, accuracy of deep learning methods is assessed for volumetric analysis (via segmentation) of the left ventricle in real-time free-breathing CMR at rest and under exercise stress. Data from healthy volunteers (n = 15) for cine and real-time free-breathing CMR at rest and under exercise stress were analyzed retrospectively. Exercise stress was performed using an ergometer in the supine position. Segmentations of two deep learning methods, a commercially available technique (comDL) and an openly available network (nnU-Net), were compared to a reference model created via the manual correction of segmentations obtained with comDL. Segmentations of left ventricular endocardium (LV), left ventricular myocardium (MYO), and right ventricle (RV) are compared for both end-systolic and end-diastolic phases and analyzed with Dice's coefficient. The volumetric analysis includes the cardiac function parameters LV end-diastolic volume (EDV), LV end-systolic volume (ESV), and LV ejection fraction (EF), evaluated with respect to both absolute and relative differences. For cine CMR, nnU-Net and comDL achieve Dice's coefficients above 0.95 for LV and 0.9 for MYO, and RV. For real-time CMR, the accuracy of nnU-Net exceeds that of comDL overall. For real-time CMR at rest, nnU-Net achieves Dice's coefficients of 0.94 for LV, 0.89 for MYO, and 0.90 for RV and the mean absolute differences between nnU-Net and the reference are 2.9 mL for EDV, 3.5 mL for ESV, and 2.6% for EF. For real-time CMR under exercise stress, nnU-Net achieves Dice's coefficients of 0.92 for LV, 0.85 for MYO, and 0.83 for RV and the mean absolute differences between nnU-Net and reference are 11.4 mL for EDV, 2.9 mL for ESV, and 3.6% for EF. Deep learning methods designed or trained for cine CMR segmentation can perform well on real-time CMR. For real-time free-breathing CMR at rest, the performance of deep learning methods is comparable to inter-observer variability in cine CMR and is usable for fully automatic segmentation. For real-time CMR under exercise stress, the performance of nnU-Net could promise a higher degree of automation in the future., (© 2024. The Author(s).)

Purpose: The quality of ultrasound images is degraded by speckle and Gaussian noises. This study aims to develop a deep-learning (DL)-based filter for ultrasound image denoising., Methods: A novel DL-based filter using adaptive residual (AdaRes) learning was proposed. Five image quality metrics (IQMs) and 27 radiomics features were used to evaluate denoising results. The effect of our proposed filter, AdaRes, on four pre-trained convolutional neural network (CNN) classification models and three radiologists was assessed., Results: AdaRes filter was tested on both natural and ultrasound image databases. IQMs results indicate that AdaRes could remove noises in three different noise levels with the highest performances. In addition, a radiomics study proved that AdaRes did not distort tissue textures and it could preserve most radiomics features. AdaRes could also improve the performance classification using CNNs in different settings. Finally, AdaRes also improved the mean overall performance (AUC) of three radiologists from 0.494 to 0.702 in the classification of benign and malignant lesions., Conclusions: AdaRes filtered out noises on ultrasound images more effectively and can be used as an auxiliary preprocessing step in computer-aided diagnosis systems. Radiologists may use it to remove unwanted noises and improve the ultrasound image quality before the interpretation., (© 2023 Wiley Periodicals LLC.)

The breathtaking economic development put a heavy toll on ecology, especially on water pollution. Efficient water resource management has a long-term influence on the sustainable development of the economy and society. Economic development and ecology preservation are tangled together, and the growth of one is not possible without the other. Deep learning (DL) is ubiquitous in autonomous driving, medical imaging, speech recognition, etc. The spectacular success of deep learning comes from its power of richer representation of data. In view of the bright prospects of DL, this review comprehensively focuses on the development of DL applications in water resources management, water environment protection, and water ecology. First, the concept and modeling steps of DL are briefly introduced, including data preparation, algorithm selection, and model evaluation. Finally, the advantages and disadvantages of commonly used algorithms are analyzed according to their structures and mechanisms, and recommendations on the selection of DL algorithms for different studies, as well as prospects for the application and development of DL in water science are proposed. This review provides references for solving a wider range of water-related problems and brings further insights into the intelligent development of water science., (© 2024. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

Background: Attenuation and scatter correction is crucial for quantitative positron emission tomography (PET) imaging. Direct attenuation correction (AC) in the image domain using deep learning approaches has been recently proposed for combined PET/MR and standalone PET modalities lacking transmission scanning devices or anatomical imaging., Purpose: In this study, different input settings were considered in the model training to investigate deep learning-based AC in the image space., Methods: Three different deep learning methods were developed for direct AC in the image space: (i) use of non-attenuation-corrected PET images as input (NonAC-PET), (ii) use of attenuation-corrected PET images with a simple two-class AC map (composed of soft-tissue and background air) obtained from NonAC-PET images (PET segmentation-based AC [SegAC-PET]), and (iii) use of both NonAC-PET and SegAC-PET images in a Double-Channel fashion to predict ground truth attenuation corrected PET images with Computed Tomography images (CTAC-PET). Since a simple two-class AC map (generated from NonAC-PET images) can easily be generated, this work assessed the added value of incorporating SegAC-PET images into direct AC in the image space. A 4-fold cross-validation scheme was adopted to train and evaluate the different models based using 80 brain 18 F-Fluorodeoxyglucose PET/CT images. The voxel-wise and region-wise accuracy of the models were examined via measuring the standardized uptake value (SUV) quantification bias in different regions of the brain., Results: The overall root mean square error (RMSE) for the Double-Channel setting was 0.157 ± 0.08 SUV in the whole brain region, while RMSEs of 0.214 ± 0.07 and 0.189 ± 0.14 SUV were observed in NonAC-PET and SegAC-PET models, respectively. A mean SUV bias of 0.01 ± 0.26% was achieved by the Double-Channel model regarding the activity concentration in cerebellum region, as opposed to 0.08 ± 0.28% and 0.05 ± 0.28% SUV biases for the network that uniquely used NonAC-PET or SegAC-PET as input, respectively. SegAC-PET images with an SUV bias of -1.15 ± 0.54%, served as a benchmark for clinically accepted errors. In general, the Double-Channel network, relying on both SegAC-PET and NonAC-PET images, outperformed the other AC models., Conclusion: Since the generation of two-class AC maps from non-AC PET images is straightforward, the current study investigated the potential added value of incorporating SegAC-PET images into a deep learning-based direct AC approach. Altogether, compared with models that use only NonAC-PET and SegAC-PET images, the Double-Channel deep learning network exhibited superior attenuation correction accuracy., (© 2024 American Association of Physicists in Medicine.)

Digital reconstruction of neuronal structures from 3D neuron microscopy images is critical for the quantitative investigation of brain circuits and functions. Currently, neuron reconstructions are mainly obtained by manual or semiautomatic methods. However, these ways are labor-intensive, especially when handling the huge volume of whole brain microscopy imaging data. Here, we present a deep-learning-based neuron morphology analysis toolbox (DNeuroMAT) for automated analysis of neuron microscopy images, which consists of three modules: neuron segmentation, neuron reconstruction, and neuron critical points detection., (© 2024. The Author(s), under exclusive license to Springer Science+Business Media, LLC, part of Springer Nature.)

Objective: To enable the intelligent diagnosis of a variety of common Electrocardiogram (ECG), we investigate the deep learning-based ECG diagnosis system., Methods: From January 2015 to December 2019, four consecutive years of 100,120 conventional 12-lead ECG data were collected in our hospital. Utilizing this dataset, we constructed a deep learning model designed to intelligently diagnose prevalent ECG anomalies by employing a multi-task learning framework. The system performance was evaluated using various metrics, including sensitivity, specificity, negative predictive value, positive predictive value, and so forth. Additionally, we employed an ECG intelligent diagnostic platform for clinical application to undertake real-time online analysis of 2500 conventional 12-lead ECG samples in June 2020, aiming to validate our model. At this stage, we compared the performance of our model against the traditional manual identification method., Results: The efficacy of the ECG intelligent diagnostic model was notably high for common and straightforward ECG patterns, such as sinus rhythm (F1 = 98.01%), sinus tachycardia (F1 = 96.26%), sinus bradycardia (F1 = 94.88%), and a normal electrocardiogram (F1 = 91.71%), as well as for Premature Ventricular Contractions (F1 = 91.62%). Nevertheless, when diagnosing rarer and more intricate ECG anomalies, the system requires an increased number of samples to refine the deep learning models. During the validation stage, our model exhibited better efficiency in terms of accuracy, labor time and labor cost when compared to the manual identification approach., Conclusions: Our deep learning-driven intelligent ECG diagnostic model clearly demonstrates significant clinical utility. The integrated artificial intelligence diagnosis system not only has the potential to augment physicians in their diagnostic processes but also offers a viable avenue to reduce associated labor costs., (© 2023 Wiley Periodicals LLC.)

Background: Low-dose positron emission tomography (LD-PET) imaging is commonly employed in preclinical research to minimize radiation exposure to animal subjects. However, LD-PET images often exhibit poor quality and high noise levels due to the low signal-to-noise ratio. Deep learning (DL) techniques such as generative adversarial networks (GANs) and convolutional neural network (CNN) have the capability to enhance the quality of images derived from noisy or low-quality PET data, which encodes critical information about radioactivity distribution in the body., Purpose: Our objective was to optimize the image quality and reduce noise in preclinical PET images by utilizing the sinogram domain as input for DL models, resulting in improved image quality as compared to LD-PET images., Methods: A GAN and CNN model were utilized to predict high-dose (HD) preclinical PET sinograms from the corresponding LD preclinical PET sinograms. In order to generate the datasets, experiments were conducted on micro-phantoms, animal subjects (rats), and virtual simulations. The quality of DL-generated images was weighted by performing the following quantitative measures: structural similarity index measure (SSIM), root mean squared error (RMSE), peak signal-to-noise ratio (PSNR), signal-to-noise ratio (SNR), and contrast-to-noise ratio (CNR). Additionally, DL input and output were both subjected to a spatial resolution calculation of full width half maximum (FWHM) and full width tenth maximum (FWTM). DL outcomes were then compared with the conventional denoising algorithms such as non-local means (NLM), block-matching, and 3D filtering (BM3D)., Results: The DL models effectively learned image features and produced high-quality images, as reflected in the quantitative metrics. Notably, the FWHM and FWTM values of DL PET images exhibited significantly improved accuracy compared to LD, NLM, and BM3D PET images, and just as precise as HD PET images. The MSE loss underscored the excellent performance of the models, indicating that the models performed well. To further improve the training, the generator loss (G loss) was increased to a value higher than the discriminator loss (D loss), thereby achieving convergence in the GAN model., Conclusions: The sinograms generated by the GAN network closely resembled real HD preclinical PET sinograms and were more realistic than LD. There was a noticeable improvement in image quality and noise factor in the predicted HD images. Importantly, DL networks did not fully compromise the spatial resolution of the images., (© 2023 American Association of Physicists in Medicine.)

The 2023 edition of the AIxIA Conference, held in Rome, brought together a large number of researchers and practitioners to discuss the most recent and important advancements in Artificial Intelligence (AI). The conference featured 19 workshops, organized by 77 experts, attracting 248 submissions and resulting in 16 proceedings. This special issue presents extended versions of selected papers initially showcased at these workshops. Each paper underwent rigorous review and represents a diverse array of topics, reflecting the multifaceted nature of the Italian AI community. The topics covered include ethical foundations to symbiotic AI, symbolic knowledge extraction from black-box models, creative influence prediction using graph theory, AI approaches to multidimensional poverty prediction, an assessment of AI-based supports for informal caregivers, deep learning-based EEG denoising, AI-assisted board-game-based learning, large language models for assessment and feedback in higher education, geometric reasoning in the Traveling Salesperson Problem, defeasible reasoning in weighted knowledge bases, and conditional computation in neural networks. These contributions demonstrate the innovative and interdisciplinary research within the AI community, offering valuable insights and advancing the field. [ABSTRACT FROM AUTHOR]

This study introduces TooT-PLM-ionCT, a comprehensive framework that consolidates three distinct systems, each meticulously tailored for one of the following tasks: distinguishing ion channels (ICs) from membrane proteins (MPs), segregating ion transporters (ITs) from MPs, and differentiating ICs from ITs. Drawing upon the strengths of six Protein Language Models (PLMs)-ProtBERT, ProtBERT-BFD, ESM-1b, ESM-2 (650M parameters), and ESM-2 (15B parameters), TooT-PLM-ionCT employs a combination of traditional classifiers and deep learning models for nuanced protein classification. Originally validated on an existing dataset by previous researchers, our systems demonstrated superior performance in identifying ITs from MPs and distinguishing ICs from ITs, with the IC-MP discrimination achieving state-of-the-art results. In light of recommendations for additional validation, we introduced a new dataset, significantly enhancing the robustness and generalization of our models across bioinformatics challenges. This new evaluation underscored the effectiveness of TooT-PLM-ionCT in adapting to novel data while maintaining high classification accuracy. Furthermore, this study explores critical factors affecting classification accuracy, such as dataset balancing, the impact of using frozen versus fine-tuned PLM representations, and the variance between half and full precision in floating-point computations. To facilitate broader application and accessibility, a web server (https://tootsuite.encs.concordia.ca/service/TooT-PLM-ionCT) has been developed, allowing users to evaluate unknown protein sequences through our specialized systems for IC-MP, IT-MP, and IC-IT classification tasks., (© 2024 The Authors. Proteins: Structure, Function, and Bioinformatics published by Wiley Periodicals LLC.)

Background: Breath-holding (BH) for cine balanced steady state free precession (bSSFP) imaging is challenging for patients with impaired BH capacity. Deep learning-based reconstruction (DLR) of undersampled k-space promises to shorten BHs while preserving image quality and accuracy of ventricular assessment., Purpose: To perform a systematic evaluation of DLR of cine bSSFP images from undersampled k-space over a range of acceleration factors., Study Type: Retrospective., Subjects: Fifteen pectus excavatum patients (mean age 16.8 ± 5.4 years, 20% female) with normal cardiac anatomy and function and 12-second BH capability., Field Strength/sequence: 1.5-T, cine bSSFP., Assessment: Retrospective DLR was conducted by applying compressed sensitivity encoding (C-SENSE) acceleration to systematically undersample fully sampled k-space cine bSSFP acquisition data over an acceleration/undersampling factor (R) considering a range of 2 to 8. Quality imperceptibility (QI) measures, including structural similarity index measure, were calculated using images reconstructed from fully sampled k-space as a reference. Image quality, including contrast and edge definition, was evaluated for diagnostic adequacy by three readers with varying levels of experience in cardiac MRI (>4 years, >18 years, and 1 year). Automated DL-based biventricular segmentation was performed commercially available software by cardiac radiologists with more than 4 years of experience., Statistical Tests: Tukey box plots, linear mixed effects model, analysis of variance (ANOVA), weighted kappa, Kruskal-Wallis test, and Wilcoxon signed-rank test were employed as appropriate. A P-value <0.05 was considered statistically significant., Results: There was a significant decrease in the QI values and edge definition scores as R increased. Diagnostically adequate image quality was observed up to R = 5. The effect of R on all biventricular volumetric indices was non-significant (P = 0.447)., Data Conclusion: The biventricular volumetric indices obtained from the reconstruction of fully sampled cine bSSFP acquisitions and DLR of the same k-space data undersampled by C-SENSE up to R = 5 may be comparable., Evidence Level: 3 TECHNICAL EFFICACY: Stage 1., (© 2023 The Authors. Journal of Magnetic Resonance Imaging published by Wiley Periodicals LLC on behalf of International Society for Magnetic Resonance in Medicine.)

Magnetic resonance imaging (MRI) is a ubiquitous medical imaging technology with applications in disease diagnostics, intervention, and treatment planning. Accurate MRI segmentation is critical for diagnosing abnormalities, monitoring diseases, and deciding on a course of treatment. With the advent of advanced deep learning frameworks, fully automated and accurate MRI segmentation is advancing. Traditional supervised deep learning techniques have advanced tremendously, reaching clinical-level accuracy in the field of segmentation. However, these algorithms still require a large amount of annotated data, which is oftentimes unavailable or impractical. One way to circumvent this issue is to utilize algorithms that exploit a limited amount of labeled data. This paper aims to review such state-of-the-art algorithms that use a limited number of annotated samples. We explain the fundamental principles of self-supervised learning, generative models, few-shot learning, and semi-supervised learning and summarize their applications in cardiac, abdomen, and brain MRI segmentation. Throughout this review, we highlight algorithms that can be employed based on the quantity of annotated data available. We also present a comprehensive list of notable publicly available MRI segmentation datasets. To conclude, we discuss possible future directions of the field-including emerging algorithms, such as contrastive language-image pretraining, and potential combinations across the methods discussed-that can further increase the efficacy of image segmentation with limited labels., (© 2024 The Authors. NMR in Biomedicine published by John Wiley & Sons Ltd.)

Objective: This study aimed to evaluate the significance of background noise in machine learning models assessing the GRBAS scale for voice disorders., Methods: A dataset of 1406 voice samples was collected from retrospective data, and a 5-layer 1D convolutional neural network (CNN) model was constructed using TensorFlow. The dataset was divided into training, validation, and test data. Gaussian noise was added to test samples at various intensities to assess the model's noise resilience. The model's performance was evaluated using accuracy, F1 score, and quadratic weighted Cohen's kappa score., Results: The model's performance on the GRBAS scale generally declined with increasing noise intensities. For the G scale, accuracy dropped from 70.9% (original) to 8.5% (at the highest noise), F1 score from 69.2% to 1.3%, and Cohen's kappa from 0.679 to 0.0. Similar declines were observed for the remaining RBAS components., Conclusion: The model's performance was affected by background noise, with substantial decreases in evaluation metrics as noise levels intensified. Future research should explore noise-tolerant techniques, such as data augmentation, to improve the model's noise resilience in real-world settings., Level of Evidence: This study evaluates a machine learning model using a single dataset without comparative controls. Given its non-comparative design and specific focus, it aligns with Level 4 evidence (Case-series) under the 2011 OCEBM guidelines Laryngoscope, 134:3537-3541, 2024., (© 2024 The Authors. The Laryngoscope published by Wiley Periodicals LLC on behalf of The American Laryngological, Rhinological and Otological Society, Inc.)

Purpose: Irradiation of the brain regions from nasopharyngeal carcinoma (NPC) radiotherapy (RT) is frequently unavoidable, which may result in radiation-induced cognitive deficit. Using deep learning (DL), the study aims to develop prediction models in predicting compromised cognition in patients following NPC RT using remote assessments and determine their relation to the quality of life (QoL) and MRI changes., Methods: Seventy patients (20-76 aged) with MRI imaging (pre- and post-RT (6 months-1 year)) and complete cognitive assessments were recruited. Hippocampus, temporal lobes (TLs), and cerebellum were delineated and dosimetry parameters were extracted. Assessments were given post-RT via telephone (Telephone Interview Cognitive Status (TICS), Telephone Montreal Cognitive Assessment (T-MoCA), Telephone Mini Addenbrooke's Cognitive Examination (Tele-MACE), and QLQ-H&N 43). Regression and deep neural network (DNN) models were used to predict post-RT cognition using anatomical and treatment dose features., Results: Remote cognitive assessments were inter-correlated (r > 0.9). TLs showed significance in pre- and post-RT volume differences and cognitive deficits, that are correlated with RT-associated volume atrophy and dose distribution. Good classification accuracy based on DNN area under receiver operating curve (AUROC) for cognitive prediction (T-MoCA AUROC = 0.878, TICS AUROC = 0.89, Tele-MACE AUROC = 0.919)., Conclusion: DL-based prediction models assessed using remote assessments can assist in predicting cognitive deficit following NPC RT. Comparable results of remote assessments in assessing cognition suggest its possibility in replacing standard assessments., Implications for Cancer Survivors: Application of prediction models in individual patient enables tailored interventions to be provided in managing cognitive changes following NPC RT., (© 2023. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Precision in the diagnosis of diverse central nervous system (CNS) tumor types is crucial for optimal treatment. DNA methylation profiles, which capture the methylation status of thousands of individual CpG sites, are state-of-the-art data-driven means to enhance diagnostic accuracy but are also time consuming and not widely available. Here, to address these limitations, we developed Deep lEarning from histoPathoLOgy and methYlation (DEPLOY), a deep learning model that classifies CNS tumors to ten major categories from histopathology. DEPLOY integrates three distinct components: the first classifies CNS tumors directly from slide images ('direct model'), the second initially generates predictions for DNA methylation beta values, which are subsequently used for tumor classification ('indirect model'), and the third classifies tumor types directly from routinely available patient demographics. First, we find that DEPLOY accurately predicts beta values from histopathology images. Second, using a ten-class model trained on an internal dataset of 1,796 patients, we predict the tumor categories in three independent external test datasets including 2,156 patients, achieving an overall accuracy of 95% and balanced accuracy of 91% on samples that are predicted with high confidence. These results showcase the potential future use of DEPLOY to assist pathologists in diagnosing CNS tumors within a clinically relevant short time frame., (© 2024. This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply.)

Background: Hyperspectral imaging (HSI), combined with machine learning, can help to identify characteristic tissue signatures enabling automatic tissue recognition during surgery. This study aims to develop the first HSI-based automatic abdominal tissue recognition with human data in a prospective bi-center setting., Methods: Data were collected from patients undergoing elective open abdominal surgery at two international tertiary referral hospitals from September 2020 to June 2021. HS images were captured at various time points throughout the surgical procedure. Resulting RGB images were annotated with 13 distinct organ labels. Convolutional Neural Networks (CNNs) were employed for the analysis, with both external and internal validation settings utilized., Results: A total of 169 patients were included, 73 (43.2%) from Strasbourg and 96 (56.8%) from Verona. The internal validation within centers combined patients from both centers into a single cohort, randomly allocated to the training (127 patients, 75.1%, 585 images) and test sets (42 patients, 24.9%, 181 images). This validation setting showed the best performance. The highest true positive rate was achieved for the skin (100%) and the liver (97%). Misclassifications included tissues with a similar embryological origin (omentum and mesentery: 32%) or with overlaying boundaries (liver and hepatic ligament: 22%). The median DICE score for ten tissue classes exceeded 80%., Conclusion: To improve automatic surgical scene segmentation and to drive clinical translation, multicenter accurate HSI datasets are essential, but further work is needed to quantify the clinical value of HSI. HSI might be included in a new omics science, namely surgical optomics, which uses light to extract quantifiable tissue features during surgery., (© 2024. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Objectives: To evaluate the relationship of changes in the deep learning-based CT quantification of interstitial lung disease (ILD) with changes in forced vital capacity (FVC) and visual assessments of ILD progression, and to investigate their prognostic implications., Methods: This study included ILD patients with CT scans at intervals of over 2 years between January 2015 and June 2021. Deep learning-based texture analysis software was used to segment ILD findings on CT images (fibrosis: reticular opacity + honeycombing cysts; total ILD extent: ground-glass opacity + fibrosis). Patients were grouped according to the absolute decline of predicted FVC (< 5%, 5-10%, and ≥ 10%) and ILD progression assessed by thoracic radiologists, and their quantification results were compared among these groups. The associations between quantification results and survival were evaluated using multivariable Cox regression analysis., Results: In total, 468 patients (239 men; 64 ± 9.5 years) were included. Fibrosis and total ILD extents more increased in patients with larger FVC decline (p < .001 in both). Patients with ILD progression had higher fibrosis and total ILD extent increases than those without ILD progression (p < .001 in both). Increases in fibrosis and total ILD extent were significant prognostic factors when adjusted for absolute FVC declines of ≥ 5% (hazard ratio [HR] 1.844, p = .01 for fibrosis; HR 2.484, p < .001 for total ILD extent) and ≥ 10% (HR 2.918, p < .001 for fibrosis; HR 3.125, p < .001 for total ILD extent)., Conclusion: Changes in ILD CT quantification correlated with changes in FVC and visual assessment of ILD progression, and they were independent prognostic factors in ILD patients., Clinical Relevance Statement: Quantifying the CT features of interstitial lung disease using deep learning techniques could play a key role in defining and predicting the prognosis of progressive fibrosing interstitial lung disease., Key Points: • Radiologic findings on high-resolution CT are important in diagnosing progressive fibrosing interstitial lung disease. • Deep learning-based quantification results for fibrosis and total interstitial lung disease extents correlated with the decline in forced vital capacity and visual assessments of interstitial lung disease progression, and emerged as independent prognostic factors. • Deep learning-based interstitial lung disease CT quantification can play a key role in diagnosing and prognosticating progressive fibrosing interstitial lung disease., (© 2023. The Author(s), under exclusive licence to European Society of Radiology.)

Background: Quantification of metabolites concentrations in institutional unit (IU) is important for inter-subject and long-term comparisons in the applications of magnetic resonance spectroscopy (MRS). Recently, deep learning (DL) algorithms have found a variety of applications on the process of MRS data. A quantification strategy compatible to DL base MRS spectral processing method is, therefore, useful., Materials and Methods: This study aims to investigate whether metabolite concentrations quantified using a convolutional neural network (CNN) based method, coupled with a scaling procedure that normalizes spectral signals for CNN input and linear regression, can effectively reflect variations in metabolite concentrations in IU across different brain regions with varying signal-to-noise ratios (SNR) and linewidths (LW). An error index based on standard error (SE) is proposed to indicate the confidence levels associated with metabolite predictions. In vivo MRS spectra were acquired from three brain regions of 43 subjects using a 3T system., Results: The metabolite concentrations in IU of five major metabolites, quantified using CNN and LCModel, exhibit similar ranges with Pearson's correlation coefficients ranging from 0.24 to 0.78. The SE of the metabolites shows a positive correlation with Cramer-Rao lower bound (CRLB) (r=0.46) and  absolute CRLB (r=0.81), calculated by multiplying CRLBs with the quantified metabolite content., Conclusion: In conclusion, the CNN based method with the proposed scaling procedures can be employed to quantify in vivo MRS spectra and derive metabolites concentrations in IU. The SE can be used as error index, indicating predicted uncertainties for metabolites and sharing information similar to the absolute CRLB., (© 2023. The Author(s), under exclusive licence to European Society for Magnetic Resonance in Medicine and Biology (ESMRMB).)

Purpose: Urolithiasis is a chronic condition that leads to repeated CT scans throughout the patient's life. The goal was to assess the diagnostic performance and image quality of submillisievert abdominopelvic computed tomography (CT) using deep learning-based image reconstruction (DLIR) in urolithiasis., Methods: 57 patients with suspected urolithiasis underwent both non-contrast low-dose (LD) and ULD abdominopelvic CT. Raw image data of ULD CT were reconstructed using hybrid iterative reconstruction (ASIR-V 70%) and high-strength-level DLIR (DLIR-H). The performance of ULD CT for the detection of urinary stones was assessed by two readers and compared with LD CT with ASIR-V 70% as a reference standard. Image quality was assessed subjectively and objectively., Results: 266 stones were detected in 38 patients. Mean effective dose was 0.59 mSv for ULD CT and 1.96 mSv for LD CT. For diagnostic performance, sensitivity and specificity were 89% and 94%, respectively, for ULDCT with DLIR-H. There was an almost perfect intra-observer concordance on ULD CT with DLIR-H versus LDCT with ASIR-V 70% (ICC = 0.90 and 0.90 for the two readers). Image noise was significantly lower and signal-to-noise ratio significantly higher with DLIR-H compared to ASIR-V 70%. Subjective image quality was also significantly better with ULDCT with DLIR-H., Conclusion: ULD CT with Deep Learning Image Reconstruction maintains a good diagnostic performance in urolithiasis, with better image quality than hybrid iterative reconstruction and a significant radiation dose reduction., (© 2024. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Objectives: Accurate risk stratification of patients with stage II and III colorectal cancer (CRC) prior to treatment selection enables limited health resources to be efficiently allocated to patients who are likely to benefit from adjuvant chemotherapy. We aimed to investigate the cost-effectiveness of a recently developed deep learning-based prognostic method, Histotyping, from the perspective of the Norwegian healthcare system., Methods: Two partitioned survival models were developed to assess the cost-effectiveness of Histotyping for two treatment cohorts: patients with CRC stage II and III. For each of the two cohorts, Histotyping was used for risk stratification to assign adjuvant chemotherapy and was compared with the standard of care (SOC) (adjuvant chemotherapy to all patients). Health outcomes measured in the model were quality-adjusted life years (QALYs) and life years (LYs) gained. Deterministic and probabilistic sensitivity analyses were performed to determine the impact of uncertainty. Scenario analyses were performed to assess the impact of the parameters with the greatest uncertainty., Results: Risk-stratifying patients with CRC stage II and III using Histotyping was dominant (less costly and more effective) compared to SOC. In patients with CRC stage II, the net monetary benefit of Histotyping was 270,934 Norwegian kroners (NOK) (year of valuation is 2021), and the net health benefit of Histotyping was 0.99. In stage III, the net monetary benefit of Histotyping was 195,419 NOK, and the net health benefit of Histotyping was 0.71., Conclusions:  Risk-stratifying patients with CRC using Histotyping prior to the administration of adjuvant chemotherapy is likely to be a cost-effective strategy in Norway., (© 2024. The Author(s), under exclusive licence to Springer Nature Switzerland AG.)