Search

Compared with discrete emotion space, image emotion analysis based on dimensional emotion space can more accurately represent fine-grained emotion. Meanwhile, this high-precision representation of emotion requires dimensional emotion prediction methods to sense and capture emotional information in images as accurately and richly as possible. However, the existing methods mainly focus on emotion recognition by extracting the emotional regions where salient objects are located while ignoring the joint influence of objects and background on emotion. Furthermore, in the existing literature, when fusing multi-level features, no consideration has been given to the varying contributions of features from different levels to emotional analysis, which makes it difficult to distinguish valuable and useless features and cannot improve the utilization of effective features. This paper proposes an image emotion prediction network named ARMNet. In ARMNet, a unified affective region extraction method that integrates eye fixation detection and attention detection is proposed to enhance the combined influence of objects and backgrounds. Additionally, the multi-level features are fused with the consideration of their different contributions through an improved channel attention mechanism. In comparison to the existing methods, experiments conducted on the CGnA10766 dataset demonstrate that the performance of valence and arousal, as measured by Mean Squared Error (MSE), Mean Absolute Error (MAE), and Coefficient of Determination (R²), has improved by 4.74%, 3.53%, 3.62%, 1.93%, 6.29%, and 7.23%, respectively. Furthermore, the interpretability of the network is enhanced through the visualization of attention weights corresponding to emotional regions within the images. [ABSTRACT FROM AUTHOR]

The weight of live pigs is directly related to their health, nutrition management, disease prevention and control, and the overall economic benefits to livestock enterprises. Direct weighing can induce stress responses in pigs, leading to decreased productivity. Therefore, modern livestock industries are increasingly turning to non-contact techniques for estimating pig weight, such as automated monitoring systems based on computer vision. These technologies provide continuous, real-time weight-monitoring data without disrupting the pigs' normal activities or causing stress, thereby enhancing breeding efficiency and management levels. Two methods of pig weight estimation based on image and point cloud data are comprehensively analyzed in this paper. We first analyze the advantages and disadvantages of the two methods and then discuss the main problems and challenges in the field of pig weight estimation technology. Finally, we predict the key research areas and development directions in the future. [ABSTRACT FROM AUTHOR]

Detecting faulty pipelines in water management systems is crucial for ensuring a reliable supply of clean water. Traditional inspection methods are often time-consuming, costly, and prone to errors. This study introduces an AI-based model utilizing images to detect pipeline defects, focusing on leaks, cracks, and corrosion. The YOLOv8 model is employed for object detection due to its exceptional performance in detecting objects, segmentation, pose estimation, tracking, and classification. By training on a large dataset of labeled images, the model effectively learns to identify visual patterns associated with pipeline faults. Experiments conducted on a real-world dataset demonstrate that the AI-based model significantly outperforms traditional methods in detection accuracy. The model also exhibits robustness to various environmental conditions such as lighting changes, camera angles, and occlusions, ensuring reliable performance in diverse scenarios. The efficient processing time of the model enables real-time fault detection in large-scale water distribution networks implementing this AI-based model offers numerous advantages for water management systems. It reduces dependence on manual inspections, thereby saving costs and enhancing operational efficiency. Additionally, the model facilitates proactive maintenance through the early detection of faults, preventing water loss, contamination, and infrastructure damage. The results from the three conducted experiments indicate that the model from Experiment 1 achieves a commendable mAP50 of 90% in detecting faulty pipes, with an overall mAP50 of 74.7%. In contrast, the model from Experiment 3 exhibits superior overall performance, achieving a mAP50 of 76.1%. This research presents a promising approach to improving the reliability and sustainability of water management systems through AI-based fault detection using image analysis. [ABSTRACT FROM AUTHOR]

This study evaluates the performance of the MaskFormer model for segmenting and classifying breast lesions using ultrasound images, addressing ultrasound's limitations. Ultrasound used for breast cancer detection faces challenges like low image contrast and difficulty in the detection of small or multiple lesions, further complicated by variability based on operator skill. Initial experiments with U-Net and other CNN-based models revealed constraints, such as early plateauing in model loss, which indicated suboptimal learning and performance. In contrast, MaskFormer demonstrated continuous improvement, achieving higher precision in breast lesion segmentation and significantly reducing both false positives and false negatives. Comparative analysis showed MaskFormer's superior performance, with the highest precision and recall rates for malignant lesions and an overall mean average precision (mAP) of 0.943. The model's ability to detect a diverse range of breast lesions, including those potentially missed by the human eye, especially by less experienced practitioners, underscores its potential. These findings suggest that integrating AI models like MaskFormer could greatly enhance ultrasound performance for breast cancer detection, providing reliable, operator-independent image analysis and potentially improving patient outcomes on a global scale. [ABSTRACT FROM AUTHOR]

Efficient and affordable plant phenotyping methods are an essential response to global climatic pressures. This study demonstrates the continued potential of consumer-grade photography to capture plant phenotypic traits in turfgrass and derive new calculations. Yet the effects of image corrections on individual calculations are often unreported. Turfgrass lysimeters were photographed over 8 weeks using a custom lightbox and consumer-grade camera. Subsequent imagery was analyzed for area of cover, color metrics, and sensitivity to image corrections. Findings were compared to active spectral reflectance data and previously reported measurements of visual quality, productivity, and water use. Results confirm that Red–Green–Blue imagery effectively measures plant treatment effects. Notable correlations were observed for corrected imagery, including between yellow fractional area with human visual quality ratings (r = −0.89), dark green color index with clipping productivity (r = 0.61), and an index combination term with water use (r = −0.60). The calculation of green fractional area correlated with Normalized Difference Vegetation Index (r = 0.91), and its RED reflectance spectra (r = −0.87). A new chromatic ratio correlated with Normalized Difference Red-Edge index (r = 0.90) and its Red-Edge reflectance spectra (r = −0.74), while a new calculation correlated strongest to Near-Infrared (r = 0.90). Additionally, the combined index term significantly differentiated between the treatment effects of date, mowing height, deficit irrigation, and their interactions (p < 0.001). Sensitivity and statistical analyses of typical image file formats and corrections that included JPEG, TIFF, geometric lens distortion correction, and color correction were conducted. Findings highlight the need for more standardization in image corrections and to determine the biological relevance of the new image data calculations. [ABSTRACT FROM AUTHOR]

Quality assessment of ultrasound medical systems is a demanding task due to the high number of parameters to quantify their performance: in the present study, a Kiviat diagram-based integrated approach was proposed to effectively combine the contribution of some experimental parameters and quantify the overall performance of pulsed wave Doppler (PWD) systems for clinical applications. Four test parameters were defined and assessed through custom-written measurement methods based on image analysis, implemented in the MATLAB environment, and applied to spectral images of a flow phantom, i.e., average maximum velocity sensitivity (AMVS), velocity measurements accuracy (VeMeA), lowest detectable signal (LDS), and the velocity profile discrepancy index (VPDI). The parameters above were scaled in a standard range to represent the four vertices of a Kiviat plot, whose area was considered the overall quality index of the ultrasound system in PWD mode. Five brand-new ultrasound diagnostic systems, equipped with linear array probes, were tested in two different working conditions using a commercial flow phantom as a reference. The promising results confirm the robustness of AMVS, VeMeA, and LDS parameters while suggesting further investigations on the VPDI. [ABSTRACT FROM AUTHOR]

As deep learning technology has progressed, automated medical image analysis is becoming ever more crucial in clinical diagnosis. However, due to the diversity and complexity of blood cell images, traditional models still exhibit deficiencies in blood cell detection. To address blood cell detection, we developed the TW-YOLO approach, leveraging multi-scale feature fusion techniques. Firstly, traditional CNN (Convolutional Neural Network) convolution has poor recognition capabilities for certain blood cell features, so the RFAConv (Receptive Field Attention Convolution) module was incorporated into the backbone of the model to enhance its capacity to extract geometric characteristics from blood cells. At the same time, utilizing the feature pyramid architecture of YOLO (You Only Look Once), we enhanced the fusion of features at different scales by incorporating the CBAM (Convolutional Block Attention Module) in the detection head and the EMA (Efficient Multi-Scale Attention) module in the neck, thereby improving the recognition ability of blood cells. Additionally, to meet the specific needs of blood cell detection, we designed the PGI-Ghost (Programmable Gradient Information-Ghost) strategy to finely describe the gradient flow throughout the process of extracting features, further improving the model's effectiveness. Experiments on blood cell detection datasets such as BloodCell-Detection-Dataset (BCD) reveal that TW-YOLO outperforms other models by 2%, demonstrating excellent performance in the task of blood cell detection. In addition to advancing blood cell image analysis research, this work offers strong technical support for future automated medical diagnostics. [ABSTRACT FROM AUTHOR]

The widespread use of IoT devices has led to the generation of a huge amount of data and driven the need for analytical solutions in many areas of human activities, such as the field of smart agriculture. Continuous monitoring of crop growth stages enables timely interventions, such as control of weeds and plant diseases, as well as pest control, ensuring optimal development. Decision-making systems in smart agriculture involve image analysis with the potential to increase productivity, efficiency and sustainability. By applying Convolutional Neural Networks (CNNs), state recognition and classification can be performed based on images from specific locations. Thus, we have developed a solution for early problem detection and resource management optimization. The main concept of the proposed solution relies on a direct connection between Cloud and Edge devices, which is achieved through Fog computing. The goal of our work is creation of a deep learning model for image classification that can be optimized and adapted for implementation on devices with limited hardware resources at the level of Fog computing. This could increase the importance of image processing in the reduction of agricultural operating costs and manual labor. As a result of the off-load data processing at Edge and Fog devices, the system responsiveness can be improved, the costs associated with data transmission and storage can be reduced, and the overall system reliability and security can be increased. The proposed solution can choose classification algorithms to find a trade-off between size and accuracy of the model optimized for devices with limited hardware resources. After testing our model for tomato disease classification compiled for execution on FPGA, it was found that the decrease in test accuracy is as small as 0.83% (from 96.29% to 95.46%). [ABSTRACT FROM AUTHOR]

Underwater image enhancement technology is crucial for the human exploration and exploitation of marine resources. The visibility of underwater images is affected by visible light attenuation. This paper proposes an image reconstruction method based on the decomposition–fusion of multi-channel luminance data to enhance the visibility of underwater images. The proposed method is a single-image approach to cope with the condition that underwater paired images are difficult to obtain. The original image is first divided into its three RGB channels. To reduce artifacts and inconsistencies in the fused images, a multi-resolution fusion process based on the Laplace–Gaussian pyramid guided by a weight map is employed. Image saliency analysis and mask sharpening methods are also introduced to color-correct the fused images. The results indicate that the method presented in this paper effectively enhances the visibility of dark regions in the original image and globally improves its color, contrast, and sharpness compared to current state-of-the-art methods. Our method can enhance underwater images in engineering practice, laying the foundation for in-depth research on underwater images. [ABSTRACT FROM AUTHOR]

Canopy imaging offers a non-destructive, efficient way to objectively measure canopy size, detect stress symptoms, and assess pigment concentrations. While it is faster and easier than traditional destructive methods, manual image analysis, including segmentation and evaluation, can be time-consuming. To make imaging more widely accessible, it's essential to reduce the cost of imaging systems and automate the analysis process. We developed a low-cost imaging system with automated analysis using an embedded microcomputer equipped with a monochrome camera and a filter for a total hardware cost of ~USD 500. Our imaging system takes images under blue, green, red, and infrared light, as well as chlorophyll fluorescence. The system uses a Python-based program to collect and analyze images automatically. The multi-spectral imaging system separates plants from the background using a chlorophyll fluorescence image, which is also used to quantify canopy size. The system then generates normalized difference vegetation index (NDVI, "greenness") images and histograms, providing quantitative, spatially resolved information. We verified that these indices correlate with leaf chlorophyll content and can easily add other indices by installing light sources with the desired spectrums. The low cost of the system can make this imaging technology widely available. [ABSTRACT FROM AUTHOR]

Metallographic image analysis is vital in the field of metal science due to its potential to automate the sensing process for grain and particle size estimation. To ensure the good quality and reliability of metal products, analysis of the integrity of metallic components is required. In contemporary manufacturing processes, microscopic analysis is a crucial step, mainly when complex systems like gearboxes, turbines, or engines are assembled using various components from multiple suppliers. A final product's quality, durability, and lifespan are determined via the quality analysis of properties of a material with proper tolerances. A flaw in a single component can cause the breakdown of the entire finished product. To ensure the good quality of a material, micro-structural analysis is necessary, which includes the routine measurement of inclusions. The particle and grain sizes of particulate samples are the most crucial physical characteristics of metals. Their measurement is routinely conducted across various industries, and they are frequently considered essential parameters in the creation of many products. This paper discusses the role of sensors in enhancing the accuracy and efficiency of metallographic image analysis, as well as the challenges and limitations associated with this technology. The paper also highlights the potential applications of sensor-assisted metallographic image analysis in various industries, such as aerospace, automotive, and construction. The paper concludes by identifying future research directions for this emerging field, including the development of more sophisticated algorithms for grain and particle size estimation, the integration of multiple sensors for more accurate measurements, and the exploration of new sensing modalities for metallographic image analysis. [ABSTRACT FROM AUTHOR]

Extensive research has been conducted in image forensics on the analysis of double-compressed images, particularly in the widely adopted JPEG format. However, there is a lack of methods to detect double compression in the HEIF format, which has recently gained popularity since it allows for reduced file size while maintaining image quality. Traditional JPEG-based techniques do not apply to HEIF due to its distinct encoding algorithms. We previously proposed a method to detect double compression in HEIF images based on Farid's work on coding ghosts in JPEG images. However, this method was limited to scenarios where the quality parameter used for the first encoding was larger than for the second encoding. In this study, we propose a lightweight image classifier to extend the existing model, enabling the identification of double-compressed images without heavily depending on the input image's quantization history. This extended model outperforms the previous approach and, despite its lightness, demonstrates excellent detection accuracy. [ABSTRACT FROM AUTHOR]

In this paper, a novel deep learning method Mamba-RAYOLO is presented, which can improve detection and classification in the processing and analysis of ECG images in real time by integrating three advanced modules. The feature extraction module in our work with a multi-branch structure during training can capture a wide range of features to ensure efficient inference and rich feature extraction. The attention mechanism module utilized in our proposed network can dynamically focus on the most relevant spatial and channel-wise features to improve detection accuracy and computational efficiency. Then, the extracted features can be refined for efficient spatial feature processing and robust feature fusion. Several sets of experiments have been carried out to test the validity of the proposed Mamba-RAYOLO and these indicate that our method has made significant improvements in the detection and classification of ECG images. The research offers a promising framework for more accurate and efficient medical ECG diagnostics. [ABSTRACT FROM AUTHOR]

Grain size analysis is used to study grain size and distribution. It is a critical indicator in sedimentary simulation experiments (SSEs), which aids in understanding hydrodynamic conditions and identifying the features of sedimentary environments. Existing methods for grain size analysis based on images primarily focus on scenarios where grain edges are distinct or grain arrangements are regular. However, these methods are not suitable for images from SSEs. We proposed a deep learning model incorporating histogram layers for the analysis of SSE images with fuzzy grain edges and irregular arrangements. Firstly, ResNet18 was used to extract features from SSE images. These features were then input into the histogram layer to obtain local histogram features, which were concatenated to form comprehensive histogram features for the entire image. Finally, the histogram features were connected to a fully connected layer to estimate the grain size corresponding to the cumulative volume percentage. In addition, an applied workflow was developed. The results demonstrate that the proposed method achieved higher accuracy than the eight other models and was highly consistent with manual results in practice. The proposed method enhances the efficiency and accuracy of grain size analysis for images with irregular grain distribution and improves the quantification and automation of grain size analysis in SSEs. It can also be applied for grain size analysis in fields such as soil and geotechnical engineering. [ABSTRACT FROM AUTHOR]

Infant meningitis remains a severe burden on global health, particularly for young infants. Traditional ultrasound imaging techniques are limited in spatial resolution to visualize white blood cells (WBCs) in the cerebrospinal fluid (CSF), which is considered a well-established marker for meningitis detection. This work presents a novel platform that uses high-resolution ultrasound to detect the backscatter signals from microscopic CSF WBCs through the anterior fontanelle of neonates and young infants. The whole system was built around a custom probe that allows for a 20 MHz focused transducer to be mechanically controlled to map the area of interest in the CSF. Data processing can be performed internally in the device without the need to extract the images for further analysis. The in vitro feasibility of the proposed solution was evaluated in imaging 7 μ m particle suspensions at different concentrations relevant to meningitis diagnosis ranging from 7- to 646-particles (pp)/ μ L. The experimental tests were conducted from a simple setup using a sample container to a more realistic setup based on an anatomical phantom of the neonatal head. The results show high-quality images, where 7 μ m particles can be resolved for the different concentrations. [ABSTRACT FROM AUTHOR]

Pancreatic cancer is a highly lethal disease with a poor prognosis. Its early diagnosis and accurate treatment mainly rely on medical imaging, so accurate medical image analysis is especially vital for pancreatic cancer patients. However, medical image analysis of pancreatic cancer is facing challenges due to ambiguous symptoms, high misdiagnosis rates, and significant financial costs. Artificial intelligence (AI) offers a promising solution by relieving medical personnel's workload, improving clinical decision-making, and reducing patient costs. This study focuses on AI applications such as segmentation, classification, object detection, and prognosis prediction across five types of medical imaging: CT, MRI, EUS, PET, and pathological images, as well as integrating these imaging modalities to boost diagnostic accuracy and treatment efficiency. In addition, this study discusses current hot topics and future directions aimed at overcoming the challenges in AI-enabled automated pancreatic cancer diagnosis algorithms. [ABSTRACT FROM AUTHOR]

The decline in seed quality over time due to natural aging or mishandling requires assessing seed vigor for resilience in adverse conditions. Accelerated aging (AA) methods simulate seed deterioration by subjecting seeds to high temperatures and humidity. Saturated salt accelerated aging (SSAA) is an AA method adopted for small seeds like lettuce (Lactuca sativa). In this study, we subjected seeds of two lettuce cultivars ('Muir' and 'Bauer') to SSAA by sealing them in a box containing 40 g/100 mL of a sodium chloride (NaCl) solution in a dark growth chamber at 41 °C for 24, 48, and 72 h with a control. We monitored their vigor using embedded computer cameras, tracking the projected canopy size (PCS) daily from sowing to harvest. The cultivar 'Muir' exhibited consistent PCS values across the treatments, while 'Bauer' showed PCS variations, with notable declines after prolonged aging. The germination rates dropped significantly after 48 and 72 h of SSAA. A nonlinear regression model revealed a strong relationship between PCS and shoot dry weight across harvests and cultivars (R2 = 0.93, RMSE = 0.15, p < 0.001). The research found that the projected canopy size and shoot dry weight increased over time with significant differences in treatments for the cultivar 'Bauer' but not for 'Muir,' with the canopy size being a strong predictor of dry weight and no significant impact from the SSAA treatments. This study highlights cultivar-specific responses to aging and demonstrates the efficacy of our imaging tool in predicting lettuce dry weight despite treatment variations. Understanding how aging affects different lettuce varieties is crucial for seed management and crop sustainability. [ABSTRACT FROM AUTHOR]

Salinity stress is a common challenge in plant growth, impacting seed quality, germination, and general plant health. Sodium chloride (NaCl) ions disrupt membranes, causing ion leakage and reducing seed viability. Gibberellic acid (GA3) treatments have been found to promote germination and mitigate salinity stress on germination and plant growth. 'Bauer' and 'Muir' lettuce (Lactuca sativa) seeds were soaked in distilled water (control), 100 mM NaCl, 100 mM NaCl + 50 mg/L GA3, and 100 mM NaCl + 150 mg/L GA3 in Petri dishes and kept in a dark growth chamber at 25 °C for 24 h. After germination, seedlings were monitored using embedded cameras, capturing red, green, and blue (RGB) images from seeding to final harvest. Despite consistent germination rates, 'Bauer' seeds treated with NaCl showed reduced germination. Surprisingly, the 'Muir' cultivar's final dry weight differed across treatments, with the NaCl and high GA3 concentration combination yielding the poorest results (p < 0.05). This study highlights the efficacy of GA3 applications in improving germination rates. However, at elevated concentrations, it induced excessive hypocotyl elongation and pale seedlings, posing challenges for two-dimensional imaging. Nonetheless, a sigmoidal regression model using projected canopy size accurately predicted dry weight across growth stages and cultivars, emphasizing its reliability despite treatment variations (R2 = 0.96, RMSE = 0.11, p < 0.001). [ABSTRACT FROM AUTHOR]

The survival and growth of young plants hinge on various factors, such as seed quality and environmental conditions. Assessing seedling potential/vigor for a robust crop yield is crucial but often resource-intensive. This study explores cost-effective imaging techniques for rapid evaluation of seedling vigor, offering a practical solution to a common problem in agricultural research. In the first phase, nine lettuce (Lactuca sativa) cultivars were sown in trays and monitored using chlorophyll fluorescence imaging thrice weekly for two weeks. The second phase involved integrating embedded computers equipped with cameras for phenotyping. These systems captured and analyzed images four times daily, covering the entire growth cycle from seeding to harvest for four specific cultivars. All resulting data were promptly uploaded to the cloud, allowing for remote access and providing real-time information on plant performance. Results consistently showed the 'Muir' cultivar to have a larger canopy size and better germination, though 'Sparx' and 'Crispino' surpassed it in final dry weight. A non-linear model accurately predicted lettuce plant weight using seedling canopy size in the first study. The second study improved prediction accuracy with a sigmoidal growth curve from multiple harvests (R2 = 0.88, RMSE = 0.27, p < 0.001). Utilizing embedded computers in controlled environments offers efficient plant monitoring, provided there is a uniform canopy structure and minimal plant overlap. [ABSTRACT FROM AUTHOR]

Hyperspectral images (HSIs) possess an inherent three-order structure, prompting increased interest in extracting 3D features. Tensor analysis and low-rank representations, notably truncated higher-order SVD (T-HOSVD), have gained prominence for this purpose. However, determining the optimal order and addressing sensitivity to changes in data distribution remain challenging. To tackle these issues, this paper introduces an unsupervised Superpixelwise Multiscale Adaptive T-HOSVD (SmaT-HOSVD) method. Leveraging superpixel segmentation, the algorithm identifies homogeneous regions, facilitating the extraction of local features to enhance spatial contextual information within the image. Subsequently, T-HOSVD is adaptively applied to the obtained superpixel blocks for feature extraction and fusion across different scales. SmaT-HOSVD harnesses superpixel blocks and low-rank representations to extract 3D features, effectively capturing both spectral and spatial information of HSIs. By integrating optimal-rank estimation and multiscale fusion strategies, it acquires more comprehensive low-rank information and mitigates sensitivity to data variations. Notably, when trained on subsets comprising 2%, 1%, and 1% of the Indian Pines, University of Pavia, and Salinas datasets, respectively, SmaT-HOSVD achieves impressive overall accuracies of 93.31%, 97.21%, and 99.25%, while maintaining excellent efficiency. Future research will explore SmaT-HOSVD's applicability in deep-sea HSI classification and pursue additional avenues for advancing the field. [ABSTRACT FROM AUTHOR]

Detecting pipeline leaks is an essential factor in maintaining the integrity of fluid transport systems. This paper introduces an advanced deep learning framework that uses continuous wavelet transform (CWT) images for precise detection of such leaks. Transforming acoustic signals from pipelines under various conditions into CWT scalograms, followed by signal processing by non-local means and adaptive histogram equalization, results in new enhanced leak-induced scalograms (ELIS) that capture detailed energy fluctuations across time-frequency scales. The fundamental approach takes advantage of a deep belief network (DBN) fine-tuned with a genetic algorithm (GA) and unified with a least squares support vector machine (LSSVM) to improve feature extraction and classification accuracy. The DBN-GA framework precisely extracts informative features, while the LSSVM classifier precisely distinguishes between leaky and non-leak conditions. By concentrating solely on the advanced capabilities of ELIS processed through an optimized DBN-GA-LSSVM model, this research achieves high detection accuracy and reliability, making a significant contribution to pipeline monitoring and maintenance. This innovative approach to capturing complex signal patterns can be applied to real-time leak detection and critical infrastructure safety in several industrial applications. [ABSTRACT FROM AUTHOR]

Breast cancer is the second most common cancer worldwide, primarily affecting women, while histopathological image analysis is one of the possibile methods used to determine tumor malignancy. Regarding image analysis, the application of deep learning has become increasingly prevalent in recent years. However, a significant issue is the unbalanced nature of available datasets, with some classes having more images than others, which may impact the performance of the models due to poorer generalizability. A possible strategy to avoid this problem is downsampling the class with the most images to create a balanced dataset. Nevertheless, this approach is not recommended for small datasets as it can lead to poor model performance. Instead, techniques such as data augmentation are traditionally used to address this issue. These techniques apply simple transformations such as translation or rotation to the images to increase variability in the dataset. Another possibility is using generative adversarial networks (GANs), which can generate images from a relatively small training set. This work aims to enhance model performance in classifying histopathological images by applying data augmentation using GANs instead of traditional techniques. [ABSTRACT FROM AUTHOR]

As remote sensing technology has advanced, the use of satellites and similar technologies has become increasingly prevalent in daily life. Now, it plays a crucial role in hydrology, agriculture, and geography. Nevertheless, because of the distinct qualities of remote sensing, including expansive scenes and small, densely packed targets, there are many challenges in detecting remote sensing objects. Those challenges lead to insufficient accuracy in remote sensing object detection. Consequently, developing a new model is essential to enhance the identification capabilities for objects in remote sensing imagery. To solve these constraints, we have designed the OD-YOLO approach that uses multi-scale feature fusion to improve the performance of the YOLOv8n model in small target detection. Firstly, traditional convolutions have poor recognition capabilities for certain geometric shapes. Therefore, in this paper, we introduce the Detection Refinement Module (DRmodule) into the backbone architecture. This module utilizes Deformable Convolutional Networks and the Hybrid Attention Transformer to strengthen the model's capability for feature extraction from geometric shapes and blurred objects effectively. Meanwhile, based on the Feature Pyramid Network of YOLO, at the head of the model framework, this paper enhances the detection capability by introducing a Dynamic Head to strengthen the fusion of different scales features in the feature pyramid. Additionally, to address the issue of detecting small objects in remote sensing images, this paper specifically designs the OIoU loss function to finely describe the difference between the detection box and the true box, further enhancing model performance. Experiments on the VisDrone dataset show that OD-YOLO surpasses the compared models by at least 5.2% in mAP50 and 4.4% in mAP75, and experiments on the Foggy Cityscapes dataset demonstrated that OD-YOLO improved mAP by 6.5%, demonstrating outstanding results in tasks related to remote sensing images and adverse weather object detection. This work not only advances the research in remote sensing image analysis, but also provides effective technical support for the practical deployment of future remote sensing applications. [ABSTRACT FROM AUTHOR]

The paper deals with a combined time–depth conversion strategy able to improve the reconstruction of voids embedded in an opaque medium, such as cavities, caves, empty hypogeal rooms, and similar targets. The combined time–depth conversion accounts for the propagation velocity of the electromagnetic waves both in free space and in the embedding medium, and it allows better imaging and interpretation of the underground scenario. To assess the strategy's effectiveness, ground penetrating radar (GPR) data referred to as an experimental test in controlled conditions are accounted for and processed by two different approaches to achieve focused images of the scenario under test. The first approach is based on a classical migration algorithm, while the second one faces the imaging as a linear inverse scattering approach. The results corroborate that the combined time–depth conversion improves the imaging in both cases. [ABSTRACT FROM AUTHOR]

The process of image fusion is the process of enriching an image and improving the image's quality, so as to facilitate the subsequent image processing and analysis. With the increasing importance of image fusion technology, the fusion of infrared and visible images has received extensive attention. In today's deep learning environment, deep learning is widely used in the field of image fusion. However, in some applications, it is not possible to obtain a large amount of training data. Because some special organs of snakes can receive and process infrared information and visible information, the fusion method of infrared and visible light to simulate the visual mechanism of snakes came into being. Therefore, this paper takes into account the perspective of visual bionics to achieve image fusion; such methods do not need to obtain a significant amount of training data. However, most of the fusion methods for simulating snakes face the problem of unclear details, so this paper combines this method with a pulse coupled neural network (PCNN). By studying two receptive field models of retinal nerve cells, six dual-mode cell imaging mechanisms of rattlesnakes and their mathematical models and the PCNN model, an improved fusion method of infrared and visible images was proposed. For the proposed fusion method, eleven groups of source images were used, and three non-reference image quality evaluation indexes were compared with seven other fusion methods. The experimental results show that the improved algorithm proposed in this paper is better overall than the comparison method for the three evaluation indexes. [ABSTRACT FROM AUTHOR]

Addressing the challenge of large-scale uneven deformation and the complexities of monitoring road conditions, this study focuses on a segment of the G15 Coastal Highway in Jiangsu Province. It employs PS-InSAR, SBAS-InSAR, and DS-InSAR techniques to comprehensively observe deformation. Analysis of 73 image datasets spanning 2018 to 2021 enables separate derivation of deformation data using distinct InSAR methodologies. Results are then interpreted alongside geological and geomorphological features. Findings indicate widespread deformation along the G15 Coastal Highway, notably significant settlement near Guanyun North Hub and uplift near Guhe Bridge. Maximum deformation rates exceeding 10 mm/year are observed in adjacent areas by all three techniques. To assess data consistency across techniques, identical observation points are identified, and correlation and difference analyses are conducted using statistical software. Results reveal a high correlation between the monitoring outcomes of the three techniques, with an average observation difference of less than 2 mm/year. This underscores the feasibility of employing a combination of these InSAR techniques for road deformation monitoring, offering a reliable approach for establishing real-time monitoring systems and serving as a foundation for ongoing road health assessments. [ABSTRACT FROM AUTHOR]

In this paper, we present a laser triangulation sensor to measure the distance between the sensor and an object without contact using a diffraction slit rather than a traditional lens. We show that by replacing the lens with a slit, we can exploit the resulting diffraction pattern to have finer and yet simpler image analysis, yielding better estimation of the distance to the object. To test our hypothesis, we build a precision position table and a laser triangulation sensor, generate large data sets to test different estimation algorithms on various materials, and compare data acquisition using a traditional lens versus using a slit. We show that position estimation when using a slit is both more precise and more accurate than comparable methods using a lens. [ABSTRACT FROM AUTHOR]

Generating realistic road scenes is crucial for advanced driving systems, particularly for training deep learning methods and validation. Numerous efforts aim to create larger and more realistic synthetic datasets using graphics engines or synthetic-to-real domain adaptation algorithms. In the realm of computer-generated images (CGIs), assessing fidelity is challenging and involves both objective and subjective aspects. Our study adopts a comprehensive conceptual framework to quantify the fidelity of RGB images, unlike existing methods that are predominantly application-specific. This is probably due to the data complexity and huge range of possible situations and conditions encountered. In this paper, a set of distinct metrics assessing the level of fidelity of virtual RGB images is proposed. For quantifying image fidelity, we analyze both local and global perspectives of texture and the high-frequency information in images. Our focus is on the statistical characteristics of realistic and synthetic road datasets, using over 28,000 images from at least 10 datasets. Through a thorough examination, we aim to reveal insights into texture patterns and high-frequency components contributing to the objective perception of data realism in road scenes. This study, exploring image fidelity in both virtual and real conditions, takes the perspective of an embedded camera rather than the human eye. The results of this work, including a pioneering set of objective scores applied to real, virtual, and improved virtual data, offer crucial insights and are an asset for the scientific community in quantifying fidelity levels. [ABSTRACT FROM AUTHOR]

The degradation of road pavements due to environmental factors is a pressing issue in infrastructure maintenance, necessitating precise identification of pavement distresses. The pavement condition index (PCI) serves as a critical metric for evaluating pavement conditions, essential for effective budget allocation and performance tracking. Traditional manual PCI assessment methods are limited by labor intensity, subjectivity, and susceptibility to human error. Addressing these challenges, this paper presents a novel, end-to-end automated method for PCI calculation, integrating deep learning and image processing technologies. The first stage employs a deep learning algorithm for accurate detection of pavement cracks, followed by the application of a segmentation-based skeleton algorithm in image processing to estimate crack width precisely. This integrated approach enhances the assessment process, providing a more comprehensive evaluation of pavement integrity. The validation results demonstrate a 95% accuracy in crack detection and 90% accuracy in crack width estimation. Leveraging these results, the automated PCI rating is achieved, aligned with standards, showcasing significant improvements in the efficiency and reliability of PCI evaluations. This method offers advancements in pavement maintenance strategies and potential applications in broader road infrastructure management. [ABSTRACT FROM AUTHOR]

In recent years, the advancement of generative techniques, particularly generative adversarial networks (GANs), has opened new possibilities for generating synthetic biometric data from different modalities, including—among others—images of irises, fingerprints, or faces in different representations. This study presents the process of generating synthetic images of human irises, using the recent StyleGAN3 model. The novelty presented in this work consists in producing generated content in both Cartesian and polar coordinate representations, typically used in iris recognition pipelines, such as the foundational work proposed by John Daugman, but hitherto not used in generative AI experiments. The main objective of this study was to conduct a qualitative analysis of the synthetic samples and evaluate the iris texture density and suitability for meaningful feature extraction. During this study, a total of 1327 unique irises were generated, and experimental results carried out using the well-known OSIRIS open-source iris recognition software and the equivalent software, wordlcoin-openiris, newly published at the end of 2023 to prove that (1) no "identity leak" from the training set was observed, and (2) the generated irises had enough unique textural information to be successfully differentiated between both themselves and between them and real, authentic iris samples. The results of our research demonstrate the promising potential of synthetic iris data generation as a valuable tool for augmenting training datasets and improving the overall performance of iris recognition systems. By exploring the synthetic data in both Cartesian and polar representations, we aim to understand the benefits and limitations of each approach and their implications for biometric applications. The findings suggest that synthetic iris data can significantly contribute to the advancement of iris recognition technology, enhancing its accuracy and robustness in real-world scenarios by greatly augmenting the possibilities to gather large and diversified training datasets. [ABSTRACT FROM AUTHOR]

This research focuses on leveraging wavelet transform for fault classification within electrical power transmission networks. This study meticulously examines the influence of various parameters, such as fault resistance, fault inception angle, fault location, and other essential components, on the accuracy of fault classification. We endeavor to explore the interplay between classification accuracy and the input data while assessing the efficacy of combining wavelet analysis with deep learning methodologies. The data, sourced from network recorders, including phase currents and voltages, undergo a scaled continuous wavelet transform (S-CWT) to generate scalogram images. These images are subsequently utilized as inputs for pretrained deep learning models. The experiments encompass various fault scenarios, spanning distinct fault types, locations, times, and resistance values. A remarkable feature of the proposed work is the attainment of 100% classification accuracy, obviating the need for additional algorithmic enhancements. The foundation of this achievement is the deliberate selection of the right input. The decision to employ an identical number of samples as the number of scales for the CWT emerges as a pivotal factor. This approach underpins the high accuracy and renders supplementary algorithms superfluous. Furthermore, this research underscores the versatility of this approach, showcasing its effectiveness across diverse networks and scenarios. Wavelet transform, after rigorous experimentation, emerges as a reliable tool for capturing transient fault characteristics with an optimal balance between time and frequency resolutions. [ABSTRACT FROM AUTHOR]

The approach of using more than one processor to compute in order to overcome the complexity of different medical imaging methods that make up an overall job is known as GPU (graphic processing unit)-based parallel processing. It is extremely important for several medical imaging techniques such as image classification, object detection, image segmentation, registration, and content-based image retrieval, since the GPU-based parallel processing approach allows for time-efficient computation by a software, allowing multiple computations to be completed at once. On the other hand, a non-invasive imaging technology that may depict the shape of an anatomy and the biological advancements of the human body is known as magnetic resonance imaging (MRI). Implementing GPU-based parallel processing approaches in brain MRI analysis with medical imaging techniques might be helpful in achieving immediate and timely image capture. Therefore, this extended review (the extension of the IWBBIO2023 conference paper) offers a thorough overview of the literature with an emphasis on the expanding use of GPU-based parallel processing methods for the medical analysis of brain MRIs with the imaging techniques mentioned above, given the need for quicker computation to acquire early and real-time feedback in medicine. Between 2019 and 2023, we examined the articles in the literature matrix that include the tasks, techniques, MRI sequences, and processing results. As a result, the methods discussed in this review demonstrate the advancements achieved until now in minimizing computing runtime as well as the obstacles and problems still to be solved in the future. [ABSTRACT FROM AUTHOR]

The field of plant phenotype is used to analyze the shape and physiological characteristics of crops in multiple dimensions. Imaging, using non-destructive optical characteristics of plants, analyzes growth characteristics through spectral data. Among these, fluorescence imaging technology is a method of evaluating the physiological characteristics of crops by inducing plant excitation using a specific light source. Through this, we investigate how fluorescence imaging responds sensitively to environmental stress in garlic and can provide important information on future stress management. In this study, near UV LED (405 nm) was used to induce the fluorescence phenomenon of garlic, and fluorescence images were obtained to classify and evaluate crops exposed to abiotic environmental stress. Physiological characteristics related to environmental stress were developed from fluorescence sample images using the Chlorophyll ratio method, and classification performance was evaluated by developing a classification model based on partial least squares discrimination analysis from the image spectrum for stress identification. The environmental stress classification performance identified from the Chlorophyll ratio was 14.9% in F673/F717, 25.6% in F685/F730, and 0.209% in F690/F735. The spectrum-developed PLS-DA showed classification accuracy of 39.6%, 56.2% and 70.7% in Smoothing, MSV, and SNV, respectively. Spectrum pretreatment-based PLS-DA showed higher discrimination performance than the existing image-based Chlorophyll ratio. [ABSTRACT FROM AUTHOR]

The ubiquity of sensors in smart-homes facilitates the support of independent living for older adults and enables cognitive assessment. Notably, there has been a growing interest in utilizing movement traces for identifying signs of cognitive impairment in recent years. In this study, we introduce an innovative approach to identify abnormal indoor movement patterns that may signal cognitive decline. This is achieved through the non-intrusive integration of smart-home sensors, including passive infrared sensors and sensors embedded in everyday objects. The methodology involves visualizing user locomotion traces and discerning interactions with objects on a floor plan representation of the smart-home, and employing different image descriptor features designed for image analysis tasks and synthetic minority oversampling techniques to enhance the methodology. This approach distinguishes itself by its flexibility in effortlessly incorporating additional features through sensor data. A comprehensive analysis, conducted with a substantial dataset obtained from a real smart-home, involving 99 seniors, including those with cognitive diseases, reveals the effectiveness of the proposed functional prototype of the system architecture. The results validate the system's efficacy in accurately discerning the cognitive status of seniors, achieving a macro-averaged F1-score of 72.22% for the two targeted categories: cognitively healthy and people with dementia. Furthermore, through experimental comparison, our system demonstrates superior performance compared with state-of-the-art methods. [ABSTRACT FROM AUTHOR]

In this paper, we address the challenge of detecting small moving targets in dynamic environments characterized by the concurrent movement of both platform and sensor. In such cases, simple image-based frame registration and optical flow analysis cannot be used to detect moving targets. To tackle this, it is necessary to use sensor and platform meta-data in addition to image analysis for temporal and spatial anomaly detection. To this end, we investigate techniques that utilize inertial data to enhance frame-to-frame registration, consistently yielding improved detection outcomes when compared against purely feature-based techniques. For cases where image registration is not possible even with metadata, we propose single-frame spatial anomaly detection and then estimate the range to the target using the platform velocity. The behavior of the estimated range over time helps us to discern targets from clutter. Finally, we show that a KNN classifier can be used to further reduce the false alarm rate without a significant reduction in detection performance. The proposed strategies offer a robust solution for the detection of moving targets in dynamically challenging settings. [ABSTRACT FROM AUTHOR]

Defect detection on rail lines is essential for ensuring safe and efficient transportation. Current image analysis methods with deep neural networks (DNNs) for defect detection often focus on the defects themselves while ignoring the related context. In this work, we propose a fusion model that combines both a targeted defect search and a context analysis, which is seen as a multimodal fusion task. Our model performs rule-based decision-level fusion, merging the confidence scores of multiple individual models to classify rail-line defects. We call the model "hybrid" in the sense that it is composed of supervised learning components and rule-based fusion. We first propose an improvement to existing vision-based defect detection methods by incorporating a convolutional block attention module (CBAM) in the you only look once (YOLO) versions 5 (YOLOv5) and 8 (YOLOv8) architectures for the detection of defects and contextual image elements. This attention module is applied at different detection scales. The domain-knowledge rules are applied to fuse the detection results. Our method demonstrates improvements over baseline models in vision-based defect detection. The model is open for the integration of modalities other than an image, e.g., sound and accelerometer data. [ABSTRACT FROM AUTHOR]

Based on the well-known role of peritumour characterization in cancer imaging to improve the early diagnosis and timeliness of clinical decisions, this study innovated a state-of-the-art approach for peritumour analysis, mainly relying on extending tumour segmentation by a predefined fixed size. We present a novel, adaptive method to investigate the zone of transition, bestriding tumour and peritumour, thought of as an annular-like shaped area, and detected by analysing gradient variations along tumour edges. For method validation, we applied it on two datasets (hepatocellular carcinoma and locally advanced rectal cancer) imaged by different modalities and exploited the zone of transition regions as well as the peritumour ones derived by adopting the literature approach for building predictive models. To measure the zone of transition's benefits, we compared the predictivity of models relying on both "standard" and novel peritumour regions. The main comparison metrics were informedness, specificity and sensitivity. As regards hepatocellular carcinoma, having circular and regular shape, all models showed similar performance (informedness = 0.69, sensitivity = 84%, specificity = 85%). As regards locally advanced rectal cancer, with jagged contours, the zone of transition led to the best informedness of 0.68 (sensitivity = 89%, specificity = 79%). The zone of transition advantages include detecting the peritumour adaptively, even when not visually noticeable, and minimizing the risk (higher in the literature approach) of including adjacent diverse structures, which was clearly highlighted during image gradient analysis. [ABSTRACT FROM AUTHOR]

A spectral image analysis has the potential to replace traditional approaches for assessing plant responses to different types of stresses, including herbicides, through non-destructive and high-throughput screening (HTS). Therefore, this study was conducted to develop a rapid bioassay method using a multi-well plate and spectral image analysis for the diagnosis of herbicide activity and modes of action. Crabgrass (Digitaria ciliaris), as a model weed, was cultivated in multi-well plates and subsequently treated with six herbicides (paraquat, tiafenacil, penoxsulam, isoxaflutole, glufosinate, and glyphosate) with different modes of action when the crabgrass reached the 1-leaf stage, using only a quarter of the recommended dose. To detect the plant's response to herbicides, plant spectral images were acquired after herbicide treatment using RGB, infrared (IR) thermal, and chlorophyll fluorescence (CF) sensors and analyzed for diagnosing herbicide efficacy and modes of action. A principal component analysis (PCA), using all spectral data, successfully distinguished herbicides and clustered depending on their modes of action. The performed experiments showed that the multi-well plate assay combined with a spectral image analysis can be successfully applied for herbicide bioassays. In addition, the use of spectral image sensors, especially CF images, would facilitate HTS by enabling the rapid observation of herbicide responses at as early as 3 h after herbicide treatment. [ABSTRACT FROM AUTHOR]

The term out-of-stock (OOS) describes a problem that occurs when shoppers come to a store and the product they are seeking is not present on its designated shelf. Missing products generate huge sales losses and may lead to a declining reputation or the loss of loyal customers. In this paper, we propose a novel deep-learning (DL)-based OOS-detection method that utilizes a two-stage training process and a post-processing technique designed for the removal of inaccurate detections. To develop the method, we utilized an OOS detection dataset that contains a commonly used fully empty OOS class and a novel class that represents the frontal OOS. We present a new image augmentation procedure in which some existing OOS instances are enlarged by duplicating and mirroring themselves over nearby products. An object-detection model is first pre-trained using only augmented shelf images and, then, fine-tuned on the original data. During the inference, the detected OOS instances are post-processed based on their aspect ratio. In particular, the detected instances are discarded if their aspect ratio is higher than the maximum or lower than the minimum instance aspect ratio found in the dataset. The experimental results showed that the proposed method outperforms the existing DL-based OOS-detection methods and detects fully empty and frontal OOS instances with 86.3% and 83.7% of the average precision, respectively. [ABSTRACT FROM AUTHOR]

The digital image method of monitoring structural displacement is receiving more attention today, especially in non-contact structure health monitoring. Some obvious advantages of this method, such as economy and convenience, were shown while it was used to monitor the deformation of the bridge structure during the service period. The image processing technology was used to extract structural deformation feature information from surveillance video images containing structural displacement in order to realize a new non-contact online monitoring method in this paper. The influence of different imaging distances and angles on the conversion coefficient (η) that converts the pixel coordinates to the actual displacement was first studied experimentally. Then, the measuring and tracking of bridge structural displacement based on surveillance video images was investigated by laboratory-scale experiments under idealized conditions. The results showed that the video imaging accuracy can be affected by changes in the relative position of the imaging device and measured structure, which is embodied in the change in η (actual size of individual pixel) on the structured image. The increase in distance between the measured structure and the monitoring equipment will have a significant effect on the change in the η value. The value of η varies linearly with the change in shooting distance. The value of η will be affected by the changes in shooting angle. The millimeter-level online monitoring of the structure displacement can be realized using images based on surveillance video images. The feasibility of measuring and tracking structural displacement based on surveillance video images was confirmed by a laboratory-scale experiment. [ABSTRACT FROM AUTHOR]

The popularity and demand for high-quality date palm fruits (Phoenix dactylifera L.) have been growing, and their quality largely depends on the type of handling, storage, and processing methods. The current methods of geometric evaluation and classification of date palm fruits are characterised by high labour intensity and are usually performed mechanically, which may cause additional damage and reduce the quality and value of the product. Therefore, non-contact methods are being sought based on image analysis, with digital solutions controlling the evaluation and classification processes. The main objective of this paper is to develop an automatic classification model for varieties of date palm fruits using a convolutional neural network (CNN) based on two fundamental criteria, i.e., colour difference and evaluation of geometric parameters of dates. A CNN with a fixed architecture was built, marked as DateNET, consisting of a system of five alternating Conv2D, MaxPooling2D, and Dropout classes. The validation accuracy of the model presented in this study depended on the selection of classification criteria. It was 85.24% for fruit colour-based classification and 87.62% for the geometric parameters only; however, it increased considerably to 93.41% when both the colour and geometry of dates were considered. [ABSTRACT FROM AUTHOR]

Medical image analysis forms the basis of image-guided surgery (IGS) and many of its fundamental tasks. Driven by the growing number of medical imaging modalities, the research community of medical imaging has developed methods and achieved functionality breakthroughs. However, with the overwhelming pool of information in the literature, it has become increasingly challenging for researchers to extract context-relevant information for specific applications, especially when many widely used methods exist in a variety of versions optimized for their respective application domains. By being further equipped with sophisticated three-dimensional (3D) medical image visualization and digital reality technology, medical experts could enhance their performance capabilities in IGS by multiple folds. The goal of this narrative review is to organize the key components of IGS in the aspects of medical image processing and visualization with a new perspective and insights. The literature search was conducted using mainstream academic search engines with a combination of keywords relevant to the field up until mid-2022. This survey systemically summarizes the basic, mainstream, and state-of-the-art medical image processing methods as well as how visualization technology like augmented/mixed/virtual reality (AR/MR/VR) are enhancing performance in IGS. Further, we hope that this survey will shed some light on the future of IGS in the face of challenges and opportunities for the research directions of medical image processing and visualization. [ABSTRACT FROM AUTHOR]

This paper proposes an analytical design procedure for 2D FIR circular filter banks and also a novel, computationally efficient implementation of the designed filter bank based on a polyphase structure and a block filtering approach. The component filters of the bank are designed in the frequency domain using a specific frequency transformation applied to a low-pass, band-pass and high-pass 1D prototype with a specified Gaussian shape and imposed specifications (peak frequency, bandwidth). The 1D prototype filter frequency response is derived in a closed form as a trigonometric polynomial with a specified order using Fourier series, and then it is factored. Since the design starts from a 1D prototype with a factored transfer function, the frequency response of the designed 2D filter bank components also results directly in a factored form. The designed filters have an accurate shape, with negligible distortions at a relatively low order. We present the design of two types of circular filter banks: uniform and non-uniform (dyadic). An example of image analysis with the uniform filter bank is also provided, showing that the original image can be accurately reconstructed from the sub-band images. The proposed implementation is presented for a simpler case, namely for a smaller size of the filter kernel and of the input image. Using the polyphase and block filtering approach, a convenient implementation at the system level is obtained for the designed 2D FIR filter, with a relatively low computational complexity. [ABSTRACT FROM AUTHOR]

In the realm of modern medicine, medical imaging stands as an irreplaceable pillar for accurate diagnostics. The significance of precise segmentation in medical images cannot be overstated, especially considering the variability introduced by different practitioners. With the escalating volume of medical imaging data, the demand for automated and efficient segmentation methods has become imperative. This study introduces an innovative approach to heart image segmentation, embedding a multi-scale feature and attention mechanism within an inverted pyramid framework. Recognizing the intricacies of extracting contextual information from low-resolution medical images, our method adopts an inverted pyramid architecture. Through training with multi-scale images and integrating prediction outcomes, we enhance the network's contextual understanding. Acknowledging the consistent patterns in the relative positions of organs, we introduce an attention module enriched with positional encoding information. This module empowers the network to capture essential positional cues, thereby elevating segmentation accuracy. Our research resides at the intersection of medical imaging and sensor technology, emphasizing the foundational role of sensors in medical image analysis. The integration of sensor-generated data showcases the symbiotic relationship between sensor technology and advanced machine learning techniques. Evaluation on two heart datasets substantiates the superior performance of our approach. Metrics such as the Dice coefficient, Jaccard coefficient, recall, and F-measure demonstrate the method's efficacy compared to state-of-the-art techniques. In conclusion, our proposed heart image segmentation method addresses the challenges posed by diverse medical images, offering a promising solution for efficiently processing 2D/3D sensor data in contemporary medical imaging. [ABSTRACT FROM AUTHOR]

The quality assurance of bulk medicinal materials, crucial for botanical drug production, necessitates advanced analytical methods. Conventional techniques, including high-performance liquid chromatography, require extensive pre-processing and rely on extensive solvent use, presenting both environmental and safety concerns. Accordingly, a non-destructive, expedited approach for assessing both the chemical and physical attributes of these materials is imperative for streamlined manufacturing. We introduce an innovative method, designated as Squeeze-and-Excitation Residual Network Combined Hyperspectral Image Analysis (SE-ReHIA), for the swift and non-invasive assessment of the chemical makeup of bulk medicinal substances. In a demonstrative application, hyperspectral imaging in the 389–1020 nm range was employed in 187 batches of Salvia miltiorrhiza. Notable constituents such as salvianolic acid B, dihydrotanshinone I, cryptotanshinone, tanshinone IIA, and moisture were quantified. The SE-ReHIA model, incorporating convolutional layers, maxpooling layers, squeeze-and-excitation residual blocks, and fully connected layers, exhibited R c 2 values of 0.981, 0.980, 0.975, 0.972, and 0.970 for the aforementioned compounds and moisture. Furthermore, R p 2 values were ascertained to be 0.975, 0.943, 0.962, 0.957, and 0.930, respectively, signifying the model's commendable predictive competence. This study marks the inaugural application of SE-ReHIA for Salvia miltiorrhiza's chemical profiling, offering a method that is rapid, eco-friendly, and non-invasive. Such advancements can fortify consistency across botanical drug batches, underpinning product reliability. The broader applicability of the SE-ReHIA technique in the quality assurance of bulk medicinal entities is anticipated with optimism. [ABSTRACT FROM AUTHOR]

Typically, the quality of the bitumen adhesion in asphalt mixtures is assessed manually by a group of experts who assign subjective ratings to the thickness of the residual bitumen coating on the gravel samples. To automate this process, we propose a hardware and software system for visual assessment of bituminous coating quality, which provides the results both in the form of a discrete estimate compatible with the expert one, and in a more general percentage for a set of samples. The developed methodology ensures static conditions of image capturing, insensitive to external circumstances. This is achieved by using a hardware construction designed to provide capturing the samples at eight different illumination angles. As a result, a generalized image is obtained, in which the effect of highlights and shadows is eliminated. After preprocessing, each gravel sample independently undergoes surface semantic segmentation procedure. Two most relevant approaches of semantic image segmentation were considered: gradient boosting and U-Net architecture. These approaches were compared by both stone surface segmentation accuracy, where they showed the same 77% result and the effectiveness in determining a discrete estimate. Gradient boosting showed an accuracy 2% higher than the U-Net for it and was thereby chosen as the main model when developing the prototype. According to the test results, the evaluation of the algorithm in 75% of cases completely coincided with the expert one, and it had a slight deviation from it in another 22% of cases. The developed solution allows for standardizing the data obtained and contributes to the creation of an interlaboratory digital research database. [ABSTRACT FROM AUTHOR]

Image anomaly detection is a trending research topic in computer vision. The objective is to build models using available normal samples to detect various abnormal images without depending on real abnormal samples. It has high research significance and value for applications in the detection of defects in product appearance, medical image analysis, hyperspectral image processing, and other fields. This paper proposes an image anomaly detection algorithm based on feature distillation and an autoencoder structure, which uses the feature distillation structure of a dual-teacher network to train the encoder, thus suppressing the reconstruction of abnormal regions. This system also introduces an attention mechanism to highlight the detection objects, achieving effective detection of different defects in product appearance. In addition, this paper proposes a method for anomaly evaluation based on patch similarity that calculates the difference between the reconstructed image and the input image according to different regions of the image, thus improving the sensitivity and accuracy of the anomaly score. This paper conducts experiments on several datasets, and the results show that the proposed algorithm has superior performance in image anomaly detection. It achieves 98.8% average AUC on the SMDC-DET dataset and 98.9% average AUC on the MVTec-AD dataset. [ABSTRACT FROM AUTHOR]

Accurate segmentation of retinal vessels is an essential prerequisite for the subsequent analysis of fundus images. Recently, a number of methods based on deep learning have been proposed and shown to demonstrate promising segmentation performance, especially U-Net and its variants. However, tiny vessels and low-contrast vessels are hard to detect due to the issues of a loss of spatial details caused by consecutive down-sample operations and inadequate fusion of multi-level features caused by vanilla skip connections. To address these issues and enhance the segmentation precision of retinal vessels, we propose a novel high-resolution network with strip attention. Instead of the U-Net-shaped architecture, the proposed network follows an HRNet-shaped architecture as the basic network, learning high-resolution representations throughout the training process. In addition, a strip attention module including a horizontal attention mechanism and a vertical attention mechanism is designed to obtain long-range dependencies in the horizontal and vertical directions by calculating the similarity between each pixel and all pixels in the same row and the same column, respectively. For effective multi-layer feature fusion, we incorporate the strip attention module into the basic network to dynamically guide adjacent hierarchical features. Experimental results on the DRIVE and STARE datasets show that the proposed method can extract more tiny vessels and low-contrast vessels compared with existing mainstream methods, achieving accuracies of 96.16% and 97.08% and sensitivities of 82.68% and 89.36%, respectively. The proposed method has the potential to aid in the analysis of fundus images. [ABSTRACT FROM AUTHOR]

Molecular tests for infectious diseases and genetic anomalies, which account for significant global morbidity and mortality, are central to nucleic acid analysis. In this study, we present a digital droplet LAMP (ddLAMP) platform that offers a cost-effective and portable solution for such assays. Our approach integrates disposable 3D-printed droplet generator chips with a consumer smartphone equipped with a custom image analysis application for conducting ddLAMP assays, thereby eliminating the necessity for expensive and complicated photolithographic techniques, optical microscopes, or flow cytometers. Our 3D printing technique for microfluidic chips facilitates rapid chip fabrication in under 2 h, without the complications of photolithography or chip bonding. The platform's heating mechanism incorporates low-powered miniature heating blocks with dual resistive cartridges, ensuring rapid and accurate temperature modulation in a compact form. Instrumentation is further simplified by integrating miniaturized magnification and fluorescence optics with a smartphone camera. The fluorescence quantification benefits from our previously established RGB to CIE-xyY transformation, enhancing signal dynamic range. Performance assessment of our ddLAMP system revealed a limit of detection at 10 copies/μL, spanning a dynamic range up to 104 copies/μL. Notably, experimentally determined values of the fraction of positive droplets for varying DNA concentrations aligned with the anticipated exponential trend per Poisson statistics. Our holistic ddLAMP platform, inclusive of chip production, heating, and smartphone-based droplet evaluation, provides a refined method compatible with standard laboratory environments, alleviating the challenges of traditional photolithographic methods and intricate droplet microfluidics expertise. [ABSTRACT FROM AUTHOR]

Computer vision and deep learning have the potential to improve medical artificial intelligence (AI) by assisting in diagnosis, prediction, and prognosis. However, the application of deep learning to medical image analysis is challenging due to limited data availability and imbalanced data. While model performance is undoubtedly essential for medical image analysis, model trust is equally important. To address these challenges, we propose TRUDLMIA, a trustworthy deep learning framework for medical image analysis, which leverages image features learned through self-supervised learning and utilizes a novel surrogate loss function to build trustworthy models with optimal performance. The framework is validated on three benchmark data sets for detecting pneumonia, COVID-19, and melanoma, and the created models prove to be highly competitive, even outperforming those designed specifically for the tasks. Furthermore, we conduct ablation studies, cross-validation, and result visualization and demonstrate the contribution of proposed modules to both model performance (up to 21 % ) and model trust (up to 5 % ). We expect that the proposed framework will support researchers and clinicians in advancing the use of deep learning for dealing with public health crises, improving patient outcomes, increasing diagnostic accuracy, and enhancing the overall quality of healthcare delivery. [ABSTRACT FROM AUTHOR]