Search

Abstract Purpose Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms’ nutrient source. Mold not only can damage papers’ structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation.

Abstract Background In low-middle income countries, healthcare providers primarily use paper health records for capturing data. Paper health records are utilized predominately due to the prohibitive cost of acquisition and maintenance of automated data capture devices and electronic medical records. Data recorded on paper health records is not easily accessible in a digital format to healthcare providers. The lack of real time accessible digital data limits healthcare providers, researchers, and quality improvement champions to leverage data to improve patient outcomes. In this project, we demonstrate the novel use of computer vision software to digitize handwritten intraoperative data elements from smartphone photographs of paper anesthesia charts from the University Teaching Hospital of Kigali. We specifically report our approach to digitize checkbox data, symbol-denoted systolic and diastolic blood pressure, and physiological data. Methods We implemented approaches for removing perspective distortions from smartphone photographs, removing shadows, and improving image readability through morphological operations. YOLOv8 models were used to deconstruct the anesthesia paper chart into specific data sections. Handwritten blood pressure symbols and physiological data were identified, and values were assigned using deep neural networks. Our work builds upon the contributions of previous research by improving upon their methods, updating the deep learning models to newer architectures, as well as consolidating them into a single piece of software. Results The model for extracting the sections of the anesthesia paper chart achieved an average box precision of 0.99, an average box recall of 0.99, and an mAP0.5-95 of 0.97. Our software digitizes checkbox data with greater than 99% accuracy and digitizes blood pressure data with a mean average error of 1.0 and 1.36 mmHg for systolic and diastolic blood pressure respectively. Overall accuracy for physiological data which includes oxygen saturation, inspired oxygen concentration and end tidal carbon dioxide concentration was 85.2%. Conclusions We demonstrate that under normal photography conditions we can digitize checkbox, blood pressure and physiological data to within human accuracy when provided legible handwriting. Our contributions provide improved access to digital data to healthcare practitioners in low-middle income countries.

One of the most popular and well-established forms of payment in use today is paper money. Handling paper money might be challenging for those with vision impairments. Assistive technology has been reinventing itself throughout time to better serve the elderly and disabled people. To detect paper currency and extract other useful information from them, image processing techniques and other advanced technologies, such as Artificial Intelligence, Deep Learning, etc., can be used. In this paper, we present a meticulously curated and comprehensive dataset named ‘NSTU-BDTAKA’ tailored for the simultaneous detection and recognition of a specific object of cultural significance - the Bangladeshi paper currency (in Bengali it is called ‘Taka’). This research aims to facilitate the development and evaluation of models for both taka detection and recognition tasks, offering a rich resource for researchers and practitioners alike. The dataset is divided into two distinct components: (i) taka detection, and (ii) taka recognition. The taka detection subset comprises 3,111 high-resolution images, each meticulously annotated with rectangular bounding boxes that encompass instances of the taka. These annotations serve as ground truth for training and validating object detection models, and we adopt the state-of-the-art YOLOv5 architecture for this purpose. In the taka recognition subset, the dataset has been extended to include a vast collection of 28,875 images, each showcasing various instances of the taka captured in diverse contexts and environments. The recognition dataset is designed to address the nuanced task of taka recognition providing researchers with a comprehensive set of images to train, validate, and test recognition models. This subset encompasses challenges such as variations in lighting, scale, orientation, and occlusion, further enhancing the robustness of developed recognition algorithms. The dataset NSTU-BDTAKA not only serves as a benchmark for taka detection and recognition but also fosters advancements in object detection and recognition methods that can be extrapolated to other cultural artifacts and objects. We envision that the dataset will catalyze research efforts in the field of computer vision, enabling the development of more accurate, robust, and efficient models for both detection and recognition tasks.

Abstract Due to migration, terror‐threats and the viral pandemic, various EU member states have re‐established internal border control or even closed their borders. European Association for Biometrics (EAB), a non‐profit organisation, solicited the views of its members on ways which biometric technologies and services may be used to help with re‐establishing open borders within the Schengen area while at the same time mitigating any adverse effects. From the responses received, this position paper was composed to identify ideas to re‐establish free travel between the member states in the Schengen area. The paper covers the contending needs for security, open borders and fundamental rights as well as legal constraints that any technological solution must consider. A range of specific technologies for direct biometric recognition alongside complementary measures are outlined. The interrelated issues of ethical and societal considerations are also highlighted. Provided a holistic approach is adopted, it may be possible to reach a more optimal trade‐off with regards to open borders while maintaining a high‐level of security and protection of fundamental rights. European Association for Biometrics and its members can play an important role in fostering a shared understanding of security and mobility challenges and their solutions.

Quality assessment in industrial applications is often carried out through visual inspection, usually performed or supported by human domain experts. However, the manual visual inspection of processes and products is error-prone and expensive. It is therefore not surprising that the automation of visual inspection in manufacturing and maintenance is heavily researched and discussed. The use of artificial intelligence as an approach to visual inspection in industrial applications has been considered for decades. Recent successes, driven by advances in deep learning, present a possible paradigm shift and have the potential to facilitate automated visual inspection, even under complex environmental conditions. For this reason, we explore the question of to what extent deep learning is already being used in the field of automated visual inspection and which potential improvements to the state of the art could be realized utilizing concepts from academic research. By conducting an extensive review of the openly accessible literature, we provide an overview of proposed and in-use deep-learning models presented in recent years. Our survey consists of 196 open-access publications, of which 31.7% are manufacturing use cases and 68.3% are maintenance use cases. Furthermore, the survey also shows that the majority of the models currently in use are based on convolutional neural networks, the current de facto standard for image classification, object recognition, or object segmentation tasks. Nevertheless, we see the emergence of vision transformer models that seem to outperform convolutional neural networks but require more resources, which also opens up new research opportunities for the future. Another finding is that in 97% of the publications, the authors use supervised learning techniques to train their models. However, with the median dataset size consisting of 2500 samples, deep-learning models cannot be trained from scratch, so it would be beneficial to use other training paradigms, such as self-supervised learning. In addition, we identified a gap of approximately three years between approaches from deep-learning-based computer vision being published and their introduction in industrial visual inspection applications. Based on our findings, we additionally discuss potential future developments in the area of automated visual inspection.

The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future. [ABSTRACT FROM AUTHOR]

Various techniques were combined to optimize an optical inspection system designed to automatically inspect defects in manufactured paper bowls. A self-assembled system was utilized to capture images of defects on the bowls. The system employed an image sensor with a multi-pixel array that combined a complementary metal-oxide semiconductor and a photo detector. A combined ring light served as the light source, while an infrared (IR) LED matrix panel was used to provide constant IR light to highlight the outer edges of the objects being inspected. The techniques employed in this study to enhance defect inspections on produced paper bowls included Gaussian filtering, Sobel operators, binarization, and connected components. Captured images were processed using these technologies. Once the non-contact inspection system's machine vision method was completed, defects on the produced paper bowls were inspected using the system developed in this study. Three inspection methods were used in this study: internal inspection, external inspection, and bottom inspection. All three methods were able to inspect surface features of produced paper bowls, including dirt, burrs, holes, and uneven thickness. The results of our study showed that the average time required for machine vision inspections of each paper bowl was significantly less than the time required for manual inspection. Therefore, the investigated machine vision system is an efficient method for inspecting defects in fabricated paper bowls. [ABSTRACT FROM AUTHOR]

In this paper, the paper cups were used as the research objects, and the machine vision detection technology was combined with different image processing techniques to investigate a non-contact optical automatic detection system to identify the defects of the manufactured paper cups. The combined ring light was used as the light source, an infrared (IR) LED matrix panel was used to provide the IR light to constantly highlight the outer edges of the detected objects, and a multi-grid pixel array was used as the image sensor. The image processing techniques, including the Gaussian filter, Sobel operator, Binarization process, and connected component, were used to enhance the inspection and recognition of the defects existing in the produced paper cups. There were three different detection processes for paper cups, which were divided into internal, external, and bottom image acquisition processes. The present study demonstrated that all the detection processes could clearly detect the surface defect features of the manufactured paper cups, such as dirt, burrs, holes, and uneven thickness. Our study also revealed that the average time for the investigated Automatic Optical Detection to detect the defects on the paper cups was only 0.3 s. [ABSTRACT FROM AUTHOR]

Due to migration, terror‐threats and the viral pandemic, various EU member states have re‐established internal border control or even closed their borders. European Association for Biometrics (EAB), a non‐profit organisation, solicited the views of its members on ways which biometric technologies and services may be used to help with re‐establishing open borders within the Schengen area while at the same time mitigating any adverse effects. From the responses received, this position paper was composed to identify ideas to re‐establish free travel between the member states in the Schengen area. The paper covers the contending needs for security, open borders and fundamental rights as well as legal constraints that any technological solution must consider. A range of specific technologies for direct biometric recognition alongside complementary measures are outlined. The interrelated issues of ethical and societal considerations are also highlighted. Provided a holistic approach is adopted, it may be possible to reach a more optimal trade‐off with regards to open borders while maintaining a high‐level of security and protection of fundamental rights. European Association for Biometrics and its members can play an important role in fostering a shared understanding of security and mobility challenges and their solutions. [ABSTRACT FROM AUTHOR]

Document classification is an important area in Natural Language Processing (NLP). Because a huge amount of scientific papers have been published at an accelerating rate, it is beneficial to carry out intelligent paper classifications, especially fine-grained classification for researchers. However, a public scientific paper dataset for fine-grained classification is still lacking, so the existing document classification methods have not been put to the test. To fill this vacancy, we designed and collected the PaperNet-Dataset that consists of multi-modal data (texts and figures). PaperNet 1.0 version contains hierarchical categories of papers in the fields of computer vision (CV) and NLP, 2 coarse-grained and 20 fine-grained (7 in CV and 13 in NLP). We ran current mainstream models on the PaperNet-Dataset, along with a multi-modal method that we propose. Interestingly, none of these methods reaches an accuracy of 80% in fine-grained classification, showing plenty of room for improvement. We hope that PaperNet-Dataset will inspire more work in this challenging area. [ABSTRACT FROM AUTHOR]

We develop a vision system for batch inspection by oven white paper model color by manufacturing a machine vision system for the oven manufacturing automation process. In the vision system, white paper object detection (spring), color clustering, and histogram extraction are performed. In addition, for the automated process of home appliances, we intend to develop an automatic mold combination detection algorithm that inspects the label position and direction (angle/coordinate) using deep learning. [ABSTRACT FROM AUTHOR]

Detecting plagiarism in academic papers is crucial for maintaining academic integrity, preserving the originality of published work, and safeguarding intellectual property. While existing applications excel at text plagiarism detection, they fall short when it comes to image plagiarism. This paper introduces a novel algorithm, named "VIBRANT-WALK," designed to detect image plagiarism in academic manuscripts. The challenge of identifying plagiarized images is formidable, requiring a unique approach. Traditional Computer Vision algorithms, proficient in image similarity tasks, face limitations in determining whether an image has been previously used in an article. To address this, the proposed algorithm leverages a repository of all published article pages, focusing on absolute identicality rather than image similarity. The algorithm comprises two stages. In the first stage, a "Vibrancy Matrix" is created through image preprocessing, aiding in contour determination. The second stage involves pixel-by-pixel comparison with images from published manuscripts. To enhance efficiency, the algorithm initiates comparisons from the pixel with the highest score in the Vibrancy Matrix, followed by pixel comparisons through random walks, significantly reducing complexity. To conduct the study, a custom dataset was compiled from 69 research articles, capturing snapshots of each page and figure. Overall, we present 485 unique test cases where we can test the accuracy and efficiency of the algorithm. The lack of publicly available datasets necessitated this approach. The proposed algorithm outperformed the existing models and algorithms in this field by achieving an overall accuracy of 94.8% on the collated dataset, identifying 460 instances of plagiarism out of the 485 test cases. The algorithm also demonstrated a 100% accuracy rate in avoiding false positives. [ABSTRACT FROM AUTHOR]

The authors present a comprehensive overview of image processing and analysis work done to support research into the model flowering plant Arabidopsis thaliana. Beside the plant's importance in biological research, using image analysis to obtain experimental measurements of it is an interesting vision problem in its own right, involving the segmentation and analysis of sequences of images of objects whose shape varies between individual specimens and also changes over time. While useful measurements can be obtained by segmenting a whole plant from the background, they suggest that the increased range and precision of measurements made available by leaf‐level segmentation makes this a problem well worth solving. A variety of approaches have been tried by biologists as well as computer vision researchers. This is an interdisciplinary area and the computer vision community has an important contribution to make. They suggest that there is a need for publicly available datasets with ground truth annotations to enable the evaluation of new approaches and to support the building of training data for modern data‐driven computer vision approaches, which are those most likely to result in the kind of fully automated systems that will be of use to biologists.

Abstract: This article explores the application of image processing techniques in recyclable waste paper sorting. In recycling, waste papers are segregated into various grades as they are subjected to different recycling processes. Highly sorted paper streams facilitate high quality end products and save processing chemicals and energy. From 1932 to 2009, different mechanical and optical paper sorting methods have been developed to fill the paper sorting demand. Still, in many countries including Malaysia, waste papers are sorted into different grades using a manual sorting system. Because of inadequate throughput and some major drawbacks of mechanical paper sorting systems, the popularity of optical paper sorting systems has increased. Automated paper sorting systems offer significant advantages over human inspection in terms of worker fatigue, throughput, speed, and accuracy. This research attempts to develop a smart vision sensing system that is able to separate the different grades of paper using first-order features. To construct a template database, a statistical approach with intra-class and inter-class variation techniques are applied to the feature selection process. Finally, the K-nearest neighbor (KNN) algorithm is applied for paper object grade identification. The remarkable achievement obtained with the method is the accurate identification and dynamic sorting of all grades of papers using simple image processing techniques. [Copyright &y& Elsevier]

The Internet of Things (IoT), projected to exceed 30 billion active device connections globally by 2025, presents an expansive attack surface. The frequent collection and dissemination of confidential data on these devices exposes them to significant security risks, including user information theft and denial-of-service attacks. This paper introduces a smart, network-based Intrusion Detection System (IDS) designed to protect IoT networks from distributed denial-of-service attacks. Our methodology involves generating synthetic images from flow-level traffic data of the Bot-IoT and the LATAM-DDoS-IoT datasets and conducting experiments within both supervised and self-supervised learning paradigms. Self-supervised learning is identified in the state of the art as a promising solution to replace the need for massive amounts of manually labeled data, as well as providing robust generalization. Our results showcase that self-supervised learning surpassed supervised learning in terms of classification performance for certain tests. Specifically, it exceeded the F1 score of supervised learning for attack detection by 4.83% and by 14.61% in accuracy for the multiclass task of protocol classification. Drawing from extensive ablation studies presented in our research, we recommend an optimal training framework for upcoming contrastive learning experiments that emphasize visual representations in the cybersecurity realm. This training approach has enabled us to highlight the broader applicability of self-supervised learning, which, in some instances, outperformed supervised learning transferability by over 5% in precision and nearly 1% in F1 score. [ABSTRACT FROM AUTHOR]

This document is a guest editorial from the journal IET Computer Vision, discussing the topic of advanced image restoration and enhancement. The editorial highlights the challenges faced in this field, such as the complexity of degradation models for real-world low-quality images and the difficulty of acquiring paired data. It also introduces a special issue of the journal that includes five accepted papers, which focus on video reconstruction and image super-resolution. The editorial concludes by providing brief summaries of each accepted paper. The guest editors of the special issue are also mentioned, along with their research interests and affiliations. [Extracted from the article]

Accurate identification of structural displacements is important for structural state assessment and performance evaluation. This paper proposes a real-time structural displacement detection model based on computer vision and deep learning. The model consists of three stages: identification, tracking, and displacement resolution. First, the displacement target is identified and tracked by the improved YOLO v7 algorithm and the improved DeepSORT algorithm. Then, the Euclidean distance method based on inverse perspective mapping (IPM-ED) is proposed for the analytical conversion of the displacement. Next, the accuracy and effectiveness of this displacement detection model are evaluated through four groups of bamboo axial compression tests. A comparative analysis is conducted between the IPM-ED displacement analysis method and the commonly used ED displacement analysis method. Finally, the robustness of this method is tested by using a cable breakage test of a cable dome structure as an application case. The research results demonstrate that the maximum average error of the four groups of bamboo displacement tests is only 3.10 mm, and the maximum relative error of peak displacement is only 6.54 mm. The RMSE basically stays around 3.5 mm. The maximum displacement error in the application case is only 4.91 mm, with a maximum MAPE of 4.94%. In addition, the error percentage under the IPM-ED algorithm is basically within 5%, while the error percentage of the ED algorithm is more than 10%. The method in this paper achieves efficient and intelligent identification of structural displacements in a non-contact manner. The proposed method is suitable for environments where the contact displacement sensor is easily affected by vibration, the site is complex and requires additional displacement sensor fixing equipment, the displacement sensor with super-high structure is unsafe to deploy, and the contact displacement sensor in narrow space is inconvenient to deploy, so it has broad application prospects. [ABSTRACT FROM AUTHOR]

Abstract: Image acquisition has great influence on the performance of any computer vision application. Different methods can be utilized to acquire the digital image of a paper, whilst scanning scheme is among the most attractive methods. This attractiveness is because of the fewer types of potential deformations and the low cost of the scanning devices, e.g. flatbed scanners. However, paper is commonly placed imperfectly on the scanner. This slight rotation is not usually based on a pivot around the paper''s geometrical center (the well known regular rotation) but instead it is based on a pivot placed at the corner of the paper. Thus, the result is a digital image that is deformed with an “irregular rotation”. The characteristic of this deformation phenomenon is currently unknown to computer vision scientists. In this paper we provide an extensive investigation of this deformation. In addition, a new set of equations that sway and measure the transformation is proposed. Our investigation leads to the conclusion that the “irregular rotation” phenomenon produces a shear transformation. Furthermore, the experimental results confirm the theoretical findings. [Copyright &y& Elsevier]

The fourth paper which is about "Emotional AI and Crime" takes the argument into the key area of how good or bad are AI techniques that are designed for facial and related recognition. To an extent, the focus on AI is wider than what might find in any discussion of AI in the narrower technical field for context is all important to see urban AI in context. Artificial intelligence (AI) emerged alongside the development of the digital computer more than 80 years ago during the second world war. [Extracted from the article]

This paper describes global research in the field of augmented reality (22078) as indexed in Scopus database during 1992-2019, using a series of bibliometric indicators. The augmented reality (AR) research registered high 54.23% growth, averaged citation impact of 8.90 citations per paper. Nearly 1% of global output in the subject (226 papers) registered high-end citations (100+) per paper. The top 15 countries accounted for 87.05% of global publications output in the subject. The USA is in leadership position for its highest publications productivity (19.25% global share). The U.K. leads the world on relative citation index (2.05). International collaboration has been a major driver of AR research pursuits; between 11.89% and 44.04% of national share of top 15 countries in AR research appeared as international collaborative publications. AR research productivity by application types was the largest across sectors, such as education, industry and medical. Computer science has emerged as the most popular areas in AR research pursuits. Technical University of Munich, Germany and Osaka University, Japan have been the most productive organizations and Nara Institute of S&T, Japan (66.55 and 7.48) and Imperial College, London, U.K. (57.14 and 6.42) have been the most impactful organizations. M. Billinghurst and N. Navab have been the most productive authors and S. Feiner and B. MacIntyre have been the most impactful authors. IEEE Transactions on Visualization & Computer Graphics, Multimedia Tools & Applications and Virtual Reality topped the list of most productive journals. [ABSTRACT FROM AUTHOR]

This document introduces a special issue of the journal "Scalable Computing: Practice & Experience" focused on next-generation pervasive reconfigurable computing for high-performance real-time applications. The authors discuss the importance of adaptable platforms for real-time tasks and highlight the benefits of reconfigurable computing in accelerating applications like image processing and machine learning. The special issue aims to explore recent advancements in this field and includes research papers on topics such as network security, malware detection, software reliability prediction, and optimization algorithms for wing design. The papers cover a range of computer science and technology topics, showcasing advancements and their potential impact on various computing domains. [Extracted from the article]

This paper presents a comparatively simple approach for showthrough and strikethrough print defect detection using computer vision method. Showthrough and strikethrough are common printing problem and are typically functions of a paper's opacity. Under normal lighting condition the visibility of printing on the reverse side of printed paper is termed as showthrough whereas the penetration of ink to the other side is termed as strikethrough. Moreover the intensity of showthrough pixel is extremely low thus it is difficult to identify the showthrough pixel from the printed area. On the other hand strikethrough is the result of penetration of ink through paper and depends on the absorbent nature of paper. Comparatively the intensity of the strikethrough pixel is higher than that of the showthrough but due to similar intensity of the ink of the printed pixel and strikethrough pixel, both overlapped with each other in the foreground of the image. These print defects can degrade the image quality as well as print production. In this study, the detection of these two print defects achieved using histogram equalization technique, to enhance the contrast between foreground and back ground pixels. A global thresholding algorithm was applied on a histogram equalized image to segment the printed area from the background of the image. Pixels in the background which are considered as showthrough and strike through pixels are identified by image subtraction. The pictorial representations of the results show the remarkable potential of the proposed technique which can be possible alternative of present subjective measures of showthrough and strikethrough. [ABSTRACT FROM AUTHOR]

During the machine vision inspection of the inner section of bottle caps within pharmaceutical packaging, the unique conca bottom and convex side walls often create obstructions to the illumination. Consequently, this results in challenges such as irregular background and diminished feature contrast in the image, ultimately leading to the misidentification of defects. As a solution, a vision system characterized by a Low-Angle and Large Divergence Angle (LALDA) is presented in this paper. Using the large divergence angle of LED, combined with low-angle illumination, a uniform image of the side wall region with bright-field characteristics and a uniform image of inner circle region at the bottom with dark-field characteristics are obtained, thus solving the problems of light being obscured and brightness overexposure of the background. Based on the imaging characteristics of LALDA, a multi-channel segmentation (MCS) algorithm is designed. The HSV color space has been transformed, and the image is automatically segmented into multiple sub-regions by mutual calculation of different channels. Further, image homogenization and enhancement are used to eliminate fluctuations in the background and to enhance the contrast of defects. In addition, a variety of defect extraction methods are designed based on the imaging characteristics of different sub-regions, which can avoid the problem of over-segmentation in detection. In this paper, the LALDA is applied to the defect detection inside the cap of capsule medicine bottle, the detection speed is better than 400 pcs/min and the detection accuracy is better than 95%, which can meet the actual production line capacity and detection requirements. [ABSTRACT FROM AUTHOR]

This paper provides an overview of the applications of Convolutional Neural Networks (CNN) in the railway maintenance industry. Our research covers specifically the subdomain of railway track maintenance. In this study, we have analyzed the state-of-the-art of CNNs applied to railway track maintenance by conducting an extensive literature review, summarizing different tasks and problems related to the topic and presenting solutions based on CNNs with a special emphasis on the data used to create these models. The results of our research show different applications of CNNs within the scope, including the detection of defects in the surface of railway rails and railway track components, such as fasteners, joints, sleepers, switches and crossings, as well as the recognition of track components, and the continuous monitoring of railway tracks. The architecture of CNNs is fitting to learning spatial hierarchies of features directly from the input data, making them of great use for Computer Vision and other applications related to the topic at hand. The implementation of IoT devices and smart sensors aid the collection of real-time data which can be used to feed powerful CNN models to recognize patterns and identify complex events related to the maintenance of railway tracks. This and more insights are discussed in detail within the contents of this paper. [ABSTRACT FROM AUTHOR]

As a key system in nuclear power plants, nuclear power systems contain high-temperature, high-pressure water media. A steam leak, if it occurs, can at minimum cause system functional loss and at worst lead to casualties. Therefore, it is urgent to carry out steam leakage detection work for high-temperature, high-pressure loop systems. Currently, steam leaks are primarily detected through visual monitoring and pressure gauges. However, if there is a minor leak under high system pressure, the slight decrease in pressure may not be enough to alert the operators, leading to a delay in detecting the steam leak. Thus, this detection method has certain drawbacks. In view of these issues, this paper introduces computer vision technology to monitor the high-temperature, high-pressure loop system and proposes the use of an improved background subtraction method to detect steam leaks in the loop system. The results show the following advantages of this method: (1) It can effectively identify steam leaks at an early stage; (2) it overcomes the difficulty of determining the threshold value for the binarization of grayscale images in traditional background subtraction methods; (3) it eliminates the noise impact brought by the binarization of grayscale images in existing improved background subtraction methods. The introduction of this method provides a new approach for detecting steam leaks in high-temperature, high-pressure loop systems and can be effectively applied in engineering fields. It also offers reference value for the detection of high-temperature, high-pressure media leaks in other fields. [ABSTRACT FROM AUTHOR]

With the continuous progress of science and technology, image processing techniques have been used increasingly in recent years. Image processing plays an indispensable role in the fields of computer vision, artificial intelligence, pattern recognition, and related fields. Improvements in basic algorithms and the development of new algorithms have resulted in considerable innovation and progress. This paper is devoted to finding new game applications in a branch of image processing. It introduces an analysis model proposed by the author and discusses the relationship between roughness in the frequency domain and visual image interpretation. By using the concept of roughness, we separated the image features into meaningful information and residual information and analysed the image in the frequency domain. The results were compared with those of traditional image processing methods. The starting point is the visual identification of a feature based on human interpretation. The image information was separated into meaningful features and the residual component to reduce the redundancy of the model. This allowed for a sparse representation of the feature information in the image. By analysing the meaningful features and residual components of an image separately, we established a relationship between the results and the original images. Parameters such as texture, morphology, and the degree of blurring were considered and we developed a parameter called "frequency roughness". The algorithm incorporates the concepts of frequency and roughness and the roughness is determined in the frequency domain. The frequency roughness algorithm successfully separated the rough features in the frequency domain and calculated the residual value in an image. This model provided more accurate image processing results than comparable methods. This paper includes an analysis and game applications of the proposed model for de-blurring, image enhancement, recognition, and other image processing tasks. Some game applications were successful, whereas others require further investigation. [ABSTRACT FROM AUTHOR]

The purpose of this study was to investigate the influence of smartphone reading on the ocular surface and to compare the various effects of different screens and light conditions on the ocular surface. One hundred nineteen volunteers were randomly divided into: light + organic light‐emitting diode (OLED), light + electronic ink (eINK), dark + OLED, and dark + eINK. Ocular surface examinations, including noninvasive break‐up time (NIBUT), noninvasive keratograph tear meniscus height (NIKTMH), ocular redness, fluorescein break‐up time (FBUT), corneal fluorescein staining, meibomian gland assessment, Schirmer I Test, and blinking frequency, were performed before and after a reading task. Symptoms were evaluated using the Ocular Surface Disease Index (OSDI) and Computer Vision Syndrome Questionnaire (CVS‐Q). NIBUT and FBUT were decreased statistically significantly after participants read on an OLED screen for 2 hours compared with the baseline in light and dark environments, whereas no statistically significant decrease was observed on an eINK screen. NIKTMH was statistically significantly decreased after reading on an OLED screen in light and dark settings, and the eINK screen had a lesser effect on NIKTMH. An obvious increase in the ocular redness, OSDI and CVS‐Q scores was observed after reading on an OLED screen, whereas the eINK screen had a lesser effect on these indicators. Blink rate increased gradually in OLED subgroups during the reading task, whereas no statistically significant difference was observed in the eINK subgroups. Our research suggested that reading on an OLED screen can cause ocular surface disorder and obvious subjective discomfort, whereas reading on an eINK screen can minimize ocular surface disorder in both dark and light environments. [ABSTRACT FROM AUTHOR]

This paper presents an approach for answering fill-in-the-blank multiple choice questions from the Visual Madlibs dataset. Instead of generic and commonly used representations trained on the ImageNet classification task, our approach employs a combination of networks trained for specialized tasks such as scene recognition, person activity classification, and attribute prediction. We also present a method for localizing phrases from candidate answers in order to provide spatial support for feature extraction. We map each of these features, together with candidate answers, to a joint embedding space through normalized canonical correlation analysis (nCCA). Finally, we solve an optimization problem to learn to combine scores from nCCA models trained on multiple cues to select the best answer. Extensive experimental results show a significant improvement over the previous state of the art and confirm that answering questions from a wide range of types benefits from examining a variety of image cues and carefully choosing the spatial support for feature extraction. [ABSTRACT FROM AUTHOR]

The authors present a comprehensive overview of image processing and analysis work done to support research into the model flowering plant Arabidopsis thaliana. Beside the plant's importance in biological research, using image analysis to obtain experimental measurements of it is an interesting vision problem in its own right, involving the segmentation and analysis of sequences of images of objects whose shape varies between individual specimens and also changes over time. While useful measurements can be obtained by segmenting a whole plant from the background, they suggest that the increased range and precision of measurements made available by leaf-level segmentation makes this a problem well worth solving. A variety of approaches have been tried by biologists as well as computer vision researchers. This is an interdisciplinary area and the computer vision community has an important contribution to make. They suggest that there is a need for publicly available datasets with ground truth annotations to enable the evaluation of new approaches and to support the building of training data for modern data-driven computer vision approaches, which are those most likely to result in the kind of fully automated systems that will be of use to biologists. [ABSTRACT FROM AUTHOR]

This paper presents a textile defect detection method that utilizes a multi‐proportion spatial attention mechanism and channel memory feature fusion network by addressing the difficulties presented by complicated shapes and large size variations. In particular, a multi‐proportion spatial attention mechanism (MPAM) is introduced, which employs multi‐proportion convolution to improve the backbone network's capacity to detect non‐uniform structural defects. Additionally, the generality and adaptability of the model are enhanced by a multi‐scale spatial pyramid pooling structure (MS‐SPP). Second, a channel attention mechanism‐based memory feature fusion network is developed, which incorporates channel attention to adaptive weight the feature channels, focusing on crucial information channels to efficiently fuse contextual features and enhance the model's memory capacity. Finally, a novel efficient Wise‐IoU (EWIoU) loss function is proposed, which utilizes a dynamic non‐monotonic focusing mechanism to increase the penalty on distance measurement, thus enhancing the model's detection performance. Experiment findings on the ZJU‐Leaper and Tianchi textile datasets reveal that compared to the YOLOv7 baseline, the method in this paper has an increase of 6.5 and 2 percentage points, respectively, and the detection accuracy is better than most existing networks. [ABSTRACT FROM AUTHOR]

Image segmentation is a key problem in the field of machine vision. Its core goal is to separate the target and background in the region of interest from the image and directly affect the accuracy of subsequent operations such as target recognition and image understanding. In the past decades, there have been many good image segmentation algorithms. In recent years, the deep learning method represented by deep learning has made great progress in the field of image segmentation. In this paper, some commonly used image segmentation algorithms based on machine learning were reviewed, and their theoretical and experimental studies were carried out. In this paper, the application prospect of machine learning in image segmentation was prospected. The existing image segmentation methods are mainly divided into the following categories: threshold-based segmentation methods, region-based segmentation methods, edge-based segmentation methods, and segmentation methods based on specific theories. In recent years, with the rapid progress of computer vision technology, the requirements for the accuracy of object image edge information segmentation have become increasingly high. The main reason for image segmentation is to better obtain object information. However, due to interference conditions such as lighting and noise, image blurry edge information segmentation has become the most difficult point in the development of computer vision technology. In the comparative experiment of algorithms, the results showed that in the training set, the response time of Deep Neural Network (DNN) algorithm, Cluster Analysis (CA) algorithm, and Support Vector Machine (SVM) algorithm was 13.72 s, 16.88 s and 17.29 s when the number of samples was 150. In the test set, when the sample number was 50, the recognition rate of DNN algorithm was 93.7%; the recognition rate of CA algorithm was 87.9%; the recognition rate of SVM algorithm was 84.3%. Therefore, the research of image fuzzy edge information segmentation based on computer vision and machine learning is essential. [ABSTRACT FROM AUTHOR]

Recognizing actions from still images has been popularly studied recently. In this paper, we model an action class as a flexible number of spatial configurations of body parts by proposing a new spatial sum–product network (SPN). First, we discover a set of parts in image collections via unsupervised learning. Then, our new spatial SPN is applied to model the spatial relationship and also the high-order correlations of parts. To learn robust networks, we further develop a hierarchical spatial SPN method, which models pairwise spatial relationship between parts inside subimages and models the correlation of subimages via extra layers of SPN. Our method is shown to be effective on two benchmark data sets. [ABSTRACT FROM PUBLISHER]

An automatic computer vision algorithm that detects individual paper fibres from an image, assesses the possibility of grasping the detected fibres with microgrippers and detects the suitable grasping points is presented. The goal of the algorithm is to enable automatic fibre manipulation for mechanical characterisation, which has traditionally been slow manual work. The algorithm classifies the objects in images based on their morphology, and detects the proper grasp points from the individual fibres by applying given geometrical constraints. The authors test the ability of the algorithm to detect the individual fibres with 35 images containing more than 500 fibres in total, and also compare the graspability analysis and the calculated grasp points with the results of an experienced human operator with 15 images that contain a total of almost 200 fibres. The detection results are outstanding, with fewer than 1% of fibres missed. The graspability analysis gives sensitivity of 0.83 and specificity of 0.92, and the average distance between the grasp points of the human and the algorithm is 220 µm. Also, the choices made by the algorithm are much more consistent than the human choices. [ABSTRACT FROM AUTHOR]

Waste segregation is an essential aspect of a smoothly functioning waste management system. Usually, various recyclable waste types are disposed of together at the source, and this brings in the necessity to segregate them into their categories. Dry waste needs to be separated into its own categories to ensure that the proper procedures are implemented to treat and process it, which leads to an overall increased recycling rate and reduced landfill impact. Paper, plastics, metals, and glass are just a few examples of the many dry waste materials that can be recycled or recovered to create new goods or energy. Over the past years, much research has been conducted to devise effective and productive ways to achieve proper segregation for the waste that is being produced at an ever-increasing rate. This article introduces a multi-class garbage segregation system employing the YOLOv5 object detection model. Our final prototype demonstrates the capability of classifying dry waste categories and segregating them into their respective bins using a 3D-printed robotic arm. Within our controlled test environment, the system correctly segregated waste classes, mainly paper, plastic, metal, and glass, eight out of 10 times successfully. By integrating the principles of artificial intelligence and robotics, our approach simplifies and optimizes the traditional waste segregation process. [ABSTRACT FROM AUTHOR]

Unmanned Aerial Vehicles (UAVs) are revolutionising diverse computer vision use case domains, from public safety surveillance to Search and Rescue (SAR), and other emergency management and disaster relief operations. The growing need for accurate face verification algorithms has prompted an exploration of synergies between UAVs and face verification. This promises cost-effective, wide-area, non-intrusive person verification. Real-world human-centric use cases such as a ”Drone Guard Angel” for vulnerable people can contribute to public safety management and offload significant police resources. These scenarios demand efficient face verification to distinguish correctly the end users for authentication, authorisation and customised services. This paper investigates the suitability of existing solutions, and analyses five state-of-the-art candidate face verification algorithms. Informed by the advantages and disadvantages of existing solutions, the paper proposes an extended dataset and a refined face verification pipeline. Subsequently, it conducts empirical evaluation of these algorithms using the proposed pipeline and dataset in terms of inference times and the distribution of the similarity indexes. Furthermore, this paper provides essential guidance for algorithm selection and deployment in UAV-based applications. Two candidate algorithms, ArcFace and FaceNet512, have emerged as the top performers. The choice between them will depend on the specific use case requirements. [ABSTRACT FROM AUTHOR]

Introduction: Recently, the Transformer model and its variants have been a great success in terms of computer vision, and have surpassed the performance of convolutional neural networks (CNN). The key to the success of Transformer vision is the acquisition of short-term and long-term visual dependencies through selfattention mechanisms; this technology can efficiently learn global and remote semantic information interactions. However, there are certain challenges associated with the use of Transformers. The computational cost of the global self-attention mechanism increases quadratically, thus hindering the application of Transformers for high-resolution images. Methods: In view of this, this paper proposes a multi-view brain tumor segmentation model based on cross windows and focal self-attention which represents a novel mechanism to enlarge the receptive field by parallel cross windows and improve global dependence by using local fine-grained and global coarse-grained interactions. First, the receiving field is increased by parallelizing the self-attention of horizontal and vertical fringes in the cross window, thus achieving strong modeling capability while limiting the computational cost. Second, the focus on self-attention with regards to local fine-grained and global coarse-grained interactions enables the model to capture short-term and longterm visual dependencies in an efficient manner. Results: Finally, the performance of the model on Brats2021 verification set is as follows: dice Similarity Score of 87.28, 87.35 and 93.28%; Hausdorff Distance (95%) of 4.58 mm, 5.26 mm, 3.78 mm for the enhancing tumor, tumor core and whole tumor, respectively. Discussion: In summary, the model proposed in this paper has achieved excellent performance while limiting the computational cost. [ABSTRACT FROM AUTHOR]

This document is a special issue of the journal "Electronics" that focuses on recent advances in computer vision. The introduction explains how computer vision has transformed various industries and daily life by enabling machines to interpret and understand visual information. It also highlights the challenges that still exist in the field, such as model robustness and interpretability. The future of computer vision is discussed, including the development of multimodal models and advancements in areas like self-supervised learning. The special issue includes 10 papers that cover a range of topics, including stereo matching, low-light image enhancement, automated test grading, image segmentation, virtual clothing design, large-scale learning, camera pose estimation, few-shot segmentation, and image-to-audio conversion. The papers present novel studies, approaches, and reviews that contribute to the advancement of computer vision. The document concludes by emphasizing the importance of computer vision in addressing various challenges and the need for ongoing research and interdisciplinary collaboration to tackle complex real-world problems. [Extracted from the article]

The introduction of YOLOv9, the latest version of the you only look once (YOLO) series, has led to its widespread adoption across various scenarios. This paper is the first to apply the YOLOv9 algorithm model to the fracture detection task as computer‐assisted diagnosis to help radiologists and surgeons to interpret X‐ray images. Specifically, this paper trained the model on the GRAZPEDWRI‐DX dataset and extended the training set using data augmentation techniques to improve the model performance. Experimental results demonstrate that compared to the mAP 50–95 of the current state‐of‐the‐art model, the YOLOv9 model increased the value from 42.16% to 43.73%, with an improvement of 3.7%. The implementation code is publicly available at https://github.com/RuiyangJu/YOLOv9‐Fracture‐Detection. [ABSTRACT FROM AUTHOR]

Due to the self-affine property of the grinding surface, the sample images with different roughness captured by the micron-scale camera exhibit certain similarities. This similarity affects the prediction accuracy of the deep learning model. In this paper, we propose an illumination method that can mitigate the impact of self-affinity using the two-scale fractal theory as a foundation. This is followed by the establishment of a machine vision detection method that integrates a neural network and correlation function. Initially, a neural network is employed to categorize and forecast the microscopic image of the workpiece surface, thereby determining its roughness category. Subsequently, the corresponding correlation function is determined in accordance with the established roughness category. Finally, the surface roughness of the workpiece was calculated based on the correlation function. The experimental results demonstrate that images obtained using this lighting method exhibit significantly enhanced accuracy in neural network classification. In comparison to traditional lighting methods, the accuracy of this method on the micrometer scale has been found to have significantly increased from approximately 50% to over 95%. Concurrently, the mean squared error (MSE) of the surface roughness calculated by the proposed method does not exceed 0.003, and the mean relative error (MRE) does not exceed 5%. The two-scale fractal geometry offers a novel approach to image processing and machine learning, with significant potential for advancement. [ABSTRACT FROM AUTHOR]

Human pose estimation is an important task in computer vision, which can provide key point detection of human body and obtain bone information. At present, human pose estimation is mainly utilized for detection of large targets, and there is no solution for detection of small targets. This paper proposes a multi-channel spatial information feature based human pose (MCSF-Pose) estimation algorithm to address the issue of medium and small targets inaccurate detection of human key points in scenarios involving occlusion and multiple poses. The MCSF-Pose network is a bottom-up regression network. Firstly, an UP-Focus module is designed to expand the feature information while reducing parameter computation during the up-sampling process. Then, the channel segmentation strategy is adopted to cut the features, and the feature information of multiple dimensions is retained through different convolutional groups, which reduces the parameter lightweight network model and makes up for the loss of the feature information associated with the depth of the network. Finally, the three-layer PANet structure is designed to reduce the complexity of the model. With the aid of the structure, it also to improve the detection accuracy and anti-interference ability of human key points. The experimental results indicate that the proposed algorithm outperforms YOLO-Pose and other human pose estimation algorithms on COCO2017 and MPII human pose datasets. [ABSTRACT FROM AUTHOR]

One of the key tasks to ensure infrastructure safety is the periodic detection of bridge cracks. Since manual crack detection is subjective and inefficient, it is very important to develop an automatic crack recognition system by using machine vision. Inspired by the pyramid vision transformer (PVT) and the feature pyramid network (FPN) variants, a method combining PVT, residual transformer (REST), holistically nested edge detection (HED), and downstream detection tasks is proposed in this paper, which is named EVPTMFF (efficient visual pyramid transformer and multiple-feature fusion). Based on the PVT, the multiheaded attention module was replaced and the efficient attention module was adopted, which could process the data efficiently and flexibly. To improve the performance of EVPTMFF, the original perceptual field windows were changed. The adjacent windows were partially overlapped, which was more conducive to feature interaction and improves detection performance. To prove the generalization ability of the model, three different data sets related to bridges were collected and formed. We carried out experiments on these three data sets, and EVPTMFF showed good results. Especially for larger data sets, the performance advantage was more significant. Practical Applications: The crack detection model proposed in this paper presents a good detection effect under different illumination and interference. And the detection results, collected data, time, and other information are saved to the bridge crack detection software. This can help engineers quickly and accurately detect cracks on the bridge surface, as well as predict the development trend of cracks and possible safety issues. In practical application, the bridge crack detection system can help engineers find and solve the bridge crack problem in time and avoid the security risks and economic losses caused by cracks. At the same time, the efficiency and accuracy of bridge maintenance can be improved, and the maintenance cost and time can be reduced. The bridge crack detection system can be integrated with other hardware equipment and management systems to form a complete bridge management platform, which contributes to the traffic construction and social and economic development of the city. [ABSTRACT FROM AUTHOR]

The construction industry is undergoing a digital transformation, with the digital twin serving as a core system for project information. This digital twin provides an opportunity to utilize AR technology for real-time verification of on-site project information. Although many AR developments for construction sites have been attempted, they have been limited to accessing information on stationary components via Building Information Models. There have been no attempts to access information on dynamically changing resources, such as personnel and equipment. This paper addresses this gap by presenting an AR framework that enables site managers to verify real-time information on specific personnel or equipment. It introduces a matching algorithm for retrieving the necessary information from the digital twin. This algorithm is pivotal in identifying and retrieving the specific information needed from the vast dataset within the digital twin. The matching process integrates object detection and tracking algorithms applied to video frames from AR devices, along with GPS and IMU sensor data. Experimental results demonstrate the potential of this matching algorithm to streamline on-site management and reduce the effort required to interact with digital twin information. This paper highlights the transformative potential of AR and digital twin technologies in revolutionizing construction site operations. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicle (UAV)-based object detection methods are widely used in traffic detection due to their high flexibility and extensive coverage. In recent years, with the increasing complexity of the urban road environment, UAV object detection algorithms based on deep learning have gradually become a research hotspot. However, how to further improve algorithmic efficiency in response to the numerous and rapidly changing road elements, and thus achieve high-speed and accurate road object detection, remains a challenging issue. Given this context, this paper proposes the high-efficiency multi-object detection algorithm for UAVs (HeMoDU). HeMoDU reconstructs a state-of-the-art, deep-learning-based object detection model and optimizes several aspects to improve computational efficiency and detection accuracy. To validate the performance of HeMoDU in urban road environments, this paper uses the public urban road datasets VisDrone2019 and UA-DETRAC for evaluation. The experimental results show that the HeMoDU model effectively improves the speed and accuracy of UAV object detection. [ABSTRACT FROM AUTHOR]