Search

The pulp and paper industry is critical to global industrial and economic development. Recently, India's pulp and paper industries have been facing severe competitive challenges. The challenges have impaired the environmental performance and resulted in the closure of several operations. Assessment and prediction of the performance of the Indian pulp and paper industry using various parameters is a critical task for researchers. This study proposes a framework for performance assessment and prediction based on Data Envelopment Analysis (DEA), Artificial Neural Networks, and Deep Learning (DL) to assist industry administration and decision-making. We presented a case study based on eight industries to demonstrate the methodology's applicability. This study analyses and predicts industry performance based on sample data observations over 30 years. The result suggests the DEA-DL-based efficiency prediction has an overall MSE of 0.08 compared with the actual efficiency. Furthermore, the efficiency rankings are compared between the three techniques. The results suggest that the integrated DEA-DL method is primarily accurate in most scenarios with the actual values. The findings of this study provide a comprehensive analysis of environmental performance for policymakers. [ABSTRACT FROM AUTHOR]

Purpose: Paper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms' nutrient source. Mold not only can damage papers' structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper. Methods: Molds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model. Results & Conclusion: In the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation. [ABSTRACT FROM AUTHOR]

The automatic semantic structuring of scientific text allows for more efficient reading of research articles and is an important indexing step for academic search engines. Sequential sentence classification is an essential structuring task and targets the categorisation of sentences based on their content and context. However, the potential of transfer learning for sentence classification across different scientific domains and text types, such as full papers and abstracts, has not yet been explored in prior work. In this paper, we present a systematic analysis of transfer learning for scientific sequential sentence classification. For this purpose, we derive seven research questions and present several contributions to address them: (1) We suggest a novel uniform deep learning architecture and multi-task learning for cross-domain sequential sentence classification in scientific text. (2) We tailor two transfer learning methods to deal with the given task, namely sequential transfer learning and multi-task learning. (3) We compare the results of the two best models using qualitative examples in a case study. (4) We provide an approach for the semi-automatic identification of semantically related classes across annotation schemes and analyse the results for four annotation schemes. The clusters and underlying semantic vectors are validated using k-means clustering. (5) Our comprehensive experimental results indicate that when using the proposed multi-task learning architecture, models trained on datasets from different scientific domains benefit from one another. Our approach significantly outperforms state of the art on full paper datasets while being on par for datasets consisting of abstracts. [ABSTRACT FROM AUTHOR]

There is increasing focus on applying deep learning methods to electrocardiograms (ECGs), with recent studies showing that neural networks (NNs) can predict future heart failure or atrial fibrillation from the ECG alone. However, large numbers of ECGs are needed to train NNs, and many ECGs are currently only in paper format, which are not suitable for NN training. We developed a fully-automated online ECG digitisation tool to convert scanned paper ECGs into digital signals. Using automated horizontal and vertical anchor point detection, the algorithm automatically segments the ECG image into separate images for the 12 leads and a dynamical morphological algorithm is then applied to extract the signal of interest. We then validated the performance of the algorithm on 515 digital ECGs, of which 45 were printed, scanned and redigitised. The automated digitisation tool achieved 99.0% correlation between the digitised signals and the ground truth ECG (n = 515 standard 3-by-4 ECGs) after excluding ECGs with overlap of lead signals. Without exclusion, the performance of average correlation was from 90 to 97% across the leads on all 3-by-4 ECGs. There was a 97% correlation for 12-by-1 and 3-by-1 ECG formats after excluding ECGs with overlap of lead signals. Without exclusion, the average correlation of some leads in 12-by-1 ECGs was 60–70% and the average correlation of 3-by-1 ECGs achieved 80–90%. ECGs that were printed, scanned, and redigitised, our tool achieved 96% correlation with the original signals. We have developed and validated a fully-automated, user-friendly, online ECG digitisation tool. Unlike other available tools, this does not require any manual segmentation of ECG signals. Our tool can facilitate the rapid and automated digitisation of large repositories of paper ECGs to allow them to be used for deep learning projects. [ABSTRACT FROM AUTHOR]

One of the pandemics that have caused many deaths is the Coronavirus disease 2019 (COVID-19). It first appeared in late 2019, and many deaths are increasing day by day until now. Therefore, the early diagnosis of COVID-19 has become a salient issue. Additionally, the current diagnosis methods have several demerits, and a new investigation is required to enhance the diagnosis performance. In this paper, a set of phases are performed, such as collecting data, filtering and augmenting images, extracting features, and classifying ECG images. The data were obtained from two publicly available ECG image datasets, and one of them contained COVID ECG reports. A set of preprocessing methods are applied to the ECG images, and data augmentation is performed to balance the ECG images based on the classes. A deep learning approach based on a convolutional neural network (CNN) is performed for feature extraction. Four different pre-trained models are applied, such as Vgg16, Vgg19, ResNet-101, and Xception. Moreover, an ensemble of Xception and the temporary convolutional network (TCN), which is named ECGConvnet, is proposed. Finally, the results obtained from the former models are fed to four main classifiers. These classifiers are softmax, random forest (RF), multilayer perception (MLP), and support vector machine (SVM). The former classifiers are used to evaluate the diagnosis ability of the proposed methods. The classification scenario is based on fivefold cross-validation. Seven experiments are presented to evaluate the performance of the ECGConvnet. Three of them are multi-class, and the remaining are binary class diagnosing. Six out of seven experiments diagnose COVID-19 patients. The aforementioned experimental results indicated that ECGConvnet has the highest performance over other pre-trained models, and the SVM classifier showed higher accuracy in comparison with the other classifiers. The resulting accuracies from ECGConvnet based on SVM are (99.74%, 98.6%, 99.1% on the multi-class diagnosis tasks) and (99.8% on one of the binary-class diagnoses, while the remaining achieved 100%). It is possible to develop an automatic diagnosis system for COVID based on deep learning using ECG data. [ABSTRACT FROM AUTHOR]

In daily clinical practice, clinicians integrate available data to ascertain the diagnostic and prognostic probability of a disease or clinical outcome for their patients. For patients with suspected or known cardiovascular disease, several anatomical and functional imaging techniques are commonly performed to aid this endeavor, including coronary computed tomography angiography (CCTA) and nuclear cardiology imaging. Continuous improvement in positron emission tomography (PET), single-photon emission computed tomography (SPECT), and CT hardware and software has resulted in improved diagnostic performance and wide implementation of these imaging techniques in daily clinical practice. However, the human ability to interpret, quantify, and integrate these data sets is limited. The identification of novel markers and application of machine learning (ML) algorithms, including deep learning (DL) to cardiovascular imaging techniques will further improve diagnosis and prognostication for patients with cardiovascular diseases. The goal of this position paper of the European Association of Nuclear Medicine (EANM) and the European Association of Cardiovascular Imaging (EACVI) is to provide an overview of the general concepts behind modern machine learning-based artificial intelligence, highlights currently prefered methods, practices, and computational models, and proposes new strategies to support the clinical application of ML in the field of cardiovascular imaging using nuclear cardiology (hybrid) and CT techniques. [ABSTRACT FROM AUTHOR]

Artificial intelligence developments are essential to the successful deployment of community-wide, MRI-driven prostate cancer diagnosis. AI systems should ensure that the main benefits of biopsy avoidance are delivered while maintaining consistent high specificities, at a range of disease prevalences. Since all current artificial intelligence / computer-aided detection systems for prostate cancer detection are experimental, multiple developmental efforts are still needed to bring the vision to fruition. Initial work needs to focus on developing systems as diagnostic supporting aids so their results can be integrated into the radiologists' workflow including gland and target outlining tasks for fusion biopsies. Developing AI systems as clinical decision-making tools will require greater efforts. The latter encompass larger multicentric, multivendor datasets where the different needs of patients stratified by diagnostic settings, disease prevalence, patient preference, and clinical setting are considered. AI-based, robust, standard operating procedures will increase the confidence of patients and payers, thus enabling the wider adoption of the MRI-directed approach for prostate cancer diagnosis. Key Points: • AI systems need to ensure that the benefits of biopsy avoidance are delivered with consistent high specificities, at a range of disease prevalence. • Initial work has focused on developing systems as diagnostic supporting aids for outlining tasks, so they can be integrated into the radiologists' workflow to support MRI-directed biopsies. • Decision support tools require a larger body of work including multicentric, multivendor studies where the clinical needs, disease prevalence, patient preferences, and clinical setting are additionally defined. [ABSTRACT FROM AUTHOR]

In recent years, there has been a dramatic increase in research papers about machine learning (ML) and artificial intelligence in radiology. With so many papers around, it is of paramount importance to make a proper scientific quality assessment as to their validity, reliability, effectiveness, and clinical applicability. Due to methodological complexity, the papers on ML in radiology are often hard to evaluate, requiring a good understanding of key methodological issues. In this review, we aimed to guide the radiology community about key methodological aspects of ML to improve their academic reading and peer-review experience. Key aspects of ML pipeline were presented within four broad categories: study design, data handling, modelling, and reporting. Sixteen key methodological items and related common pitfalls were reviewed with a fresh perspective: database size, robustness of reference standard, information leakage, feature scaling, reliability of features, high dimensionality, perturbations in feature selection, class balance, bias-variance trade-off, hyperparameter tuning, performance metrics, generalisability, clinical utility, comparison with traditional tools, data sharing, and transparent reporting. Key Points • Machine learning is new and rather complex for the radiology community. • Validity, reliability, effectiveness, and clinical applicability of studies on machine learning can be evaluated with a proper understanding of key methodological concepts about study design, data handling, modelling, and reporting. • Understanding key methodological concepts will provide a better academic reading and peer-review experience for the radiology community. [ABSTRACT FROM AUTHOR]

Olivier was the 2004-2005 President of the European Association of Geoscientists and Engineers (EAGE), and he was the 2003 SEG/EAGE Distinguished Instructor. His PhD research was awarded the John S. Archer award for research excellence by the Department of Earth Science and Engineering, Imperial College London. I Mathematical Geosciences i is fortunate to publish many excellent papers every year, which makes the selection process for the Best Paper Award a challenging undertaking. [Extracted from the article]

Deep learning has achieved remarkable success in a wide range of domains. However, it has not been comprehensively evaluated as a solution for the task of Chinese biomedical named entity recognition (Bio-NER). The traditional deep-learning approach for the Bio-NER task is usually based on the structure of recurrent neural networks (RNN) and only takes word embeddings into consideration, ignoring the value of character-level embeddings to encode the morphological and shape information. We propose an RNN-based approach, WCP-RNN, for the Chinese Bio-NER problem. Our method combines word embeddings and character embeddings to capture orthographic and lexicosemantic features. In addition, POS tags are involved as a priori word information to improve the final performance. The experimental results show our proposed approach outperforms the baseline method; the highest F-scores for subject and lesion detection tasks reach 90.36 and 90.48% with an increase of 3.10 and 2.60% compared with the baseline methods, respectively. [ABSTRACT FROM AUTHOR]

Over the years the number of research publications per year is growing exponentially. Finding research papers of quality from the massive literature of relevant articles is a challenging and time-consuming task. The approaches in the latest literature address citation recommendation by utilizing large bibliographic information and use machine learning and deep learning methods for the task. These techniques clearly require a large amount of training data as well as machines with high processing power. To overcome these issues, we propose a novel method by modifying the popular hyperlink induced topic search (HITS), a web page ranking algorithm, as citation recommendation using hyperlink induced topic search (CR-HITS) that works on a directed and weighted heterogeneous bibliographic network containing diverse types of nodes and edges. We define effective scoring schemes for nodes and edges based on basic bibliographic information like citations of papers, number of publications of an author, etc. Given a few seed papers, the citation recommendation algorithm CR-HITS is run on small neighborhoods of the seed papers and hence the time taken by the execution is very small to yield the final recommendations. To the best of our knowledge, HITS has been used for the first time for the citation recommendation problem. We perform extensive experimentation on DBLP (version-11) and ACM (version-9) datasets and compare the results with many baseline methods in terms of MAP, MRR, and recall@N measures. The performance of the proposed algorithms is superior with respect to the MAP metric and matches the second best for the other two metrics. Since the top two algorithms use deep learning methods and use much larger bibliographic information including abstracts of the papers, we claim that our approach utilizes very low resources, yet yields recommendations that are very close to the top recommendations. [ABSTRACT FROM AUTHOR]

The integration of artificial intelligence (AI) in ophthalmology has promoted the development of the discipline, offering opportunities for enhancing diagnostic accuracy, patient care, and treatment outcomes. This paper aims to provide a foundational understanding of AI applications in ophthalmology, with a focus on interpreting studies related to AI-driven diagnostics. The core of our discussion is to explore various AI methods, including deep learning (DL) frameworks for detecting and quantifying ophthalmic features in imaging data, as well as using transfer learning for effective model training in limited datasets. The paper highlights the importance of high-quality, diverse datasets for training AI models and the need for transparent reporting of methodologies to ensure reproducibility and reliability in AI studies. Furthermore, we address the clinical implications of AI diagnostics, emphasizing the balance between minimizing false negatives to avoid missed diagnoses and reducing false positives to prevent unnecessary interventions. The paper also discusses the ethical considerations and potential biases in AI models, underscoring the importance of continuous monitoring and improvement of AI systems in clinical settings. In conclusion, this paper serves as a primer for ophthalmologists seeking to understand the basics of AI in their field, guiding them through the critical aspects of interpreting AI studies and the practical considerations for integrating AI into clinical practice. [ABSTRACT FROM AUTHOR]

Natural disasters can be unpredictable and catastrophic. Even after the event, the repercussions are prolonged due to the incompetence of disaster management strategies. To mitigate the effects of a natural hazard, disaster management teams have to rapidly come forth with innovative plans of action. To contain the damage that a disaster causes, the response time, and preparedness of a disaster management team is crucial. Having a forewarning about the nature of the disaster can prove to be beneficial for the management team. Remote/unreachable areas such as deep parts of the forests, far-flung rural areas, oceans and other hard to reach locations are at a higher risk of receiving poorer aid and response due to the lack of communication and connectivity with the rest of the world. Our paper provides a solution for this particular problem by suggesting UAV/Drones for surveillance and monitoring in these inaccessible, disaster struck areas. The drones not only monitor the situation but constantly click pictures and send them to a base station, where the images are used to collect insights about the type of disaster that has to be dealt with. The paper proposes a deep learning model based on feature concatenation for classification of disasters which can be deployed at the base station, and can receive data in the form of images from a UAV/drone hovering over the affected place. The proposed model is efficient and able to achieve a higher accuracy as compared to the leading CNN models and closely related recent works as well. [ABSTRACT FROM AUTHOR]

In a treatment or diagnosis related to oral health conditions such as oral cancer and oropharyngeal cancer, an investigation of tongue's movements is a major part. In an automatic measurement of such movement, it must first start with a task of tongue segmentation. This paper proposes a solution of tongue segmentation based on a decoder-encoder CNN-based structure i.e., U-Net. However, it could suffer from a problem of feature loss in deep layers. This paper proposes a Deep Upscale U-Net (DU-UNET). An additional up-sampling of the feature map from a contracting path is concatenated to an upper layer of an expansive path, based on an original U-Net structure. The segmentation model is constructed by training DU-UNET on the two publicly available datasets, and transferred to the self-collected dataset of tongue images with five tongue postures which were recorded at a far distance from a camera under a real-world scenario. The proposed DU-UNET outperforms the other existing methods in our literature reviews, with accuracy of 99.2%, mean IoU of 97.8%, Dice score of 96.8%, and Jaccard score of 96.8%. [ABSTRACT FROM AUTHOR]

Named entity recognition (NER) aims to identify the required entities and their types from unstructured text, which can be utilized for the construction of knowledge graphs. Traditional methods heavily rely on manual feature engineering and face challenges in adapting to large datasets within complex linguistic contexts. In recent years, with the development of deep learning, a plethora of NER methods based on deep learning have emerged. This paper begins by providing a succinct introduction to the definition of the problem and the limitations of traditional methods. It enumerates commonly used NER datasets suitable for deep learning methods and categorizes them into three classes based on the complexity of named entities. Then, some typical deep learning-based NER methods are summarized in detail according to the development history of deep learning models. Subsequently, an in-depth analysis and comparison of methods achieving outstanding performance on representative and widely used datasets is conducted. Furthermore, the paper reproduces and analyzes the recognition results of some typical models on three different types of typical datasets. Finally, the paper concludes by offering insights into the future trends of NER development. [ABSTRACT FROM AUTHOR]

Gynecological health remains a critical aspect of women's overall well-being, with profound implications for maternal and reproductive outcomes. This comprehensive review synthesizes the current state of knowledge on four pivotal aspects of gynecological health: preterm birth, breast cancer and cervical cancer and infertility treatment. Machine learning (ML) has emerged as a transformative technology with the potential to revolutionize gynecology and women's healthcare. The subsets of AI, namely, machine learning (ML) and deep learning (DL) methods, have aided in detecting complex patterns from huge datasets and using such patterns in making predictions. This paper investigates how machine learning (ML) algorithms are employed in the field of gynecology to tackle crucial issues pertaining to women's health. This paper also investigates the integration of ultrasound technology with artificial intelligence (AI) during the initial, intermediate, and final stages of pregnancy. Additionally, it delves into the diverse applications of AI throughout each trimester. This review paper provides an overview of machine learning (ML) models, introduces natural language processing (NLP) concepts, including ChatGPT, and discusses the clinical applications of artificial intelligence (AI) in gynecology. Additionally, the paper outlines the challenges in utilizing machine learning within the field of gynecology. [ABSTRACT FROM AUTHOR]

This paper introduces the collection of the Journal on Machine Learning (ML) and the user. It provides a brief history of ML from the 1950's through to the current time, sketching the nature of the kinds of precursor AI techniques used in such things as expert systems right the way through to the emergence of ML and its tool sets, including deep learning. It concludes with the 'generative AI' used in such ML technologies as PaLM and GPT-3. The history highlights key changes and developments in ML, the especial importance and limitations of deep learning, and the changing attitudes and expectations of users in an environment when ML can and often is oversold. The paper then explores the ways CSCW research has addressed the social context of organisational systems and how the same can apply for ML tools and techniques. It urges research that focuses on the particular ways that ML comes to fit into 'real world' collaborative work sites and hence speaks to the CSCW cannon. [ABSTRACT FROM AUTHOR]

Segmentation of whole slide histological images through the classification of tissue types of small fragments is an extremely relevant task in digital pathology, necessary for the development of methods for automatic analysis of whole slide histological images. The extremely large resolution of such images also makes the task of increasing image resolution relevant, which allows storing images at a reduced resolution and increasing it if necessary. Annotating whole slide images by histologists is complex and time-consuming, so it is important to make the most efficient use of the available data, both labeled and unlabeled. In this paper we propose a novel neural network method to simultaneously solve the problems of super-resolution of histological images from ×20 optical magnification to ×40 and classifying image fragments into tissue types at ×20 magnification. The use of a single encoder as well as the proposed neural network training scheme allows to achieve better results on both tasks compared to existing approaches. The PATH-DT-MSU WSS2v2 dataset presented for the first time in this paper was used for training and testing the method. On the test sample, an accuracy value of 0.971 and a balanced accuracy value of 0.916 were achieved in the classification task on 5 tissue types, for the super-resolution task, values of PSNR = 32.26 and SSIM = 0.89 were achieved. The source code of the proposed method is available at: https://github.com/Kukty/WSI_SR_CL. [ABSTRACT FROM AUTHOR]

The inverse design of nanophotonic devices has been widely concerned by researchers, and on-demand design is the difficulty of inverse design. In inverse design, researchers usually define a target spectrum based on the performance indicators and experiences and then inverse design the structural parameters from the target spectrum. Due to the uncertainty of inverse design and "one-to-many" problem, it is not usually possible to guarantee that the target spectrum is sure to correspond to a real nanostructure. In order to solve these problems, an inverse design method combining generative model and genetic algorithm is proposed in this paper. Before the inverse design, the real spectrum is compressed into a latent space by the generation model, and then, the target spectrum is decoded from the latent space according to the performance index. Finally, the hybrid optimization algorithm combining genetic algorithm and forward prediction network is used to optimize the generated spectrum. The design method follows the process from performance indicators to target spectrum to structural parameter, and we successfully realized the inverse design of multilayer nanofilms on demand by using this method in the experimental part. The inverse design method proposed in this paper provides a possible solution for the inverse design of nanophotonic devices on demand. [ABSTRACT FROM AUTHOR]

De-mining operations are of critical importance for humanitarian efforts and safety in conflict-affected regions. In this paper, we address the challenge of enhancing the accuracy and efficiency of mine detection systems. We present an innovative Deep Learning architecture tailored for pulse induction-based Metallic Mine Detectors (MMD), so called DL-MMD. Our methodology leverages deep neural networks to distinguish amongst nine distinct materials with an exceptional validation accuracy of 93.5%. This high level of precision enables us not only to differentiate between anti-personnel mines, without metal plates but also to detect minuscule 0.2-g vertical paper pins in both mineralized soil and non-mineralized environments. Moreover, through comparative analysis, we demonstrate a substantial 3% and 7% improvement (approx.) in accuracy performance compared to the traditional K-Nearest Neighbors and Support Vector Machine classifiers, respectively. The fusion of deep neural networks with the pulse induction-based MMD not only presents a cost-effective solution but also significantly expedites decision-making processes in de-mining operations, ultimately contributing to improved safety and effectiveness in these critical endeavors. [ABSTRACT FROM AUTHOR]

In order to solve the problem of untimely monitoring of tool wear status during laser-ultrasonic compound cutting (LUCC), which leads to the reduction of process accuracy and product quality damage, a method of tool wear status monitoring based on acoustic emission (AE) and deep learning is proposed in this paper. The AE signal is collected and analyzed in the frequency and time-frequency domains by using Fourier transform (FT) and wavelet packet decomposition (WPD), it is found that the AE signal energy is mainly concentrated in the 1st, 2nd, 3rd, and 4th frequency bands, and the energy of each frequency band in the signal increases gradually when the tool wear degree increases, however, the percentage of energy of each frequency band in the total energy shows different change trend. According to the amount of flank wear of the tool, the tool wear degree is divided into four tool wear states. The SVM model and BP neural network model were established based on MATLAB software to realize the tool wear state monitoring. The results show that the tool wear monitoring based on BP neural network is better than that of SVM for tool wear status monitoring. The model identification correct rate reaches 99 %, which is more suitable for the tool wear state monitoring designed in this paper. [ABSTRACT FROM AUTHOR]

Wireless link scheduling in device-to-device (D2D) networks is an NP-hard problem. As a solution, multiple supervised deep learning (DL) models have been recently proposed, which depend on the geographical information of D2D pairs. However, such DL models require labeled training data. In this paper, we focus on unsupervised learning of scheduling. More specifically, this paper proposes using a Density-Based anti-Clustering for Scheduling D2D Communications (DBSCHedule). The proposed algorithm is a two-step approach that consists of clustering and anti-clustering. First, clustering aims at identifying the non-interfering groups of D2D pairs. Then, anti-clustering aims at identifying the maximally separated sub-groups to minimize the interference. The clustering step uses a fully-automated unsupervised density-based spectral-clustering of applications with noise (DBSCAN) and the anti-clustering uses the inverse of the objective function of the k-means clustering. Results show comparable performance with the optimal FPLinQ scheduler yet without requiring any channel information nor is there a requirement to solve a complex optimization problem. Moreover, a comparable performance to the previous attempts using DL and modified clustering is achieved while being completely adaptive and easily accommodating to changes in the network layout. [ABSTRACT FROM AUTHOR]

Accurate atom mapping, which establishes correspondences between atoms in reactants and products, is a crucial step in analyzing chemical reactions. In this paper, we present a novel end-to-end approach that formulates the atom mapping problem as a deep graph matching task. Our proposed model, AMNet (Atom Matching Network), utilizes molecular graph representations and employs various atom and bond features using graph neural networks to capture the intricate structural characteristics of molecules, ensuring precise atom correspondence predictions. Notably, AMNet incorporates the consideration of molecule symmetry, enhancing accuracy while simultaneously reducing computational complexity. The integration of the Weisfeiler-Lehman isomorphism test for symmetry identification refines the model's predictions. Furthermore, our model maps the entire atom set in a chemical reaction, offering a comprehensive approach beyond focusing solely on the main molecules in reactions. We evaluated AMNet's performance on a subset of USPTO reaction datasets, addressing various tasks, including assessing the impact of molecular symmetry identification, understanding the influence of feature selection on AMNet performance, and comparing its performance with the state-of-the-art method. The result reveals an average accuracy of 97.3% on mapped atoms, with 99.7% of reactions correctly mapped when the correct mapped atom is within the top 10 predicted atoms. Scientific contribution The paper introduces a novel end-to-end deep graph matching model for atom mapping, utilizing molecular graph representations to capture structural characteristics effectively. It enhances accuracy by integrating symmetry detection through the Weisfeiler-Lehman test, reducing the number of possible mappings and improving efficiency. Unlike previous methods, it maps the entire reaction, not just main components, providing a comprehensive view. Additionally, by integrating efficient graph matching techniques, it reduces computational complexity, making atom mapping more feasible. [ABSTRACT FROM AUTHOR]

IoT devices convert billions of objects into data-generating entities, enabling them to report status and interact with their surroundings. This data comes in various formats, like structured, semi-structured, or unstructured. In addition, it can be collected in batches or in real time. The problem now is how to benefit from all of this data gathered by sensing and monitoring changes like temperature, light, and position. In this paper, we propose a predictive analytics framework constructed on top of open-source technologies such as Apache Spark and Kafka. The framework focuses on forecasting temperature time series data using traditional and deep learning predictive analytics methods. The analysis and prediction tasks were performed using Autoregressive Integrated Moving Average (ARIMA), Seasonal Autoregressive Integrated Moving Average (SARIMA), Long Short-Term Memory (LSTM), and a novel hybrid model based on Convolution Neural Network (CNN) and LSTM. The purpose of this paper is to determine whether and how recently developed deep learning-based models outperform traditional algorithms in the prediction of time series data. The empirical studies conducted and reported in this paper demonstrate that deep learning-based models, specifically LSTM and CNN-LSTM, exhibit superior performance compared to traditional-based algorithms, ARIMA and SARIMA. More specifically, the average reduction in error rates obtained by LSTM and CNN-LSTM models were substantial when compared to other models indicating the superiority of deep learning. Moreover, the CNN-LSTM-based deep learning model exhibits a higher degree of closeness to the actual values when compared to the LSTM-based model. [ABSTRACT FROM AUTHOR]

With a significant number of mechanical products approaching the retirement phase, the batch recycling of discarded mechanical parts necessitates a preliminary assessment of their surface condition. However, the presence of surface rust poses a challenge to defect identification. Therefore, this paper proposes a method for detecting heavily rusted surface defects based on an improved YOLOv8n network. In the Backbone, the C2f-DBB module of re-parameterized deep feature extraction was introduced, and the attention module was designed to improve the accuracy of information extraction. In the Neck part, a Bi-Afpn multiscale feature fusion strategy is designed to facilitate information exchange between features at different scales. Finally, Focal-CIoU is employed as the bounding box loss function to enhance the network's localization performance and accuracy for defects. Experimentally, it is proved that the improved network in this paper improves the Recall, Precision, and mAP0.5 by 1.2%, 2.1%, and 1.9%, respectively, on the original basis, which is better than other network models. [ABSTRACT FROM AUTHOR]

The increasing availability of hydrological and physiographic spatiotemporal data has boosted machine learning's role in rapid flood mapping. Yet, data scarcity, especially high-resolution DEMs, challenges regions with limited access. This paper examines how DEM type and resolution affect flood prediction accuracy, utilizing a cutting-edge deep learning (DL) method called 1D convolutional neural network (CNN). It utilizes synthetic hydrographs as training input and water depth data obtained from LISFLOOD-FP, a 2D hydrodynamic model, as target data. This study investigates digital surface models (DSMs) and digital terrain models (DTMs) derived from a 1 m LIDAR-based DTM, with resolutions from 15 to 30 m. The methodology is applied and assessed in a established benchmark, city of Carlisle, UK. The models' performance is then evaluated and compared against an observed flood event using RMSE, Bias, and Fit indices. Leveraging the insights gained from this region, the paper discusses the applicability of the methodology to address the challenges encountered in a data-scarce flood-prone region, exemplified by Pakistan. Results indicated that utilizing a 30 m DTM outperformed a 30 m DSM in terms of flood depth prediction accuracy by about 21% during the flood peak stage, highlighting the superior performance of DTM at lower resolutions. Increasing the resolution of DTM to 15 m resulted in a minimum 50% increase in RMSE and a 20% increase in fit index across all flood stages. The findings emphasize that while a coarser resolution DEM may impact the accuracy of machine learning models, it remains a viable option for rapid flood prediction. However, even a slight improvement in data resolution in data-scarce regions would provide significant added value, ultimately enhancing flood risk management. [ABSTRACT FROM AUTHOR]

Deep learning models have a high application value in runoff forecasting, but their prediction mechanism is difficult to interpret and their computational cost is high when dealing with complex hydrological relationships, limiting their feasibility in hydrological process mechanism analysis. To address these concerns, the paper first introduces an attention mechanism (AM) for building a long short-term memory network (LSTM) model with AM in the hidden layer (AM-LSTM). The AM-LSTM model employs attention layers to improve information extraction from hidden layers, resulting in a more accurate representation of the relationships between runoff-related elements. Furthermore, in the hidden layers of the AM-LSTM model, interpretable spatiotemporal attention units are established, which not only improves the model's prediction accuracy but also provides interpretability to the forecasting process. Furthermore, parallelization techniques are used in the paper to address the issue of model runtime cost. Simultaneously, to address the accuracy degradation caused by parallelization, the paper employs wavelet denoising (WD) techniques and builds the WD-AM-LSTM model. This accomplishment enables the runoff forecasting model to predict runoff in real time and with high accuracy. Based on validation using ten-day runoff data from the Huanren Reservoir in the Hun River's middle reaches, the results show that, with two layers and an eight-batch size, the AM-LSTM model outperforms the LSTM model in capturing spatiotemporal runoff features. During the model testing phase, the AM-LSTM model improves the MAE, RMSE, and NSE performance metrics by 8.46%, 13%, and 3.82%, respectively. The WD-AM-LSTM model effectively mitigates the noise impact caused by data parallelization under the conditions of two layers and a batch size of 512, achieving the same level of prediction performance while reducing computational cost by 92.01%. By incorporating attention mechanisms and wavelet denoising techniques, this study obtains high-speed and accurate predictions with interpretable results. It expands the deep learning models' applicability in ten-day runoff forecasting work. [ABSTRACT FROM AUTHOR]

Understanding how outdoor environments affect mental health outcomes is vital in today's fast-paced and urbanized society. Recently, advancements in data-gathering technologies and deep learning have facilitated the study of the relationship between the outdoor environment and human perception. In a systematic review, we investigate how deep learning techniques can shed light on a better understanding of the influence of outdoor environments on human perceptions and emotions, with an emphasis on mental health outcomes. We have systematically reviewed 40 articles published in SCOPUS and the Web of Science databases which were the published papers between 2016 and 2023. The study presents and utilizes a novel topic modeling method to identify coherent keywords. By extracting the top words of each research topic, and identifying the current topics, we indicate that current studies are classified into three areas. The first topic was "Urban Perception and Environmental Factors" where the studies aimed to evaluate perceptions and mental health outcomes. Within this topic, the studies were divided based on human emotions, mood, stress, and urban features impacts. The second topic was titled "Data Analysis and Urban Imagery in Modeling" which focused on refining deep learning techniques, data collection methods, and participants' variability to understand human perceptions more accurately. The last topic was named "Greenery and visual exposure in urban spaces" which focused on the impact of the amount and the exposure of green features on mental health and perceptions. Upon reviewing the papers, this study provides a guide for subsequent research to enhance the view of using deep learning techniques to understand how urban environments influence mental health. It also provides various suggestions that should be taken into account when planning outdoor spaces. [ABSTRACT FROM AUTHOR]

Software-defined networking will be a critical component of the networking domain as it transitions from a standard networking design to an automation network. To meet the needs of the current scenario, this architecture redesign becomes mandatory. Besides, machine learning (ML) and deep learning (DL) techniques provide a significant solution in network attack detection, traffic classification, etc. The DDoS attack is still wreaking havoc. Previous work for DDoS attack detection in SDN has not yielded significant results, so the author has used the most recent deep learning technique to detect the attacks. In this paper, we aim to classify the network traffic into normal and malicious classes based on features in the available dataset by using various deep learning techniques. TCP, UDP, and ICMP traffic are considered normal; however, malicious traffic includes TCP Syn Attack, UDP Flood, and ICMP Flood, all of which are DDoS attack traffic. The major contribution of this paper is the identification of novel features for DDoS attack detection. Novel features are logged into the CSV file to create the dataset, and machine learning algorithms are trained on the created SDN dataset. Various work which has already been done for DDoS attack detection either used a non-SDN dataset or the research data is not made public. A novel hybrid machine learning model is utilized to perform the classification. The dataset used by the ML/DL algorithms is a collection of public datasets on DDoS attacks as well as an experimental DDoS dataset generated by us and publicly available on the Mendeley Data repository. A Python application performs the classification of traffic into one of the classes. From the various classifiers used, the accuracy score of 99.75% is achieved with Stacked Auto-Encoder Multi-layer Perceptron (SAE-MLP). To measure the effectiveness of the SDN-DDoS dataset, the other publicly available datasets are also evaluated against the same deep learning algorithms, and traffic classification accuracy is found to be significantly higher with the SDN-DDoS dataset. The attack detection time of 216.39 s also serve as experimental evidence. [ABSTRACT FROM AUTHOR]

The Internet of Things (IoT) paradigm and the advanced wireless technologies of 5G and beyond are expected to enable diverse applications such as autonomous driving, industrial automation, and smart cities. These applications bring together a vast and diverse IoT device population that occupy radio frequency spectrum. Such a large number of wireless devices expose previously unheard-of threat surfaces in addition to the bandwidth shortage and throughput issues. Device identification is crucial in such scenarios not only to authenticate and authorize nodes, but also to employ different network services. One of the promising solutions for device identification is the use of radio frequency (RF) fingerprinting. Recently, wireless device identification using RF fingerprinting along with machine learning and deep learning technologies showed outstanding results in the recent contemporary domains. This paper presents a systematic literature review of RF fingerprinting identification of wireless devices by presenting the results as a graphical and tabular representation of statistical data obtained. Only experimental research papers were considered of over 130 journals and international conference papers that have been classified and evaluated from the year 2010 till date. This survey focuses on exploring the commonly used RF fingerprinting approaches, feature extraction and filtration techniques, and classification algorithm used in the device identification. Finally, open issues and challenges along with future directions have presented which were discovered during the process of analyzing the literature. [ABSTRACT FROM AUTHOR]

Protein structure expectation is a particularly mind boggling issue that it is frequently assaulted and disintegrated using four distinct levels and they are: 1-D forecast of under- lying highlights along the essential succession of amino acids sequences, 2-D forecast of spatial connections between the sequence of amino acids, 3-D forecast of a tertiary structure of protein and quaternary structure of protein. This paper also try to introduce some assessment tools for finding the accuracy of result from applying ML and DL tools. And try to analyses and compare various algorithms based on deep learning methods verses machine learning methods used for sequence prediction. This paper also examines the turn of events and utilization of concealed Markov model, uphold vector machines, Bayesian techniques, and grouping strategies. This investigation will be helpful in creating future strategies to improve the exactness of protein auxiliary structure expectation. In this paper, also introduce and summarize the problem of quantum essential elements of: (1) Variational auto-encoder (2) GAN, generative adversarial network (3) RNN, recurrent neural (4) CNN, convolutional neural networks protein structure prediction. Later on also summarizes the evolution of predictive algorithms for 1-4D structure of protein from Amino Acid Sequences and summarize the deep learning ideas to prediction of structure of protein and learned algorithms of the last decade. [ABSTRACT FROM AUTHOR]

Programmed death-ligand 1 (PD-L1) expression is currently used in the clinic to assess eligibility for immune-checkpoint inhibitors via the tumor proportion score (TPS), but its efficacy is limited by high interobserver variability. Multiple papers have presented systems for the automatic quantification of TPS, but none report on the task of determining cell-level PD-L1 expression and often reserve their evaluation to a single PD-L1 monoclonal antibody or clinical center. In this paper, we report on a deep learning algorithm for detecting PD-L1 negative and positive tumor cells at a cellular level and evaluate it on a cell-level reference standard established by six readers on a multi-centric, multi PD-L1 assay dataset. This reference standard also provides for the first time a benchmark for computer vision algorithms. In addition, in line with other papers, we also evaluate our algorithm at slide-level by measuring the agreement between the algorithm and six pathologists on TPS quantification. We find a moderately low interobserver agreement at cell-level level (mean reader-reader F1 score = 0.68) which our algorithm sits slightly under (mean reader-AI F1 score = 0.55), especially for cases from the clinical center not included in the training set. Despite this, we find good AI-pathologist agreement on quantifying TPS compared to the interobserver agreement (mean reader-reader Cohen's kappa = 0.54, 95% CI 0.26–0.81, mean reader-AI kappa = 0.49, 95% CI 0.27—0.72). In conclusion, our deep learning algorithm demonstrates promise in detecting PD-L1 expression at a cellular level and exhibits favorable agreement with pathologists in quantifying the tumor proportion score (TPS). We publicly release our models for use via the Grand-Challenge platform. [ABSTRACT FROM AUTHOR]

This paper focuses on the problem of motorcyclist helmet detection in single images. Although some previous works have been developed to deal with this problem, yet most of them are designed for videos and not suitable for single-image helmet detection. In view of this, in this paper, we propose a novel dual-detection framework for single-image motorcyclist helmet detection with multi-head self-attention. Particularly, two types of detectors are first trained, namely the rider detector and the head-shoulder detector, which are jointly leveraged in the dual-detection scheme. To take advantage of the contextual relevance information, the multi-head self-attention mechanism is incorporated, where multiple self-attention layers are integrated to capture the complex relationships among the input features so as to further enhance the detection accuracy. A new benchmark dataset, termed the SCAU helmet detection on motorcyclists (SCAU-HDM) dataset, is presented, which consists of 8000 training images and 2000 test images. Extensive experiments on the benchmark dataset demonstrate the effectiveness of the proposed framework. The code is available at https://github.com/LiChunHong2020/SCAUHDM. [ABSTRACT FROM AUTHOR]

In this paper, a scalable end-to-end tree boosting system called XGBoost has been applied for predicting the magnitude of an earthquake from the early part of earthquake waveform data. This model uses the features extracted from the early P wave phase of the records as an input. The model's effectiveness has been verified by using data on earthquakes occurring in the Eurasian plate of Japan Islands from 1996 to 2021. Feature engineering has given 29 new features identified from the early P wave phase of the record, which show a high correlation with the magnitude of an earthquake. The comparison of predicted and actual magnitude shows that a trained XGboost model, which uses a single input record for magnitude prediction, gives an average prediction error of 0.004 ± 0.57 for earthquakes in the test dataset. In contrast, the average prediction error of –1.1 ± 0.80 and –0.65 ± 0.69 has been obtained for the magnitude estimated from conventional τc and Pd methods using the same test dataset. It is further seen that the average predicted magnitude of a single earthquake of magnitude 4.5 and 6.1 (MJMA) obtained by using multiple nearfield records using XGBoost model is 4.58 ± 0.33 and 6.32 ± 0.29, which is close to the actual magnitude of the earthquake. The results presented in this paper clearly show that the structured data can be effectively used by complex machine learning or deep learning models to predict earthquake magnitude from single or multiple records. [ABSTRACT FROM AUTHOR]

Microscopic image analysis technology helps solve the inadvertences of artificial traditional methods in disease, wastewater treatment, and environmental change monitoring analysis. Convolutional neural network (CNN) play an important role in microscopic image analysis. Image segmentation, in which U-Net is increasingly applied in microscopic image segmentation, is a crucial step in detection, tracking, monitoring, feature extraction, modelling, and analysis. This paper comprehensively reviews the development history of U-Net, analyses several research results of various segmentation methods since the emergence of U-Net, and conducts a comprehensive review of related papers. This paper summarised the improved methods of U-Net and then listed the existing significance of image segmentation techniques and their improvements introduced over the years. Finally, focusing on the different improvement strategies of U-Net in different papers, the related work of each application target is reviewed according to detailed technical categories to facilitate future research. Researchers can see the dynamics of the transmission of technological development and keep up with future trends in this interdisciplinary field. [ABSTRACT FROM AUTHOR]

Deep neural networks are extensively used in text mining and Natural Language Processing is to enable computers to understand, analyze, and generate natural language data, such as text or speech, but semantic resources, such as taxonomies and ontologies, are not fully included in deep learning. In this paper, we use Deep Convolutional Neural Network (Deep CNN) to classify research papers using the Computer Science Ontology, an ontology of research areas in the field of computer science. It takes as input the abstract and keywords of a particular research paper and returns the relevant research topic. To evaluate our ontology, we used a gold standard dataset that includes research articles. To further improve text classification results, we propose to design a Deep CNN model. We then used ontology matching to reduce the classes and get better results. Experimental results show that the proposed approach outperforms the one with the highest precision, recall, and F1-score. [ABSTRACT FROM AUTHOR]

Cancelable biometrics serves as an effective countermeasure against various template attacks launched by intruders, safeguarding the biometric system. This paper proposes a cancelable approach with a novel feature extraction technique for iris recognition, known as the hybrid architecture of the convolutional neural network (CNN) and GRU (gated recurrent unit). To provide cancelability to the system, the paper makes use of a random projection technique. The proposed method has the best outcome in terms of accurate identification. The method is validated on two Iris datasets IITD and MMU, which show promising results on the equal error rate (EER) and accuracy. The proposed model provides 0.02 and 0.045 EER for IITD and MMU, respectively, and accuracy 0.98 and 0.933%, for IITD and MMU Iris dataset, respectively, which is very high compared to other methodologies. The proposed hybrid architecture is being used for a cancelable biometric system for the first time based on literature review. The efficiency of the proposed method is high when validated on the datasets. [ABSTRACT FROM AUTHOR]

Since the emergence of big data, the popularity of deep learning models has increased and they are being implemented in a wide range of applications, including people detection and counting in congested environments. Detecting and counting people for human behavior analysis in retail stores is a challenging research problem due to the congested and crowded environment. This paper proposes a deep learning approach for detecting and counting people in the presence of occlusions and illuminance variation in a crowded retail environment, utilizing deep CNNs (DCNNs) for semantic segmentation of top-view depth visual data. Semantic segmentation has been implemented using (DCNNs) in recent years since it is a powerful approach. The objective of this paper is to design a novel architecture that consists of an encoder–decoder architecture. We were motivated to use transfer learning to solve the problem of insufficient training data. We used ResNet50 for the encoder, and we built the decoder part as a novel contribution. Our model was trained and evaluated on the TVHeads dataset and the people counting dataset (PCDS) that are available for research purposes. It consists of depth data of people captured from a top-view RGB-D sensor. The segmentation results indicate high accuracy and demonstrate that the proposed model is robust and accurate. [ABSTRACT FROM AUTHOR]

At present, in end-to-end network combined with deep learning in stereo matching, how to perceive ample image details within an acceptable range of computational cost, so as to improve the final matching accuracy, has become a hot research topic. In this paper, we design a cascaded disparity correction network based on DispNet, which can refine the initial disparity image by combining the process output results in the trunk network. The method proposed in this paper is named ETE–DC–CNN (end to end–disparity correction–convolutional neural network). In the trunk network, the mixed dilated convolution module is employed to extract the features of the original image, and the feature image is constructed into a 3D disparity space volume through depth-separable convolution, after which the initial disparity image can be obtained through 2D encoder–decoder module. In the correction network, the gradient information of the initial feature image is combined to reconstruct the modified matching cost body guided by the initial disparity image and then a smaller encoder–decoder module is trained and processed to make the final result at the sub-pixel level. The algorithm in this paper has been verified in SceneFlow and KITTI 2012/2015 data sets. The method proposed in this article achieves 3.46, 2.12, 1.19, and 0.6 results in the non-occluded area and 4.04, 2.55, 1.58, and 0.7 results in the global area on the Er (> 2 px), Er (> 3 px), Er (> 5 px), and Epe indicators in the KITTI 2012 test set, which are higher than those of the backbone network DispNet. [ABSTRACT FROM AUTHOR]

A major research subject in recent times is Alzheimer's disease (AD) due to the growth and considerable societal impacts on health. So, the detection of AD is essential for medication care. Early detection of AD is critical for effective treatment, and monitoring the time period between normal aging's unavoidable cognitive loss and dementia's more catastrophic degradation is common practice. The deep learning method for early diagnosis and automated categorization of AD has suddenly gained a lot of attention since rapid advancement in the field of GANs approaches has now been used in the clinical research sector. Many recent studies using brain MRI images and convolutional neural networks (CNNs) to identify Alzheimer's disease have yielded promising results. Instead of adequately engaging with the lack of real data, many research papers have focused on prediction. The main purpose of this paper is to do this by generating synthetic MRI images using a series of DCGANs. This paper demonstrates the effectiveness of this concept by cascading DCGANs that imitate different stages of Alzheimer's disease and utilizing SRGANs to enhance the resolution of MRI scans. The purpose of this research is to come forward and tell if an individual might just get Alzheimer's disease. CNN, DCGANs, and SRGANs are used in this paper to present a deep learning-based approach that improves classification and prediction accuracy to 99.7% and also handles the lack of data and the resolution of data. [ABSTRACT FROM AUTHOR]

Fruit recognition and location are the premises of robot automatic picking. YOLOv3 has been used to detect different fruits in complex environment. However, for the object with definite features, the complex network structure will increase the computing time and may cause overfitting. Therefore, this paper has carried out a lightweight design for the YOLOv3. This paper proposed an improved T-Net to detect tomato images. Firstly, the T-Net reduces the residual network layers. This paper changed the number of cycles in each group of the residual unit to 1, 2, 2, 1, and 1. Second, two feature layers with different scales are selected according to the features of tomatoes. Meanwhile, the convolutional layer at the neck has been reduced by two layers. Finally, the location and approximate diameter of the ripe tomato are obtained by combining the node information of the Intel D435i camera and T-Net in the Robot Operation System. T-Net obtains mean average precision (mAP) of 99.2%, F1-score of 98.9%, precision of 99.0%, and recall of 98.8% at a detection rate of 104.2 FPS. The proposed T-Net has outperformed the YOLOv3 with 0.4%, 0.1%, and 0.2% increase in precision, mAP, and F1-score. The detection speed of T-Net is 1.8 times faster than YOLOv3. The mean errors of the center coordinates and diameter of the tomato are 8.5 mm and 2.5 mm, respectively. This model provides a method for efficient real-time detection and location of tomatoes. [ABSTRACT FROM AUTHOR]

Context: With the union of machine learning (ML) and quantum chemistry, amid the debate between machine-learned functionals and human-designed functionals in density functional theory (DFT), this paper aims to demonstrate the generation of potential energy surfaces using computations with machine-learned density functional approximation (ML-DFA). A recent research trend is the application of ML in quantum sciences in the design of density functionals such as DeepMind's Deep Learning model (DeepMind21, DM21). Though science reported the state-of-the-art performance of DM21, the opportunity to utilize DeepMind's pretrained DM21 neural networks in computations in quantum chemistry has not yet been tapped. So far in the literature, the Deep Learning density functionals (DM21) have not been applied to generate potential energy surfaces. While the superior accuracy of DM21 has been reported, there is still a scarcity of publications that apply DM21 in calculations in the field. In this context, for the first time in literature, neural density functionals inferring 2D potential energy surfaces (ML-DFA-PES) based on machine-learned DFA-based computational method is contributed in this paper. This paper reports the ML-DFA-generated PES for C4H8, H2O, H2, and H2+ by employing a pretrained DM21m TensorFlow model with cc-pVDZ basis set. In addition, we also analyze the long-range behavior of DM21 based PES to investigate the ability to describe a system at long ranges. Furthermore, we compare PES diagrams from DM21 with popular DFT functionals (b3lyp/ PW6B95) and CCSD(T). Methods: In this method, 2D potential energy surfaces are obtained using a method that relies upon the neural network's ability to accurately learn the mapping between 3D electron density and exchange–correlation potential. By inserting Deep Learning inference in DFT with a pretrained neural network, self-consistent field (SCF) energy at different geometries along the coordinates of interest is computed, and then, potential energy surfaces are plotted. In this method, first, the electron density is computed mathematically, and this computed 3D electron density is used as a ML feature vector to predict the exchange correlation potential as a ML inference computed by a forward pass of pre-trained DM21 TensorFlow computational graph, followed by the computation of self-consistent field energy at multiple geometries, and then, SCF energies at different bond lengths/angles are plotted as 2D PES. We implement this in a python source code using frameworks such as PySCF and DM21. This paper contributes this implementation in open source. The source code and DM21-DFA-based PES are contributed at https://sites.google.com/view/MLfunctionals-DeepMind-PES. [ABSTRACT FROM AUTHOR]

Forecasting of load is essential for operating power systems. India recently witnessed one of the worst power crisis with the highest ever power demand of 207 GW on April 29, 2022. The demand in the month of May and June 2022 was estimated to reach 215 GW. The peak demand this year 2023, according to the electricity ministry, is predicted to be around 230 GW from April to June. The inability to meet certain fundamental issues as power can take a toll on any country's economy. Proper prediction helps in proper decision making and planning. The main objective of this paper is to predict day ahead electrical load demand for Assam. Statistical and Machine Learning Algorithms has been studied. The study has been carried out using real-time data for the years 2016, 2017 and 2018. The paper presents a detailed analysis of the different hyper parameters of the deep learning models and their effect is seen on the learning efficiency. A novel stacked forecasting model is proposed using neural networks as base learners and CatBoost as the meta-learner. The performance of the proposed model has been evaluated and compared with individual models in terms of training time and accuracy using different error metrics namely MAE, MSE, RMSE, MAPE and R2 score. A comparison of the proposed prediction model with the prediction models available in literature has been presented. The conclusion states that both the statistical and machine learning algorithms used in this study act as useful tools for daily load forecasting with considerable accuracy; yet machine learning algorithm outperforms the statistical methods. The entire work has been done in Google Colaboratory using Python as the programming language. [ABSTRACT FROM AUTHOR]

Phishing evolves rapidly nowadays, causing much damage to finance, brand reputation, and privacy. Various phishing detection methods have been proposed along with the rise of phishing, but there are still research issues. Phishing websites mainly steal users’ information through visual deception and deep learning methods have been proved very effective in computer vision applications but there is a lack in the research on visual analysis using deep learning algorithms. Moreover, most research use balanced datasets, which is not the case in a real Web environment. Therefore, this paper proposes a security indicator area (SIA) which contains most security indicators that are designed to help users identify phishing sites. The proposed method then takes screenshots of SIA and uses a convolutional neural network (CNN) as a classifier. To prove the efficiency of the proposed method, this paper carries out several comparative experiments on an unbalanced dataset with much fewer phishing sites, which increases detection difficulty but also makes the detection closer to reality. The results show that the proposed method achieves the highest F1-score among the compared methods, while providing advantages on detection efficiency and data expansibility in phishing detection. [ABSTRACT FROM AUTHOR]

In the process of calisthenics training, athletes' movements need to be monitored and analyzed. The traditional monitoring method has the problem of insufficient resolution, which limits the improvement of accuracy and reliability. In this paper, a high dimensional image super resolution model is developed by using infrared spectral imaging technology to improve the monitoring and simulation results in the process of aerobics training. In this paper, infrared spectral imaging technology combined with deep learning algorithm is used to design a high dimensional image super resolution model. Infrared spectral imaging data were collected during aerobics training, and the data were trained and learned to extract features and realize super-resolution reconstruction. Finally, the model is tested and verified to evaluate its monitoring and simulation effect in aerobics training. The experimental results show that the high-dimensional image super resolution model has good monitoring and simulation effects in aerobics training. By increasing the detail and clarity of the image, the model can provide more accurate motion analysis and motion suggestions, so as to help the trainer improve the movement skills and improve the training effect. [ABSTRACT FROM AUTHOR]

When traditional EEG signals are collected based on the Nyquist theorem, long-time recordings of EEG signals will produce a large amount of data. At the same time, limited bandwidth, end-to-end delay, and memory space will bring great pressure on the effective transmission of data. The birth of compressed sensing alleviates this transmission pressure. However, using an iterative compressed sensing reconstruction algorithm for EEG signal reconstruction faces complex calculation problems and slow data processing speed, limiting the application of compressed sensing in EEG signal rapid monitoring systems. As such, this paper presents a non-iterative and fast algorithm for reconstructing EEG signals using compressed sensing and deep learning techniques. This algorithm uses the improved residual network model, extracts the feature information of the EEG signal by one-dimensional dilated convolution, directly learns the nonlinear mapping relationship between the measured value and the original signal, and can quickly and accurately reconstruct the EEG signal. The method proposed in this paper has been verified by simulation on the open BCI contest dataset. Overall, it is proved that the proposed method has higher reconstruction accuracy and faster reconstruction speed than the traditional CS reconstruction algorithm and the existing deep learning reconstruction algorithm. In addition, it can realize the rapid reconstruction of EEG signals. [ABSTRACT FROM AUTHOR]

This paper presents an intelligent healthcare framework by incorporating modern computing technologies like machine learning and deep learning. The sole motivation of this paper is to predict diabetes status intelligently so that patients can be made aware of their diabetes status regularly. A novel ensemble machine learning-based diabetes prediction framework, namely "iDP", has been proposed in this paper. Six different machine learning approaches have been used for the iDP framework, namely random forest, decision tree, neural network, AdaBoost, support vector machine, and XGBoost. Training and testing of ensemble modeling have been performed based on these learning techniques. A comprehensive preliminary data analysis and screening of statistical analysis have been systematically demonstrated in this paper. The recursive feature elimination and fivefold cross-validation methods have been used to select the best model. All experiments have been performed using R-Studio 1.2.5 with the help of the Rattle library 5.4.0. The preliminary data analytic and Pearson correlation coefficient values have been computed to verify the linearity relationship among the data. Results have been reported in eight performance metrics, including accuracy, specificity, sensitivity, area under curve, area under convex hull, minimum error rate, minimum weighted loss, and precision. The proposed iDP framework improves the results on different aspects in order to compare them with individual learning approaches. Despite this, a comparative performance analysis of the iDP framework has also been performed with state-of-the-art prevailing models. As per experiment, the iDP framework gives better results in most cases, like accuracy: 95.26%, AUC: 91.15%, sensitivity: 96.81%, specificity: 97.72% and precision: 90.72%. [ABSTRACT FROM AUTHOR]

The number of papers on machine learning and deep neural networks applied to intrusion detection systems (IDS) is ever-increasing. Differently from existing work on the topic, this paper explores the effect of training-time randomness of deep neural networks, which is overlooked by the related literature. Training-time randomness is regulated by the seed of the pseudorandom number generator, and affects the performance of IDS models. The seed selection is studied in conjunction with other critical learning parameters: to the best of our knowledge, there are no similar studies in IDS. The experiments are done with a recent and widely consolidated intrusion detection benchmark, which is used to train and test a neural network under different combinations of seeds and parameters both in supervised and semi-supervised learning modes. The results are inferred by a mixture of explorative analysis, design of experiments, and analysis of variance. According to the results, the choice of the seed yields either excellent or scarce detection metrics; more importantly, the seed selection might be as relevant as the other major learning parameters assessed. [ABSTRACT FROM AUTHOR]

Automated software transformations and the process of automated program repair and improvement are an important aspect of modern software engineering practices. In this paper, we describe a system which uses a graph-based deep learning model that can be trained to automatically transform and improve computer programs. By operating on language-agnostic, universal graph-like structures easily extractable from source code files (abstract syntax trees), the deep learning agent learns which transformations should be effectively applied to various structures recognized in the source code in order to improve it. By defining a metric which we want to improve and introducing an optimization task—a reinforcement learning setting, an agent learns to automatically apply a chain of transformations to the program, drastically improving it. While similar program improvement processes exist, they exclusively use exhaustive search algorithms to try all the possible code transformations which is a long process susceptible to local optimum issues. Our solution aims to model and embed structural knowledge about the programs being transformed which greatly helps the agent to choose best possible code transformations to apply. Elements of the approach we present in this paper are further applicable not just to automatic software improvement tasks, but also to other code-related tasks. [ABSTRACT FROM AUTHOR]

With the rapid development of information transfer technology and the influence of complex electromagnetic environment, the signal components in communication systems are becoming more and more complex, and the spectrum congestion is further aggravated, which seriously affects the performance of communication systems. Single-channel blind source separation technology is an effective solution, but the existing algorithms are deficient in terms of estimation accuracy, time delay and computational complexity. Based on the powerful feature extraction capability and timing signal processing capability of deep learning, this paper proposes an end-to-end time-domain blind separation convolutional network structure, including three parts: encoder, separation module and decoder. The attention mechanism module is also introduced into the encoding layer of the network to enhance the deep feature extraction ability of the network, highlight the influence of important timing features of communication signals, further improve the separation performance and enhance the practicality of the network. The experimental results show that the algorithm has superior performance and can effectively separate the mixed communication signal of various modulation types, and it can also extract own-side communication signals from high-power masked signals. Compared with the existing algorithms, the network in this paper has high separation accuracy and low computational complexity, which breaks the bottleneck of traditional single-channel blind separation algorithms in complex communication electromagnetic environment. [ABSTRACT FROM AUTHOR]