Search

The explosive growth of geospatial data is increasing requirements for automatic and efficient data learning abilities. Many deep learning methods have been widely applied for geospatial data understanding tasks, such as road networks and geospatial object detection. However, the demands for more accurate learning of high-level features require the use of deeper neural networks. To further improve the learning efficiency of deep neural networks, in this paper, we propose an improved convolutional neural network named EDense. First, we use its dense connectivity to integrate a CNN with an extreme learning machine. Then, we expand the kernels in the convolutional layers to increase the width of the network model. Furthermore, we propose one-feature EDense (OF-EDense), which is a simplified version of EDense, to fit conditions in which the number of parameters is strictly limited. Finally, the experimental results fully demonstrate the strong learning ability and high learning efficiency of EDense. [ABSTRACT FROM AUTHOR]

The number of deep learning (DL) layers increases, and following the performance of computing nodes improvement, the output accuracy of deep neural networks (DNN) faces a bottleneck problem. The resident network (RN) based DNN model was applied to address these issues recently. This paper improved the RN and developed a rectified linear unit (ReLU) based conditional generative adversarial nets (cGAN) to classify plantar pressure images. A foot scan system collected the plantar pressure images, in which normal (N), planus (PL), and talipes equinovarus feet (TE) data-sets were acquired subsequently. The 9-foot types named N, PL, TE, N-PL, N-TE, PL-N, PL-TE, TE-N, and TE-PL were classified using the proposed DNN models, named resident network-based conditional generative adversarial nets (RNcGAN). It improved the RN structure firstly and the cGAN system hereafter. In the classification of plantar pressure images, the pixel-level state matrix can be direct as an input, different from the previous image classification task with image reduction and feature extraction. cGAN can directly output the pixels of the image without any simplification. Finally, the model achieved better results in the evaluation indicators of accuracy (AC), sensitivity (SE), and F1-measurement (F1) by comparing to artificial neural networks (ANN), k-nearest neighbor (kNN), Fast Region-based Convolution Neural Network (Fast R-CNN), visual geometry group (VGG16), scaled-conjugate-gradient convolution neural networks (SCG-CNN), GoogleNet, AlexNet, ResNet-50–177, and Inception-v3. The final prediction of class accuracy is 95.17%. Foot type classification is vital for producing comfortable shoes in the industry. [ABSTRACT FROM AUTHOR]

Molecular property prediction (MPP) is vital in drug discovery and drug reposition. Deep learning-based MPP models capture molecular property-related features from various molecule representations. In this paper, we propose a molecule sequence embedding and prediction model facing with MPP task. We pre-trained a bi-directional encoder representations from Transformers (BERT) encoder to obtain the semantic representation of compound fingerprints, called Fingerprints-BERT (FP-BERT), in a self-supervised learning manner. Then, the encoded molecular representation by the FP-BERT is input to the convolutional neural network (CNN) to extract higher-level abstract features, and the predicted properties of the molecule are finally obtained through fully connected layer for distinct classification or regression MPP tasks. Comparison with the baselines shows that the proposed model achieves high prediction performance on all of the classification tasks and regression tasks. [ABSTRACT FROM AUTHOR]

Forecasting has always been the backbone of planning studies in the power system. With the advent of the restructured power system and also the integration of renewable energy sources, it has become more challenging. Accurate load forecasting leads to a reduction in supply–demand mismatch, whereas solar insolation/wind speed forecasting improves generation side planning. With the rapid growth in computer-based intelligence, self-learning mechanisms together with continuously growing volume of the dataset and affordable cost-effective data storage options, deep learning performance keeps getting better and has made a huge impact to solve the complex problems associated with the power system network. In this paper, we propose a classical long short-term memory neural network model for a combined day-ahead load and solar insolation forecasting of residential consumers equipped with rooftop PV based on weather classification. The effectiveness of the proposed model based on mean absolute error, mean bias error and coefficient of correlation (R-Squared) is compared with that of the standard artificial neural network and convolutional neural network models. [ABSTRACT FROM AUTHOR]

This paper introduces a novel deep learning approach for generating fine resolution structures that preserve all the information from the topology optimization (TO). The proposed approach utilizes neural networks (NNs) that map the desired engineering properties to seed for determining optimized structure. The main novelty of this framework is the utilization of parameters such as density and nodal deflections to predict optimized topologies for a wide range of design space. In this research, a three-stage NN framework is employed, wherein the first stage is a feedforward deep neural network. The second stage uses a convolutional neural network (CNN), and the final stage is the post-processing of results obtained from CNN. The first stage maps input design variables vector to output density distribution image. The image output of the first stage and design variables vector inputted to the first network serve as inputs to the second stage, which outputs optimized structure. Finally, post-processing of this optimized structure is done to ensure volume fraction constraint and optimal solution. These structures can be tessellated per the nodal displacement of an FEA solved larger structure. Because of this framework, the proposed approach makes TO computations faster and captures essential physics while using NNs to determine the final structure. The application of the proposed model to three-dimensional problems is also demonstrated. [ABSTRACT FROM AUTHOR]