Search

Power line inspection is an important means to eliminate hidden dangers of power lines. It is a difficult research problem how to solve the low accuracy of power line inspection based on deep neural network (DNN) due to the problems of multi‐view‐shape, small‐size object. In this paper, an automatic detection model based on Feature visual clustering network (FVCNet) for power line inspection is established. First, an unsupervised clustering method for power line inspection is proposed, and applied to construct a detection model which can recognize multi‐view‐shape objects and enhanced object features. Then, the bilinear interpolation method is used to Feature enhancement method, and the enhanced high‐level semantics and low‐level semantics are fused to solve the problems of small object size and single sample. In this paper, FVCNet is applied to the MS‐COCO 2017 data set and self‐made power line inspection data set, and the test accuracy is increased to 61.2% and 82.0%, respectively. Compared with other models, especially for the categories that are greatly affected by multi‐view‐shape, the test accuracy has been improved significantly. [ABSTRACT FROM AUTHOR]

This paper trains a multilayered neural network (MLNN) for solving fractional delay differential equations (FDDEs), including nonlinear and singular types. The proposed methodology involves replacing the unknown functions in the equations with a truncated power series expansion. Subsequently, a collection of algebraic equations is solved utilizing an iterative minimization technique that leverages the capabilities of the MLNN architecture. The outcomes demonstrate that the MLNN architecture provides the required accuracy and strong stability compared to several numerical methods. [ABSTRACT FROM AUTHOR]

The driver authority decision for driver‐initiated takeover is closely related to vehicle driving safety. In this paper, a lateral driver‐automation driver authority decision method considering the safety of the intended functionality is proposed to improve vehicle driving safety. Based on systems‐theoretic processes analysis, functional safety analysis of driver initiative takeover is carried out to clarify the safety of the intended functionality issues caused by the unreasonable decision. Then, a method for defining the safe driving area is developed to assess the safety level of the driving area around the ego vehicle. Taking the driver‐vehicle state parameters and vehicle–vehicle state parameters as input, a deep neural network model is constructed to determine the intention of the driver to take over the vehicle. The lateral driver‐automation driver authority decision method is designed to make the driver‐machine take‐over decisions, which considers the safety of the intended functionality. The effectiveness of the proposed method is evaluated via numerical simulation and hardware‐in‐the‐loop experiments. The results show that the designed method not only improves the control ability of the driver to the maximum extent but also integrates the perception ability of the driver into the vehicle control system to improve further vehicle driving safety. [ABSTRACT FROM AUTHOR]

Many test coverage metrics have been proposed to measure the deep neural network (DNN) testing effectiveness, including structural coverage and nonstructural coverage. These test coverage metrics are proposed based on the fundamental assumption: They are correlated with test effectiveness. However, the fundamental assumption is still not validated sufficiently and reasonably, which brings question on the usefulness of DNN test coverage. This paper conducted a revisiting study on the existing DNN test coverage from the test effectiveness perspective, to effectively validate the fundamental assumption. Here, we carefully considered the diversity of subjects, three test effectiveness criteria, and both typical and state‐of‐the‐art test coverage metrics. Different from all the existing studies that deliver negative conclusions on the usefulness of existing DNN test coverage, we identified some positive conclusions on their usefulness from the test effectiveness perspective. In particular, we found the complementary relationship between structural and nonstructural coverage and identified the practical usage scenarios and promising research directions for these existing test coverage metrics. [ABSTRACT FROM AUTHOR]

In this paper, the geometry factors of mode I and mode II (YI and YII) and the normalized T‐stress (T*) of the centrally cracked Brazilian disk specimen are predicted using a deep learning approach. Three deep neural networks are developed to model the relationship between the crack angle (α) and the ratio of half the crack length to the radius (a/R) as input variables and each of YI, YII, and T* as output variables. Three independent databases consisting of 174, 174, and 117 data points are prepared for YI, YII, and T*, respectively, from the previous works to train, generalize, and validate the deep neural networks. Finally, sensitivity analysis of YI, YII, and T* to α and a/R is conducted, and mathematical models are obtained using the partial dependence plots, which can be used in the optimization of stress intensity factors and T‐stress of the cracked Brazilian disk specimens with different dimensions. Highlights: Three analytical databases are prepared for YI, YII, and T*.Three independent DNN models are developed for predicting YI, YII, and T* of the BD specimen.The sensitivity of YI, YII, and T* to the α and a/R are evaluated using PDP analysis.The mathematical relationship between α and a/R, and YI, YII, and T* are obtained. [ABSTRACT FROM AUTHOR]

Concrete which is the most commercialized construction material and thus it plays a key role in this era of development and hence its evolution is of utmost importance and therefore the evolution of the quality of concrete to that of its highly evolved type namely, ultra‐high performance concrete (UHPC) is undeniably the boon to this sector. Though, the correlations between the technical characteristics of UHPC and the composition of its mixture are complicated, nonlinear, and complex to characterize using standard statistical techniques. This paper is intended to use both deep neural network and ensemble machine learning algorithms namely gradient boosting, extreme gradient boosting, random forest regressor, extra tree regressor, and voting regressor trained with an 810 UHPC mixture collections with 15 input variables to predict its compressive strength. After adjusting a regression model, the prediction efficiency and generalization ability of the developed models are validated using a number of performance parameters. It was established that all employed models performed better at forecasting result, the extra tree regressor was the most accurate followed by extreme gradient boosting. [ABSTRACT FROM AUTHOR]

Deep neural network (DNN) surrogates of expensive physics simulations are enabling a rapid change in the way that common experimental design and analysis tasks are approached. Surrogate models allow simulations to be performed in parallel and separately from downstream tasks, thereby enabling analyses that would be impossible with the simulation in‐the‐loop; surrogates based on DNNs can effectively emulate diverse non‐scalar data of the types collected in fusion and laboratory‐astrophysics experiments. The challenge is in training the surrogate model, for which large ensembles of physics simulations must be run, preferably without wasting computational effort on uninteresting simulations. In this paper, we present an iterative sampling scheme that can preferentially propose simulations in interesting regions of parameter space without neglecting unexplored regions, allowing high‐quality and wide‐ranging surrogate models to be trained using 2–3 times fewer simulations compare to space‐filling designs. Our approach uses an explicit importance function defined on the simulation output space, balanced against a measure of simulation density which serves as a proxy for surrogate accuracy. It is easy to implement and can be tuned to find interesting simulations early in the study, allowing surrogates to be trained quickly and refined as new simulations become available; this represents an important step towards the routine generation of deep surrogate models quickly enough to be truly relevant to experimental work. [ABSTRACT FROM AUTHOR]

World's science and technologies have been challenged by the COVID‐19 pandemic. Each and every community across the globe are trying to find a real‐time novel method for accurate treatment and cure of COVID‐19 infected patients. The most important lead to take from this pandemic is to detect the infected patients as soon as possible and provide them an accurate treatment. At present, the worldwide methodology to detect COVID‐19 is reverse transcription‐polymerase chain reaction (RT‐PCR). This technique is costly and time taking. For this reason, the implementation of a novel method is required. This paper includes the use of deep learning analysis to develop a system for identifying COVID‐19 patients. Proposed technique is based on convolution neural network (CNN) and deep neural network (DNN). This paper proposes two models, first is designing DNN on the basis of fractal feature of the images and second is designing CNN using lungs x‐ray images. To find the infected area (tissues) of the lungs image using CNN architecture, segmentation process has been used. Developed CNN architecture gave results of classification with accuracy equal to 94.6% and sensitivity equal to 90.5% which is much better than the proposed DNN method, which gave accuracy 84.11% and sensitivity 84.7%. The outcome of the presented model shows 94.6% accuracy in detecting infected regions. Using this method the growth of the infected regions can be monitored and controlled. The designed model can also be used in post‐COVID‐19 analysis. [ABSTRACT FROM AUTHOR]

Given the difficult of experimental determination, quantitative structure–property relationship (QSPR) and deep learning (DL) provide an important tool to predict physicochemical property of chemical compounds. In this paper, partial least squares (PLS), genetic function approximation (GFA), and deep neural network (DNN) were used to predict the Lee retention index (Lee‐RI) of PAHs in SE‐52 and DB‐5 stationary phases. Four molecular descriptors, molecular weight (MW), quantitative estimate of drug‐likeness (QED), atomic charge weighted negative surface area (Jurs_PNSA_3), and relative negative charge (Jurs_RNCG) were selected to construct regression models based on genetic algorithm. For SE‐52, PLS model showed best prediction power, followed by DNN and GFA. The relative error (RE), root mean square error (RMSE), and regression coefficient (R2) of best PLS regression model are 1.228%, 5.407, and 0.980. For DB‐5, DNN model showed best prediction power, followed by GFA and PLS. The RE, RMSE and R2 of best DNN regression model for DB‐5‐1 and DB‐5‐2 are 1.058%, 4.325%, 0.976%, 0.821%, 3.795%, and 0.970%, respectively. The three regression models not only show good predictive ability, but also highlight the stability and ductility of the models. [ABSTRACT FROM AUTHOR]

The detection of mathematical expressions is a prerequisite step for the digitisation of scientific documents. Many different multistage approaches have been proposed for the detection of expressions in document images, that is, page segmentation and expression detection. However, the detection accuracy of such methods still needs improvement owing to errors in the page segmentation of complex documents. This paper presents an end‐to‐end framework for mathematical expression detection in scientific document images without requiring optical character recognition (OCR) or document analysis techniques applied in conventional methods. The novelty of this paper is twofold. First, because document images are usually in binary form, the direct use of these images, which lack texture information as input for detection networks, may lead to an incorrect detection. Therefore, we propose the application of a distance transform to obtain a discriminating and meaningful representation of mathematical expressions in document images. Second, the transformed images are fed into the faster region with a convolutional neural network (Faster R‐CNN) optimized to improve the accuracy of the detection. The proposed framework was tested on two benchmark data sets (Marmot and GTDB). Compared with the original Faster R‐CNN, the proposed network improves the accuracies of detection of isolated and inline expressions by 5.09% and 3.40%, respectfully, on the Marmot data set, whereas those on the GTDB data set are improved by 4.04% and 4.55%. A performance comparison with conventional methods shows the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

High‐dimensional classification is a fundamentally important research problem in high‐dimensional data analysis. In this paper, we derive a nonasymptotic rate for the minimax excess misclassification risk when feature dimension exponentially diverges with the sample size and the Bayes classifier possesses a complicated modular structure. We also show that classifiers based on deep neural networks can attain the above rate, hence, are minimax optimal. [ABSTRACT FROM AUTHOR]

The syndrome called COVID‐19 which was firstly spread in Wuhan, China has already been declared a globally "Pandemic." To stymie the further spread of the virus at an early stage, detection needs to be done. Artificial Intelligence‐based deep learning models have gained much popularity in the detection of many diseases within the confines of biomedical sciences. In this paper, a deep neural network‐based "LiteCovidNet" model is proposed that detects COVID‐19 cases as the binary class (COVID‐19, Normal) and the multi‐class (COVID‐19, Normal, Pneumonia) bifurcated based on chest X‐ray images of the infected persons. An accuracy of 100% and 98.82% is achieved for binary and multi‐class classification respectively which is competitive performance as compared to the other recent related studies. Hence, our methodology can be used by health professionals to validate the detection of COVID‐19 infected patients at an early stage with convenient cost and better accuracy. [ABSTRACT FROM AUTHOR]

Purpose: Fetal head circumference (HC) is an important biometric parameter that can be used to assess fetal development in obstetric clinical practice. Most of the existing methods use deep neural network to accomplish the task of automatic fetal HC measurement from two‐dimensional ultrasound images, and some of them achieved relatively high prediction accuracy. However, few of these methods focused on optimizing model efficiency performance. Our purpose is to develop a more efficient approach for this task, which could help doctors measure HC faster and would be more suitable for deployment on devices with scarce computing resources. Methods: In this paper, we present a very lightweight deep convolutional neural network to achieve automatic fetal head segmentation from ultrasound images. By using sequential prediction network architecture, the proposed model could perform much faster inference while maintaining a high prediction accuracy. In addition, we used depthwise separable convolution to replace part of the standard convolution in the network and shrunk the input image to further improve model efficiency. After getting fetal head segmentation results, post‐processing, including morphological processing and least‐squares ellipse fitting, was applied to obtain the fetal HC. All experiments in this work were performed on a public dataset, HC18, with 999 fetal ultrasound images for training and 335 for testing. The dataset is publicly available on https://hc18.grand‐challenge.org/ and the code for our method is also publicly available on https://github.com/ApeMocker/CSM‐for‐fetal‐HC‐measurement. Results: Our model has only 0.13 million [M] parameters and can achieve an inference speed of 28 [ms] per frame on a CPU and 0.194 [ms] per frame on a GPU, which far exceeds all existing deep learning‐based models as far as we know. Experimental results showed that the method achieved a mean absolute difference of 1.97(± 1.89) [mm] and a Dice similarity coefficient of 97.61(± 1.72) [%] on HC18 test set, which were comparable to the state of the art. Conclusion: We presented a very lightweight deep learning‐based model to realize fast and accurate fetal head segmentation from two‐dimensional ultrasound image, which is then used for calculating the fetal HC. The proposed method could help obstetricians measure the fetal HC more efficiently with high accuracy, and has the potential to be applied to the situations where computing resources are relatively scarce. [ABSTRACT FROM AUTHOR]

Summary: Multiple‐input multiple‐output (MIMO) technology is much significant for achieving high data rates while considering the multiuser communication. For this purpose, the estimation of Channel State Information (CSI) is performed by the pilot. But, the estimated CSI cannot be applied for downlinks while processing an extremely high speed mobile data as it gets outdated because of the rapid channel variation. Estimating the channel in the MIMO systems is highly difficult on using non‐stationary channel characteristics under the high mobility environments. Channel estimation with received signal‐to‐noise ratio (SNR) feedback ensures an effective performance in the practical wireless MIMO systems. This paper plans to develop an intelligent deep learning strategy to solve the channel estimation problem in MIMO system. The main goal of the proposed model is to estimate the MIMO channel coefficients at a transmitter based on the received SNR feedback information from a receiver using the swarm intelligence‐based deep ensemble learning machine (SI‐DELM). For both the scenarios, the SI‐DELM is developed, in which the convolution neural network (NN) with three classifiers is used. Here, the fully connected layers of CNN are replaced by the NN, recurrent neural network (RNN), and deep neural network (DNN). In the SI‐DEL‐based channel estimation, the hyper parameter tuning is performed by the adaptive iteration assisted mixture ratio‐based cat swarm optimization (AIMR‐CSO) for minimizing the mean square error (MSE) and bit error rate (BER) of the estimated channel. Finally, by performing numerical simulations, the efficiency and better performance of the suggested model is revealed by conducting the comparison between proposed and conventional models. [ABSTRACT FROM AUTHOR]

Automatic and robust target depth estimation is an important issue of an active detection system working in the reliable acoustic path (RAP) environment. In this paper, the target depth‐sensitive acoustic interference structure is used as input, and a deep neural network (DNN) method is proposed to realize automatic depth estimation. Furthermore, to improve the robustness of the network, both the sound speed profile (SSP) uncertainty and the target trajectory uncertainty are considered in the training dataset. The former is modelled as a random weighted sum of the empirical orthogonal function (EOF), and the latter is modelled by the partial‐data‐lacking of the network input. The method was evaluated through simulated data and compared with the conventional method of matching the measured interference structure with the replicas. The presented method exhibits a higher accuracy of depth estimate in uncertain environments when the signal‐to‐noise ratio (SNR) is higher than −6 dB, but its performance deteriorates rapidly as the SNR decreases further. The method is also verified by semi‐simulation with experimental data in deep water. [ABSTRACT FROM AUTHOR]

Spintronic devices are considered as one of the most promising technologies for non‐volatile memory and computing. However, two crucial drawbacks, that is, lack of intrinsic multi‐level operation and low on/off ratio, greatly hinder their further application for advanced computing concepts, such as deep neural network (DNN) accelerator. In this paper, a spintronic multi‐level memory unit with high on/off ratio is proposed by integrating several series‐connected magnetic tunnel junctions (MTJs) with perpendicular magnetic anisotropy (PMA) and a Schottky diode in parallel. Due to the rectification effect on the PMA MTJ, an on/off ratio over 100, two orders of magnitude higher than intrinsic values, is obtained under proper proportion of alternating current and direct current. Multiple resistance states are stably achieved and can be reconfigured by spin transfer torque effect. A computing‐in‐memory architecture based DNN accelerator for image classification with the experimental parameters of this proposal to evidence its application potential is also evaluated. This work can satisfy the rigorous requirements of DNN for memory unit and promote the development of high‐accuracy and robust artificial intelligence applications. [ABSTRACT FROM AUTHOR]

Visual interpretation of chest X‐rays (CXRs) is tedious and prone to error. Significant amount of time is spent by the radiologist in differentiating normal from abnormal CXRs and in identifying the location and type of abnormalities. An assistance tool for automatically classifying normal and different types of abnormal CXRs can facilitate the diagnosis and potentially save time costs. In this paper, a novel hybrid model having concatenation of Visual Geometry Group (VGG19) network and Entropy features as a modified deep convolutional neural network (DCNN) architecture, called VEntNet, is proposed for the automated multi‐class categorization of CXR images into normal, coronavirus disease (COVID), tuberculosis (TB), viral pneumonia, and bacterial pneumonia. The VEntNet model implemented consists of deep features extraction from convolutional layers of VGG19 network which are then concatenated with hand‐crafted entropy features extracted from CXRs. The concatenated features are then fed to the fully connected (FC) layers for performing multi‐class categorization using Softmax activation function. The performance of proposed VEntNet model is compared with other DCNNs with and without the hybrid approach for categorization of closely related lung pathologies and normal CXR images. Our proposed VEntNet achieved accuracies of 98.78% and 90.96%, respectively, for four and five‐class classification of CXRs. Thus, it is demonstrated that among the different DCNNs, our VEntNet outperformed in four‐class CXR categorization tasks. The proposed model can potentially save time by facilitating the screening of CXRs to identify those with abnormalities present as well as to categorize the abnormalities. [ABSTRACT FROM AUTHOR]

This paper proposes an efficient method for photovoltaic (PV) system output forecasting by deep Boltzmann machines (DBM) with scatter search‐predator‐prey brain storm optimization (SS‐PPBSO). DBM plays a key role to extract features of input variables while SS‐PPBSO is a new evolutionary computation that combines PPBSO with scatter search. In recent years, as renewable energy, PV systems are positively introduced into power network in Japan so that power system operation becomes complicated due to the uncertainty. To overcome this challenge, it is required to forecast PV outputs that are influenced by weather conditions significantly. This paper proposes a new efficient PV output forecasting method with DBM that makes use of SS‐PPBSO in learning. The effectiveness of the proposed method is demonstrated for real data of a PV system. [ABSTRACT FROM AUTHOR]

Modeling and simulating a power distribution network (PDN) for printed circuit boards with irregular board shapes and multi‐layer stackup is computationally inefficient using full‐wave simulations. This paper presents a new concept of using deep learning for PDN impedance prediction. A boundary element method (BEM) is applied to efficiently calculate the impedance for arbitrary board shape and stackup. Then over one million boards with different shapes, stackup, integrated circuits (IC) location, and decap placement are randomly generated to train a deep neural network (DNN). The trained DNN can predict the impedance accurately for new board configurations that have not been used for training. The consumed time using the trained DNN is only 0.1 s, which is over 100 times faster than the BEM method and 10 000 times faster than full‐wave simulations. [ABSTRACT FROM AUTHOR]

The healthcare technologies in COVID‐19 pandemic had grown immensely in various domains. Blockchain technology is one such turnkey technology, which is transforming the data securely; to store electronic health records (EHRs), develop deep learning algorithms, access the data, process the data between physicians and patients to access the EHRs in the form of distributed ledgers. Blockchain technology is also made to supply the data in the cloud and contact the huge amount of healthcare data, which is difficult and complex to process. As the complexity in the analysis of data is increasing day by day, it has become essential to minimize the risk of data complexity. This paper supports deep neural network (DNN) analysis in healthcare and COVID‐19 pandemic and gives the smart contract procedure, to identify the feature extracted data (FED) from the existing data. At the same time, the innovation will be useful to analyse future diseases. The proposed method also analyze the existing diseases which had been reported and it is extremely useful to guide physicians in providing appropriate treatment and save lives. To achieve this, the massive data is integrated using Python scripting language under various libraries to perform a wide range of medical and healthcare functions to infer knowledge that assists in the diagnosis of major diseases such as heart disease, blood cancer, gastric and COVID‐19. [ABSTRACT FROM AUTHOR]

Fouling degrades the thermal and hydraulic performances of the heat exchanger (HE), leading to failure if undetected. It occurs due to the accumulation of undesired material on the heat transfer surface. Knowledge about the HE fouling dynamics is required to plan mitigation strategies, ensuring a sustainable and safe operation. This paper aims to propose a feature‐based technique to predict the fouling status of the HE based on historical data. Three thermal and two hydraulic features are extracted from the HE. Random forest (RF) is employed to detect the dominant features using the Gini index. These dominant features are used to predict the fouling resistance using a deep neural network based on the Long Short‐Term Memory (LSTM) model. Also, these dominant features provide reliable inferences to reason out the fouling dynamics. A diagnostic flag is derived based on the dominant feature and is used to diagnose the ongoing fouling phenomena, which is vital to formulate mitigation. The proposed technique is investigated on the data acquired from the HEs used in a thermal power plant (Case 1) and petroleum refinery (Case 2). Prediction accuracy of 99% and 97% is observed for Cases 1 and 2, respectively. Experimental results illustrate that RF enables the LSTM to achieve faster training and reliable prediction of fouling. [ABSTRACT FROM AUTHOR]

Predicting the performance of thermoelectric generators (TEGs) is an essential part of designing high‐performance TEGs. However, due to the complexity of the TEG system, the existing methods are either time‐consuming or not precise enough, inconvenient for device optimization. In this paper, the deep learning (DL) method to fast and accurately get the performance of TEG devices is presented. First, the key features of a typical TEG device are captured and the training dataset is prepared based on the extracted features and finite element simulations. Next, a proper deep neural network architecture is acquired and the model is trained to converge at a low loss. Finally, the experimental data is used to validate the generalization ability of the presented model. Besides, the device optimization based on the DL solution is performed and an output power enhancement of up to 182% is achieved for the authors' sample module. The presented DL solution thus can be well applied in designing or optimizing high‐performance TEGs. Furthermore, the established framework also sheds considerable light on applying the DL approach to solve general engineering problems. [ABSTRACT FROM AUTHOR]

Since the large‐scale protein sequence data is available, applying deep neural networks to mine better features from the sequences becomes possible. Eukaryotic protein subcellular localization prediction which makes a contribution in many biology process, has used protein sequences in many automatic predicting methods. Moreover, gene ontology (GO) annotation has been shown to be helpful in improving the prediction accuracy of subcellular localization. However, experimentally annotated proteins are not always available. On the other hand, experimentally annotated proteins are available for certain species such as human, mouse, Arabidopsis thaliana, etc. It is highly motivated to perform deep learning of GO annotations on the available experimentally annotated proteins and to transfer it to subcellular localization prediction on other species. In this paper, we propose a deep protein subcellular localization predictor, consisting of a linear classifier and a deep feature extractor of convolution neural network (CNN). The deep CNN feature extractor is first shared and pre‐trained in a deep GO annotation predictor, and then is transferred to the subcellular localization predictor with fine‐tuning using protein localization samples. In this way, we have a deep protein subcellular localization predictor enhanced with transfer learning of GO annotation. The proposed method has good performances on the Swiss‐Prot datasets, when transfer learning using the protein samples both within and out species. Moreover, it outperforms the state‐of‐the‐art traditional methods on benchmark datasets. © 2021 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

Inverse modeling of microwave components plays an important role in microwave design and diagnosis or tuning. Since the analytical function or formula of the inverse input‐output relationship does not exist and is difficult to obtain, artificial neural network (ANN) becomes an efficient tool to develop inverse models for microwave components. This paper provides an overview of recent advances in neural network‐based inverse modeling techniques for microwave applications. We review two different shallow neural network‐based inverse modeling techniques, including the comprehensive neural network inverse modeling methodology and the multivalued neural network inverse modeling technique. Both techniques address the problem of nonuniqueness in inverse modeling. We also provide an overview of recently developed hybrid deep neural network modeling technique and the application to inverse modeling. For the inverse modeling problem with high‐dimensional inputs, the relationship between the inputs and the outputs of the inverse model will become more complicated and the inverse modeling problem will become harder. The deep neural network becomes a practical choice. The hybrid deep neural network structure is presented. The recently proposed activation function, specifically for microwave application, and a three‐stage deep learning algorithm for training the hybrid deep neural network are reviewed. [ABSTRACT FROM AUTHOR]

Bayesian models use posterior predictive distributions to quantify the uncertainty of their predictions. Similarly, the point predictions of neural networks and other machine learning algorithms may be converted to predictive distributions by various bootstrap methods. The predictive performance of each algorithm can then be assessed by quantifying the performance of its predictive distribution. Previous methods for assessing such performance are relative, indicating whether certain algorithms perform better than others. This paper proposes performance measures that are absolute in the sense that they indicate whether or not an algorithm performs adequately without requiring comparisons with other algorithms. The first proposed performance measure is a predictive p value that generalizes a prior predictive p value with the prior distribution equal to the posterior distribution of previous data. The other proposed performance measures use the generalized predictive p value for each prediction to estimate the proportion of target values that are compatible with the predictive distribution. The new performance measures are illustrated by using them to evaluate the predictive performance of deep neural networks when applied to the analysis of a large housing price data set that is used as a standard in machine learning. [ABSTRACT FROM AUTHOR]

This paper describes the development of three‐dimensional (3D) human recognition system of flying drone system for emergency rescue and investigation. In this system, deep neural network and its application for 3D object recognition are key techniques for human detection from a free viewpoint. Some appearance based characteristics are captured as movie frames, and the system uses deep neural networks to automatically classify concerned object. The proposed system performs well that many kinds of views of personnel can be recognized from bird's eye view. Experimental results show that the system can effectively recognize human objects with high accuracy. [ABSTRACT FROM AUTHOR]

It has been reported that training deep neural networks is more difficult than training shallow neural networks. Hinton et al. proposed deep belief networks with a learning algorithm that trains one layer at a time. A much better generalization can be achieved when pre‐training each layer with an unsupervised learning algorithm. Since then, deep neural networks have been extensively studied. On the other hand, it has been revealed that singular points affect the training dynamics of the learning models such as neural networks and cause a standstill of training. Naturally, training deep neural networks suffer singular points. As described in this paper, we present a deep neural network model that has fewer singular points than the usual one. First, we demonstrate that some singular points in the deep real‐valued neural network, which is equivalent to a deep complex‐valued neural network, have been resolved as its inherent property. Such deep neural networks are less likely to become trapped in local minima or plateaus caused by critical points. Results of experiments on the two spirals problem, which has an extreme nonlinearity, support our theory. Copyright © 2017 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]