Search

Deep learning has accomplished huge success in computer vision applications such as self-driving vehicles, facial recognition, and controlling robots. A growing need for deploying systems on resource-limited or resource-constrained environments such as smart cameras, autonomous vehicles, robots, smartphones, and smart wearable devices drives one of the current mainstream developments of convolutional neural networks: reducing model complexity but maintaining fine accuracy. In this study, the proposed efficient light convolutional neural network (ELNet) comprises three convolutional modules which perform ELNet using fewer computations, which is able to be implemented in resource-constrained hardware equipment. The classification task using CIFAR-10 and CIFAR-100 datasets was used to verify the model performance. According to the experimental results, ELNet reached 92.3% and 69%, respectively, in CIFAR-10 and CIFAR-100 datasets; moreover, ELNet effectively lowered the computational complexity and parameters required in comparison with other CNN architectures. [ABSTRACT FROM AUTHOR]

Abstract: This study presents a functional neural fuzzy network (FNFN) for classification applications. The proposed FNFN model adopts a functional neural network (FLNN) to the consequent part of the fuzzy rules. Orthogonal polynomials and linearly independent functions are used for a functional expansion of the FLNN. Thus, the consequent part of the proposed FNFN model is a nonlinear combination of input variables. The FNFN model can construct its structure and adapt its free parameters with online learning algorithms, which consist of structure learning algorithm and parameter learning algorithm. The structure learning algorithm is based on the entropy measure to determine the number of fuzzy rules. The parameter learning algorithm, based on the gradient descent method, can adjust the shapes of the membership functions and the corresponding weights of the FLNN. Finally, the FNFN model is applied to various simulations. The simulation results for the Iris, Wisconsin breast cancer, and wine classifications show that FNFN model has superior performance than other models for classification applications. [ABSTRACT FROM AUTHOR]

Abstract: Kernel-based nonlinear characteristic extraction and classification algorithms are popular new research directions in machine learning. In this paper, we propose an improved photometric stereo scheme based on improved kernel-independent component analysis method to reconstruct 3D human faces. Next, we fetch the information of 3D faces for facial face recognition. For reconstruction, we obtain the correct normal vector’s sequence to form the surface, and use a method for enforcing integrability to reconstruct 3D objects. We test our algorithm on a number of real images captured from the Yale Face Database B, and use three kinds of methods to fetch characteristic values. Those methods are called contour-based, circle-based, and feature-based methods. Then, a three-layer, feed-forward neural network trained by a back-propagation algorithm is used to realize a classifier. All the experimental results were compared to those of the existing human face reconstruction and recognition approaches tested on the same images. The experimental results demonstrate that the proposed improved kernel independent component analysis (IKICA) method is efficient in reconstruction and face recognition applications. [ABSTRACT FROM AUTHOR]

Abstract: The implementation of adaptive neural fuzzy networks (NFNs) using field programmable gate arrays (FPGA) is proposed in this study. Hardware implementation of NFNs with learning ability is very difficult. The backpropagation (BP) method in the learning algorithm is widely used in NFNs, making it difficult to implement NFNs in hardware because calculating the backpropagation error of all parameters in a system is very complex. However, we use the simultaneous perturbation method as a learning scheme for the NFN hardware implementation. In order to reduce the chip area, we utilize the traditional non-linear activation function to implement the Gaussian function. We can confirm the reasonableness of NFN performance through some examples. [Copyright &y& Elsevier]

This paper introduces a recurrent neural-fuzzy network (RNFN) based on improved particle swarm optimization (IPSO) for pattern recognition applications. The proposed IPSO method consists of the modified evolutionary direction operator (MEDO) and the traditional PSO. A novel MEDO combining the evolutionary direction operator (EDO) and the migration operation is also proposed. Hence, the proposed IPSO method can improve the ability of searching global solution. Experimental results have shown that the proposed IPSO method has a better performance than the traditional PSO in the human body classification and the skin color detection. [Copyright &y& Elsevier]

In this study, we proposed a new technique to compensate the backlight images. Two processing stages, called the backlight level detection and the backlight image compensation, are proposed. In the backlight level detection stage, we first transferred the color space to gray space by feature weighting, then obtain two backlight factors. We apply these two backlight factors to the proposed functional-link-based neuro-fuzzy network (FNFN) with immune particle swarm optimization (IPSO) for detecting compensation degree. In the backlight image compensation stage, we also proposed the adaptive cubic curve method to compensate and enhance the brightness of backlight images according to the compensation degree of each image. The backlight degree is indicated by histograms of the luminance distribution in the backlight level detection stage. The experiment results showed that the backlight images can be compensated effectively. [Copyright &y& Elsevier]

Abstract: This paper introduces implementation of a wavelet neural network (WNN) with learning ability on field programmable gate array (FPGA). A learning algorithm using gradient descent method is not easy to implement in an electronic circuit and has local minimum. A more suitable method is the particle swarm optimization (PSO) that is a population-based optimization algorithm. The PSO is similar to the GA, but it has no evolution operators such as crossover and mutation. In the approximation of a nonlinear activation function, we use a Taylor series and a look-up table (LUT) to achieve a more accurate approximation. The results of the two experiments demonstrate the successful hardware implementation of the wavelet neural networks with the PSO algorithm using FPGA. From the results of the experiment, it can be seen that the performance of the PSO is better than that of the simultaneous perturbation algorithm at sufficient particle sizes. [Copyright &y& Elsevier]

Abstract: A recurrent wavelet-based neuro fuzzy network (RWNFN) is proposed in this paper. The proposed RWNFN integrates wavelet transforms with fuzzy rules. Temporal relations are embedded in the network by adding feedback connections from memory units in the third layer of a feedforward wavelet-based neuro fuzzy network (WNFN). The RWNFN augments the basic ability of the WNFN to overcome temporal problems. Moreover, an online learning algorithm is proposed to automatically construct the RWNFN. Computer simulations were conducted to illustrate the performance and applicability of the proposed system. [Copyright &y& Elsevier]

This paper presents a wavelet-based recurrent fuzzy neural network (WRFNN) for prediction and identification of nonlinear dynamic systems. The proposed WRFNN model combines the traditional Thkagi-Sugeno-Kang (TSK) fuzzy model and the wavelet neural networks (WNN). This paper adopts the nonorthogonal and compactly supported functions as wavelet neural network bases. Temporal relations embedded in the network are caused by adding some feedback connections representing the memory units into the second layer of the feedforward wavelet-based fuzzy neural networks (WFNN). An online learning algorithm, which consists of structure learning and parameter learning, is also presented. The structure learning depends on the degree measure to obtain the number of fuzzy rules and wavelet functions. Meanwhile, the parameter learning is based on the gradient descent method for adjusting the shape of the membership function and the connection weights of WNN. Finally, computer simulations have demonstrated that the proposed WRFNN model requires fewer adjustable parameters and obtains a smaller rms error than other methods. [ABSTRACT FROM AUTHOR]

The aim of this paper is to distinguish the vehicle detection and count the class number in each classification from the inputs. We proposed the use of Fuzzy Guided Scale Choice (FGSC)-based SSD deep neural network architecture for vehicle detection and class counting with parameter optimization. The 'FGSC' blocks are integrated into the convolutional layers of the model, which emphasize essential features while ignoring less important ones that are not significant for the operation. We created the passing detection lines and class counting windows and connected them with the proposed FGSC-SSD deep neural network model. The 'FGSC' blocks in the convolution layer emphasize essential features and find out unnecessary features by using the scale choice method at the training stage and eliminate that significant speedup of the model. In addition, FGSC blocks avoided many unusable parameters in the saturation interval and improved the performance efficiency. In addition, the Fuzzy Sigmoid Function (FSF) increases the activation interval through fuzzy logic. While performing operations, the FGSC-SSD model reduces the computational complexity of convolutional layers and their parameters. As a result, the model tested Frames Per Second (FPS) on edge artificial intelligence (AI) and reached a real-time processing speed of 38.4 and an accuracy rate of more than 94%. Therefore, this work might be considered an improvement to the traffic monitoring approach by using edge AI applications. [ABSTRACT FROM AUTHOR]