Search

Automatic sleep staging methods usually extract hand-crafted features or network trained features from signals recorded by polysomnography (PSG), and then estimate the stages by various classifiers. In this study, we propose a classification approach based on a hierarchical neural network to process multi-channel PSG signals for improving the performance of automatic five-class sleep staging. The proposed hierarchical network contains two stages: comprehensive feature learning stage and sequence learning stage. The first stage is used to obtain the feature matrix by fusing the hand-crafted features and network trained features. A multi-flow recurrent neural network (RNN) as the second stage is utilized to fully learn temporal information between sleep epochs and fine-tune the parameters in the first stage. The proposed model was evaluated by 147 full night recordings in a public sleep database, the Montreal Archive of Sleep Studies (MASS). The proposed approach can achieve the overall accuracy of 0.878, and the F1-score is 0.818. The results show that the approach can achieve better performance compared to the state-of-the-art methods. Ablation experiment and model analysis proved the effectiveness of different components of the proposed model. The proposed approach allows automatic sleep stage classification by multi-channel PSG signals with different criteria standards, signal characteristics, and epoch divisions, and it has the potential to exploit sleep information comprehensively. [ABSTRACT FROM AUTHOR]

Highlights • Propose a new super-resolution method based on CSC and CNN. • Use CNN to reconstruct the high resolution image for the low-frequency part. • Propose an ACSC to reconstruct high resolution image for high-frequency part. • Integrate and develope the advantages of the CSC method and CNN. Abstract The convolutional sparse coding-based super-resolution (CSC-SR) method has shown its good performance in single image super-resolution. It divides the low-resolution (LR) image into low-frequency part and the high-frequency part, and reconstructs their corresponding high-resolution (HR) image with bicubic interpolation and convolutional sparse coding (CSC) method, respectively. This paper is devoted to improve the performance of CSC-SR method. As convolutional neural network (CNN) can reveal the mapping relation between the LR image and the HR image for the low-frequency part better, we replace the bicubic interpolation with CNN to reconstruct the HR image for the low-frequency part. In addition, we propose an adaptive CSC method to reconstruct the HR image for the high-frequency part. We name our proposed super-resolution method as hybrid adaptive convolutional sparse coding-based super-resolution (HACSC-SR) method. Many comparison experiments illustrate that our proposed HACSC-SR method is superior to CSC-SR, CNN as well as several existing super-resolution methods. [ABSTRACT FROM AUTHOR]

We study the problem of 3D object detection from RGB-D images so as to achieve localization (i.e., producing a bounding box around the object) and classification (i.e., determining the object category) simultaneously. Its challenges arise from high intra-class variability, illumination change, background clutter and occlusion. To solve this problem, we propose a novel solution that integrates the 2D information (RGB images), the 3D information (RGB-D images) and the object/scene context information together, and call it the Context-Assisted 3D (C3D) method. In the proposed C3D method, we first use a convolutional neural network (CNN) to jointly detect a 3D object in a scene and its scene category. Then, we improve the detection result furthermore with a Conditional Random Field (CRF) model that incorporates the object potential, the scene potential, the scene/object context, the object/object context, and the room geometry. Extensive experiments are conducted to demonstrate that the proposed C3D method achieves the state-of-the-art performance for 3D object detection against the SUN RGB-D benchmark dataset. [ABSTRACT FROM AUTHOR]

• A deep learning method based on CNN and LSTM was used to recognise pig aggression. • This study directly process video episodes rather than individual frames. • CNN features were input into LSTM framework to extract spatial-temporal features. • The proposed method could recognise aggressive episodes with an accuracy of 97.2%. • A frame skipping approach can improve the accuracy to 98.4% and halve running time. Aggression is considered as a major animal welfare problem in commercial pig farming. The aim of this study is to develop a deep learning method based on convolutional neural network (CNN) and long short-term memory (LSTM) to recognise aggressive episodes of pigs. Compared to previous studies of pig behaviours based on deep learning, this study directly process video episodes rather than individual frames. In the experiment, nursery pigs (8/pen) were mixed for 3 days and then 8 h of video was recorded in each day. From these videos, 600 aggressive 2 s-episodes were manually selected and then augmented into 2400 episodes by using horizontal, vertical and diagonal mirroring. From the videos, 2400 non-aggressive 2 s-episodes were also manually selected. 80% of the data were randomly allocated as training set and the remaining 20% as validation set. Firstly, the CNN architecture VGG-16 was used to extract spatial features. These features were then input into LSTM framework to further extract temporal features. Through fully connected layer, the prediction function Softmax was finally used to determine if the current episode is aggression or non-aggression. Using the proposed method, aggressive episodes could be recognised with an accuracy of 97.2%. This result indicates that this method can be used to recognise aggressive episodes of pigs. Additionally, this paper further investigates the validity of this method under the conditions of skipping frames and reducing the episode length. The results show that a frame skipping approach whereby 30 fps is reduced into 15 fps within each 2 s-episode can improve the accuracy into 98.4% and halve the total running time. [ABSTRACT FROM AUTHOR]

Chlorophyll-a (Chl-a) concentration plays a crucial role in monitoring marine phytoplankton, holding significant implications for marine ecosystems and human livelihoods. Remote sensing serves as a valuable method for directly estimating Chl-a concentration and facilitating marine monitoring activities. In order to accurately estimate Chl-a concentration and effectively monitor the marine ecological environment of the Taiwan Strait, this paper introduces a novel neural network model called Convolutional Neural Network with Dual Attention Mechanism Optimization (CNN-CBAM). Additionally, the spectral bands derived from MODIS 500 m imagery are subjected to various processing techniques to generate four distinct sets of feature data. These datasets are subsequently merged with in-situ measurements of Chl-a concentration obtained from buoy stations. Given the limited availability of buoy stations, the temporal continuity of data is leveraged to overcome the spatial distribution constraints. This enables the estimation of Chl-a concentration at various time intervals within the research area of the Taiwan Strait. To evaluate the performance of the model, metrics such as root mean square error (RMSE), mean absolute percentage error (MAPE), and R2 are employed. The results demonstrate that the CNN-CBAM model, utilizing MODIS temporal data, effectively retrieves Chl-a concentration in the research area of the Taiwan Strait with high accuracy. For the CNN-CBAM model, the RMSE is 0.34 μg L−1, MAPE is 22%, and R2 is 0.86. In comparison, the traditional empirical model using the Band Ratio (BR) model has an RMSE of 0.61 μg L−1, MAPE of 57%, and R2 of 0.31. The results indicate that the CNN-CBAM model has improved R2 by 0.55 compared to the traditional BR model. Additionally, the RMSE and MAPE have decreased by 0.27 μg L−1 and 35%, respectively. The superiority of the CNN-CBAM model over the traditional BR model is evident, showcasing a substantial enhancement in the accuracy of Chl-a concentration retrieval. Given the challenges posed by the intricate and ever-changing marine environment, particularly the scarcity of in-situ buoy stations, this study offers a practical solution for monitoring Chl-a concentration. It establishes a framework for leveraging satellite-based multispectral sensors to enable large-scale and multi-temporal remote sensing retrieval of Chl-a concentration in the research area of the Taiwan Strait. • The CNN-CBAM model demonstrates exceptional performance in estimating Chl-a concentration. • The CNN-CBAM model excels in mining non-linear data compared to traditional empirical models. • CNN-CBAM outperforms other machine learning models in extracting high-dimensional feature data. • The incorporation of the CBAM module enhances the performance of the CNN model. [ABSTRACT FROM AUTHOR]