Search

The appetite of fish significantly influences aquaculture efficiency and fish welfare. However, accurately assessing fish appetite has posed a challenging problem. Currently, the study of fish feeding behaviour relies primarily on the overall information obtained from images of fish schools, often overlooking the distinctive behavioural traits of individual fish. Analysing the behaviour of individual fish is hindered by challenges such as intraclass variation and cross-occlusion within real aquaculture environments. To address these challenges, this paper introduces a novel method for assessing appetite based on individual fish behaviour. The ByteTrack model was improved to enable stable tracking of each fish within a school under complex conditions. Additionally, this paper employs the spatiotemporal graph convolutional neural network (ST-GCN) to extract the movement characteristics of individual fish, facilitating accurate appetite assessment. The experimental results demonstrate that the proposed method achieves 98.47% accuracy in appetite assessment, surpassing the performance of other state-of-the-art methods. This paper provides a new opportunity and effective means for analysing fish behaviour and appetite in intricate environments. • ·An appetite assessment method based on YOLOv8-ByteTrack and ST-GCN was proposed. • ·The method integrates fish features into spatial-temporal sequences. • ·The method prevents data loss caused by fish school stacking. [ABSTRACT FROM AUTHOR]

• Proposed a method (DEEP-EP) for prediction of Epigenetic Protein. • Features are extracted by DDE, DPC, and GAAC. • ERCNN is used for model training. • DEEP-EP secured the best performance. Epigenetic proteins (EP) play a role in the progression of a wide range of diseases, including autoimmune disorders, neurological disorders, and cancer. Recognizing their different functions has prompted researchers to investigate them as potential therapeutic targets and pharmacological targets. This paper proposes a novel deep learning-based model that accurately predicts EP. This study introduces a novel deep learning-based model that accurately predicts EP. Our approach entails generating two distinct datasets for training and evaluating the model. We then use three distinct strategies to transform protein sequences to numerical representations: Dipeptide Deviation from Expected Mean (DDE), Dipeptide Composition (DPC), and Group Amino Acid (GAAC). Following that, we train and compare the performance of four advanced deep learning models algorithms: Ensemble Residual Convolutional Neural Network (ERCNN), Generative Adversarial Network (GAN), Convolutional Neural Network (CNN), and Gated Recurrent Unit (GRU). The DDE encoding combined with the ERCNN model demonstrates the best performance on both datasets. This study demonstrates deep learning's potential for precisely predicting EP, which can considerably accelerate research and streamline drug discovery efforts. This analytical method has the potential to find new therapeutic targets and advance our understanding of EP activities in disease. [ABSTRACT FROM AUTHOR]

• We proposed a novel computational method for detect RNA m6A sites. • The proposed method is of powerful ability to predict RNA m6A sites in multiple species or tissues, and of across species or tissue ability. • A user-friendly webserver facilitates recognition of RNA m6A for biologists. N6-methyladenosine (m6A) is the most prevalent, abundant, and conserved internal modification in the eukaryotic messenger RNA (mRNAs) and plays a crucial role in the cellular process. Although more than ten methods were developed for m6A detection over the past decades, there were rooms left to improve the predictive accuracy and the efficiency. In this paper, we proposed an improved method for predicting m6A modification sites, which was based on bi-directional gated recurrent unit (Bi-GRU) and convolutional neural networks (CNN), called Deepm6A-MT. The Deepm6A-MT has two input channels. One is to use an embedding layer followed by the Bi-GRU and then by the CNN, and another is to use one-hot encoding, dinucleotide one-hot encoding, and nucleotide chemical property codes. We trained and evaluated the Deepm6A-MT both by the 5-fold cross-validation and the independent test. The empirical tests showed that the Deepm6A-MT achieved the state of the art performance. In addition, we also conducted the cross-species and the cross-tissues tests to further verify the Deepm6A-MT for effectiveness and efficiency. Finally, for the convenience of academic research, we deployed the Deepm6A-MT to the web server, which is accessed at the URL http://www.biolscience.cn/Deepm6A-MT/. [ABSTRACT FROM AUTHOR]

Currently, deep learning has achieved remarkable success in estimating plant disease from unmanned aerial system (UAS) images. However, two critical challenges remain unexplored: spatiotemporal variations in disease symptoms and the domain shift between source and target datasets. To overcome these challenges, this paper proposes an approach that incorporates temporal aspects of disease progression using time series analysis. Spatiotemporal information is integrated by combining convolutional neural networks and bidirectional long-short term memory (CNN-BiLSTM) to classify the disease into five severity levels. Various feature extraction methods, including both handcrafted and CNN-based feature extractors, are evaluated. Furthermore, to tackle the problem of domain shift, a feature-level domain adaptation method is proposed. This method aims to learn transferable feature representations that remain consistent despite variations between source and target datasets. This approach enhances the spatiotemporal transferability of the CNN-BiLSTM model, enabling the effective utilisation of historical datasets. The study demonstrates that the CNN-BiLSTM model outperforms traditional time-independent machine-learning methods that rely on handcrafted features. Specifically, the Resnet101-BiLSTM model achieves the highest overall classification accuracy of 89.7% among all tested models evaluated on a one-year dataset. Moreover, it shows superior generalisation with 72.7% accuracy for cross-spatiotemporal disease severity classification using domain adaptation, as demonstrated through two-year experiments. By reducing the domain shift of source and target datasets and harnessing time series high-resolution images obtained throughout the crop growing season, this hybrid approach has substantial potential to advance the assessment of crop disease severity in field conditions. • Compared different CNN-based feature extractors for FOV4 symptom detection in UAS images. • Developed a BiLSTM model for temporal analysis in UAS datasets. • Use of domain adaptation enhanced model generalization. • CNN-BiLSTM with CORAL achieved 72.7% accuracy, proving its effectiveness in diverse real-world applications. [ABSTRACT FROM AUTHOR]

The scattering transform is a multilayered, wavelet-based transform initially introduced as a mathematical model of convolutional neural networks (CNNs) that has played a foundational role in our understanding of these networks' stability and invariance properties. In subsequent years, there has been widespread interest in extending the success of CNNs to data sets with non-Euclidean structure, such as graphs and manifolds, leading to the emerging field of geometric deep learning. In order to improve our understanding of the architectures used in this new field, several papers have proposed generalizations of the scattering transform for non-Euclidean data structures such as undirected graphs and compact Riemannian manifolds without boundary. Analogous to the original scattering transform, these works prove that these variants of the scattering transform have desirable stability and invariance properties and aim to improve our understanding of the neural networks used in geometric deep learning. In this paper, we introduce a general, unified model for geometric scattering on measure spaces. Our proposed framework includes previous work on compact Riemannian manifolds without boundary and undirected graphs as special cases but also applies to more general settings such as directed graphs, signed graphs, and manifolds with boundary. We propose a new criterion that identifies to which groups a useful representation should be invariant and show that this criterion is sufficient to guarantee that the scattering transform has desirable stability and invariance properties. Additionally, we consider finite measure spaces that are obtained from randomly sampling an unknown manifold. We propose two methods for constructing a data-driven graph on which the associated graph scattering transform approximates the scattering transform on the underlying manifold. Moreover, we use a diffusion-maps based approach to prove quantitative estimates on the rate of convergence of one of these approximations as the number of sample points tends to infinity. Lastly, we showcase the utility of our method on spherical images, a directed graph stochastic block model, and on high-dimensional single-cell data. [ABSTRACT FROM AUTHOR]

Cyanobacteria are the dominating microorganisms in aquatic environments, posing significant risks to public health due to toxin production in drinking water reservoirs. Traditional water quality assessments for abundance of the toxigenic genera in water samples are both time-consuming and error-prone, highlighting the urgent need for a fast and accurate automated approach. This study addresses this gap by introducing a novel public dataset, TCB-DS (Toxigenic Cyanobacteria Dataset), comprising 2593 microscopic images of 10 toxigenic cyanobacterial genera and subsequently, an automated system to identify these genera which can be divided into two parts. Initially, a feature extractor Convolutional Neural Network (CNN) model was employed, with MobileNet emerging as the optimal choice after comparing it with various other popular architectures such as MobileNetV2, VGG, etc. Secondly, to perform classification algorithms on the extracted features of the first section, multiple approaches were tested and the experimental results indicate that a Fully Connected Neural Network (FCNN) had the optimal performance with weighted accuracy and f1-score of 94.79% and 94.91%, respectively. The highest macro accuracy and f1-score were 90.17% and 87.64% which were acquired using MobileNetV2 as the feature extractor and FCNN as the classifier. These results demonstrate that the proposed approach can be employed as an automated screening tool for identifying toxigenic Cyanobacteria with practical implications for water quality control replacing the traditional estimation given by the lab operator following microscopic observations. The dataset and code of this paper are publicly available at https://github.com/iman2693/CTCB. • Implementing ML for cyanobacteria classification. • Introduction of a dataset of 10 toxicogenic cyanobacterial genera. • Proposing the MobileNet for classification of Cyanobacteria. • Utilization of FCNN as the optimal classifier for cyanobacterial cell images. • Reaching to the accuracy and f1-score of 94.79% and 94.91%, respectively. [ABSTRACT FROM AUTHOR]

Epilepsy affects over 50 million people globally. Electroencephalography is critical for epilepsy diagnosis, but manual seizure classification is time-consuming and requires extensive expertise. This paper presents an automated multi-class seizure classification model using EEG signals from the Temple University Hospital Seizure Corpus ver. 1.5.2. 11 features including time-based correlation, time-based eigenvalues, power spectral density, frequency-based correlation, frequency-based eigenvalues, sample entropy, spectral entropy, logarithmic sum, standard deviation, absolute mean, and ratio of Daubechies D4 wavelet transformed coefficients were extracted from 10-second sliding windows across channels. The model combines multi-head self-attention mechanism with a deep convolutional neural network (CNN) to classify seven subtypes of generalized and focal epileptic seizures. The model achieved 0.921 weighted accuracy and 0.902 weighted F1 score in classifying focal onset non-motor, generalized onset non-motor, simple partial, complex partial, absence, tonic, and tonic-clonic seizures. In comparison, a CNN model without multi-head attention achieved 0.767 weighted accuracy. Ablation studies were conducted to validate the importance of transformer encoders and attention. The promising classification results demonstrate the potential of deep learning for handling EEG complexity and improving epilepsy diagnosis. This seizure classification model could enable timely interventions when translated into clinical practice. [ABSTRACT FROM AUTHOR]

Chlorophyll-a (Chl-a) concentration plays a crucial role in monitoring marine phytoplankton, holding significant implications for marine ecosystems and human livelihoods. Remote sensing serves as a valuable method for directly estimating Chl-a concentration and facilitating marine monitoring activities. In order to accurately estimate Chl-a concentration and effectively monitor the marine ecological environment of the Taiwan Strait, this paper introduces a novel neural network model called Convolutional Neural Network with Dual Attention Mechanism Optimization (CNN-CBAM). Additionally, the spectral bands derived from MODIS 500 m imagery are subjected to various processing techniques to generate four distinct sets of feature data. These datasets are subsequently merged with in-situ measurements of Chl-a concentration obtained from buoy stations. Given the limited availability of buoy stations, the temporal continuity of data is leveraged to overcome the spatial distribution constraints. This enables the estimation of Chl-a concentration at various time intervals within the research area of the Taiwan Strait. To evaluate the performance of the model, metrics such as root mean square error (RMSE), mean absolute percentage error (MAPE), and R2 are employed. The results demonstrate that the CNN-CBAM model, utilizing MODIS temporal data, effectively retrieves Chl-a concentration in the research area of the Taiwan Strait with high accuracy. For the CNN-CBAM model, the RMSE is 0.34 μg L−1, MAPE is 22%, and R2 is 0.86. In comparison, the traditional empirical model using the Band Ratio (BR) model has an RMSE of 0.61 μg L−1, MAPE of 57%, and R2 of 0.31. The results indicate that the CNN-CBAM model has improved R2 by 0.55 compared to the traditional BR model. Additionally, the RMSE and MAPE have decreased by 0.27 μg L−1 and 35%, respectively. The superiority of the CNN-CBAM model over the traditional BR model is evident, showcasing a substantial enhancement in the accuracy of Chl-a concentration retrieval. Given the challenges posed by the intricate and ever-changing marine environment, particularly the scarcity of in-situ buoy stations, this study offers a practical solution for monitoring Chl-a concentration. It establishes a framework for leveraging satellite-based multispectral sensors to enable large-scale and multi-temporal remote sensing retrieval of Chl-a concentration in the research area of the Taiwan Strait. • The CNN-CBAM model demonstrates exceptional performance in estimating Chl-a concentration. • The CNN-CBAM model excels in mining non-linear data compared to traditional empirical models. • CNN-CBAM outperforms other machine learning models in extracting high-dimensional feature data. • The incorporation of the CBAM module enhances the performance of the CNN model. [ABSTRACT FROM AUTHOR]

Deep learning methods utilizing Convolutional Neural Networks (CNNs) and Transformers have achieved remarkable success in volumetric medical image analysis. While successful, the symmetrical structure of numerous networks pays insufficient attention to the encoding phase, and the large amount of memory occupied by voxels leads to unnecessary redundancy in the network. In this paper, we present a novel approach to handle volumetric medical images by converting them into point cloud and introduce a new asymmetrical segmentation architecture. We propose a dual-path encoder that fully captures both dense and sparse representations of the input point cloud sampled from volumes. Moreover, the two obtained representations are subtracted at the skip connection as a complementary feature during the decoding stage. Experimental results on the Brain Tumor Segmentation (BraTS) and the Multi-sequence Cardiac MR Segmentation tasks demonstrate the great potential of our point-based method for volumetric medical image segmentation. [ABSTRACT FROM AUTHOR]

Accurate segmentation of nasopharyngeal carcinoma (NPC) in magnetic resonance (MR) images is crucial for radiotherapy planning. However, vanilla 2D/3D deep convolutional networks fail to gain satisfying NPC segmentation results, since 3D methods suffer from inter-slice discontinuities and 2D methods lack inter-slice context learning. To address this problem, this paper proposes a 2.5D learning Selective Inter-slice Context Network (SICNet) for NPC segmentation. The proposed SICNet comprises a main encoder that extracts target features from the middle slice and an auxiliary encoder that learns inter-slice context from adjacent slices. The features from two encoders are fused by the Inter-slice Context Fusion (ICF) module and then sent to the decoder for predictions. Furthermore, a knowledge distillation module named Mask-Guided Self-knowledge Distillation (MGSD) is proposed to help the auxiliary encoder learn context selectively. Specifically, with the guidance of mask labels, MGSD tells the auxiliary encoder where to look and how to learn, thus achieving selective inter-slice context learning and boosting segmentation accuracy. The proposed SICNet achieves a DSC of 74.38 ± 11.99, an HD95 of 9.31 ± 2.68, and an ASSD of 1.46 ± 0.76 on an in-house NPC dataset, outperforming other state-of-the-art segmentation methods. [ABSTRACT FROM AUTHOR]

Domain generalizable person re-identification (DG ReID) aims to obtain a model that can be applied directly to unseen domains once trained on a set of source domains (datasets collected from different camera networks). Among current DG ReID methods, instance normalization is a promising solution to reduce the effect of domain bias, but it inevitably filters out some discriminative information. Besides, since most pioneering approaches cannot effectively address the loss of discriminative information, this paper proposes a Style Elimination and Information Restitution (SEIR) module and constructs a generalizable framework. Specifically, we utilize instance normalization to reinforce the generalization capability on unseen domains. Then, the instance-specific mean and variance are employed to construct a feature vector that includes discriminative and style information. Besides, an encoder–decoder structure is designed to restitute the discriminative information to ensure a high recognition rate. Finally, a dual optimization strategy is devised to update the proposed module by simulating a real train-test process to enhance the generalization robustness further and prevent SEIR from overfitting to the source domain. Extensive experimental results demonstrate that the proposed method outperforms the state-of-the-art methods by a large margin on the public DG ReID benchmarks. • A Style Elimination and Information Restitution module for handling domain bias. • An optimization strategy for improving the generalization ability. • We propose a framework for generalizable person re-identification. • Significant results were achieved for addressing the generalizable person re-identification. [ABSTRACT FROM AUTHOR]

It is frequently observed that overparameterized neural networks generalize well. Regarding such phenomena, existing theoretical work mainly devotes to linear settings or fully-connected neural networks. This paper studies the learning ability of an important family of deep neural networks, deep convolutional neural networks (DCNNs), under both underparameterized and overparameterized settings. We establish the first learning rates of underparameterized DCNNs without parameter or function variable structure restrictions presented in the literature. We also show that by adding well-defined layers to a non-interpolating DCNN, we can obtain some interpolating DCNNs that maintain the good learning rates of the non-interpolating DCNN. This result is achieved by a novel network deepening scheme designed for DCNNs. Our work provides theoretical verification of how overfitted DCNNs generalize well. [ABSTRACT FROM AUTHOR]

The Allen-Cahn equation is a well-known stiff semilinear parabolic equation used to describe the process of phase separation and transition in phase field modeling of multi-component physical systems, while the conservative Allen-Cahn equation is a modified version of the classic Allen-Cahn equation that can additionally conserve the mass. As neural networks and deep learning techniques have achieved significant successes in recent years in scientific and engineering applications, there has been growing interest in developing deep learning algorithms for numerical solutions of partial differential equations. In this paper, we propose a novel deep learning method for predicting the dynamics of the classic and conservative Allen-Cahn equations. Specifically, we design two special convolutional neural network models, one for each of the two equations, to learn the fully-discrete operators between two adjacent time steps. The loss functions of the two models are defined using the residual of the fully-discrete systems, which result from applying the central finite difference discretization in space and the Crank–Nicolson approximation in time. This approach enables us to train the models without requiring any ground-truth data. Moreover, we introduce an effective training strategy that automatically generates useful samples along the time evolution to facilitate training of the models. Finally, we conduct extensive experiments in two and three dimensions to demonstrate outstanding performance of our proposed method, including its dynamics prediction and generalization ability under different scenarios. • We propose two novel convolutional neural networks to learn the fully-discrete operators of the classic and conservative Allen-Chan equations. • The loss functions are defined using the residual of the fully-discrete systems, which enables us to train the models without ground-truth data. • We introduce a novel training strategy that automatically generates samples along the time to facilitate effective training of the two models. • Extensive experiments demonstrate outstanding performance of the proposed models for dynamics prediction under different scenarios. [ABSTRACT FROM AUTHOR]