Search

Recently, intelligent data processing and interpretation based on deep learning (DL) have received considerable attention. Training data are vital for DL-based approaches. In geosciences, researchers have been facing a significant obstacle, i.e., the absence of authoritative and representative open data for training and testing artificial neural networks (ANNs). Although open-source works in geosciences are increasing, the quantity is currently limited. With the aid of the Society of Exploration Geophysicists (SEG) 2020 Machine Learning (ML) Blind-Test Challenge Data, we open source a package for DL-based seismic facies classification (SFC). We regard SFC as translating the seismic data into the facies by training a flexible end-to-end encoding–decoding-style ANN “BridgeNet” revised from U-Net. Inspired by the residual network (ResNet), we further enhance the BridgeNet by inserting the identity shortcut connections, which can theoretically ease the notorious problem of vanishing/exploding gradients. The evaluated framework, however, is not restricted to SFC. We hope that it can provide some insights that help researchers to construct and train ANNs that yield reliable and robust results in their own tasks. We carry out benchmarking experiments to investigate some crucial factors impacting the ANN’s performance to elucidate how we obtained our current optimal results on the SEG 2020 ML Challenge Data. The accuracy and continuity of predicted facies along the training and testing sections indicate that the results are consistent with geologic sedimentation, verifying the generalization capability of the enhanced flexible end-to-end encoding–decoding-style BridgeNet. For SFC, we recommend a memory-saving sparse categorical cross-entropy (CC) loss function to improve the efficiency. The codes are available at https://doi.org/10.5281/zenodo.5787673. [ABSTRACT FROM AUTHOR]

Physical and/or economic constraints cause acquired seismic data to be incomplete; however, complete data are required for many subsequent seismic processing procedures. Data reconstruction is a crucial and long-standing topic in the exploration seismology field. We extended our previous works on deep learning (DL)-based irregularly and regularly missing 2-D data reconstruction to 3-D data. A key motivation is that the 3-D convolutional neural network (CNN) can take full advantage of the 3-D nature of the data, and the additional dimension allows more information to contribute to the data reconstruction. DL also avoids many assumptions (e.g., linearity, sparsity, and low-rank) limiting conventional nonintelligent reconstruction methods. We built an artificial neural network (ANN) based on an end-to-end U-Net encoder–decoder-style 3-D CNN. The ANN was trained on large quantities of various synthetic and field 3-D seismic data using a mean-squared-error (MSE) loss function and an Adam optimizer. We demonstrated that the developed 3-D CNN reconstruction method appears to outperform the 2-D CNN for 3-D restoration. We benchmarked the ANN’s generalization capacity for recovery of irregularly and regularly sampled 3-D data on several typical seismic data sets, particularly those with high missing percentages or large gaps. An ANN trained with irregularly sampled data can be partly applied to regularly sampled cases. We investigated how a key parameter, i.e., the learning rate, can be experimentally determined. In the context of the presented examples, our methodology provided a substantial improvement over an open-source state-of-the-art rank-reduction-based approach in terms of data fidelity and efficiency. [ABSTRACT FROM AUTHOR]

The efficacy of channel modeling and training for multiple-input multiple-output (MIMO) time-varying flat faded Rayleigh channels is studied herein from the information-theoretical perspective. To characterize the channel dynamics in wide-sense stationary uncorrelated scattering wireless environments, proper autoregressive (AR) channel models for different fading speeds are discussed from the viewpoints of the mean squared error (MSE) and Bayesian Cramér-Rao lower bound (BCRB) of channel estimation. Furthermore, the training efficacy is examined with the achievable capacity when the MSE of channel estimation attains the BCRB. Our numerical simulations show that neither is the first-order AR model enough, nor is a large-order AR model needed for modeling time-varying fading channels. The analysis on BCRB also shows that the influence of the multiple access interference among transmit antennas is not negligible for channel estimation in time-varying fading channels even if using orthogonal sequences for training. As channel tracking can utilize the current and all past training symbols, the optimal training lengths for each data packet may be less than the number of transmit antennas. These results help re-examine the efficacy of model complexity and training overhead, and characterize the achievable rate for MIMO systems that use more practical methods in estimating Rayleigh fading channels. [ABSTRACT FROM AUTHOR]

This paper details the authors' efforts to push the baseline of emotion recognition performance on the Geneva Multimodal Emotion Portrayals (GEMEP) Facial Expression Recognition and Analysis database. Both subject-dependent and subject-independent emotion recognition scenarios are addressed in this paper. The approach toward solving this problem involves face detection, followed by key-point identification, then feature generation, and then, finally, classification. An ensemble of features consisting of hierarchical Gaussianization, scale-invariant feature transform, and some coarse motion features have been used. In the classification stage, we used support vector machines. The classification task has been divided into person-specific and person-independent emotion recognitions using face recognition with either manual labels or automatic algorithms. We achieve 100% performance for the person-specific one, 66% performance for the person-independent one, and 80% performance for overall results, in terms of classification rate, for emotion recognition with manual identification of subjects. [ABSTRACT FROM AUTHOR]