Search

Training of large scale deep neural networks with distributed implementations is an effective way to improve the efficiency. However, high network communication cost for synchronizing gradients and parameters is a major bottleneck in distributed training. In this work, we propose an asynchronous training algorithm based on sampling and mean fusion for distributed recurrent neural network (RNN). In distributed RNN, multiple distributed neuron nodes and an interaction node work together to implement the training. The synchronization overhead is reduced by a unique asynchronous sampling strategy amongst the distributed neuron nodes. Then, in order to make up for the accuracy loss caused by the asynchronous parameter update, a mean fusion algorithm is proposed, where the interaction node averages all local parameters from the distributed neurons. We mathematically prove the convergence of the proposed algorithm. Experimental verification is performed on two language modeling benchmark datasets. The results demonstrate significant speed gains for distributed RNN, while the accuracy loss is less than 1% on average.

Global navigation satellite system interferometric reflectometry (GNSS-IR) represents an extra method to detect snow depth for climate research and water cycle managing. However, using a single frequency of GNSS-IR for snow depth retrieval is often found to be challenging when attempting to achieve a high spatial and temporal sensitivity. To evaluate both the capability of the GNSS-IR snow depth retrieved by the multi-GNSS system and multi-frequency from signal-to-noise ratio (SNR) data, the accuracy of snow depth retrieval by different frequency signals from the multi-GNSS system is analyzed, and a joint retrieval is carried out by combining the multi-GNSS system retrieval results. The SNR data of the global positioning system (GPS), global orbit navigation satellite system (GLONASS), Galileo satellite navigation system (Galileo), and BeiDou navigation satellite system (BDS) from the P387 station of the U.S. Plate Boundary Observatory (PBO) are analyzed. A Lomb–Scargle periodogram (LSP) spectrum analysis is used to compare the difference in reflector height between the snow-free and snow surfaces in order to retrieve the snow depth, which is compared with the PBO snow depth. First, the different frequency retrieval results of the multi-GNSS system are analyzed. Then, the retrieval accuracy of the different GNSS systems is analyzed through multi-frequency mean fusion. Finally, the joint retrieval accuracy of the multi-GNSS system is analyzed through mean fusion. The experimental shows that the retrieval results of different frequencies of the multi-GNSS system have a strong correlation with the PBO snow depth, and that the accuracy is better than 10 cm. The multi-frequency mean fusion of different GNSS systems can effectively improve the retrieval accuracy, which is better than 7 cm. The joint retrieval accuracy of the multi-GNSS system is further improved, with a correlation coefficient (R) between the retrieval snow depth and the PBO snow depth of 0.99, and the accuracy is better than 3 cm. Therefore, using multi-GNSS and multi-frequency data to retrieve the snow depth has a good accuracy and feasibility.

This paper discusses a super-resolution (SR) system implemented on a mobile device. We utilized an Android device's camera to take successive shots and applied a classical multiple-image super-resolution (SR) technique that utilized a set of low-resolution (LR) images. Images taken from the mobile device are subjected to our proposed filtering scheme wherein images that have noticeable presence of blur are discarded to avoid outliers from affecting the produced high-resolution (HR) image. The remaining subset of images are subjected to non-local means denoising, then feature-matched against the first reference LR image. Successive images are then aligned with respect to the first image via affine and perspective warping transformations. The LR images are then upsampled using bicubic interpolation. An L -norm minimization approach, which is essentially taking the pixel-wise mean of the aligned images, is performed to produce the final HR image. Our study shows that our proposed method performs better than the bicubic interpolation, which makes its implementation in a mobile device quite feasible. We have also proven in our experiments that there are substantial differences from images captured using burst mode that can be utilized by an SR algorithm to create an HR image. [ABSTRACT FROM AUTHOR]

Global navigation satellite system interferometric reflectometry (GNSS-IR) represents an extra method to detect snow depth for climate research and water cycle managing. However, using a single frequency of GNSS-IR for snow depth retrieval is often found to be challenging when attempting to achieve a high spatial and temporal sensitivity. To evaluate both the capability of the GNSS-IR snow depth retrieved by the multi-GNSS system and multi-frequency from signal-to-noise ratio (SNR) data, the accuracy of snow depth retrieval by different frequency signals from the multi-GNSS system is analyzed, and a joint retrieval is carried out by combining the multi-GNSS system retrieval results. The SNR data of the global positioning system (GPS), global orbit navigation satellite system (GLONASS), Galileo satellite navigation system (Galileo), and BeiDou navigation satellite system (BDS) from the P387 station of the U.S. Plate Boundary Observatory (PBO) are analyzed. A Lomb–Scargle periodogram (LSP) spectrum analysis is used to compare the difference in reflector height between the snow-free and snow surfaces in order to retrieve the snow depth, which is compared with the PBO snow depth. First, the different frequency retrieval results of the multi-GNSS system are analyzed. Then, the retrieval accuracy of the different GNSS systems is analyzed through multi-frequency mean fusion. Finally, the joint retrieval accuracy of the multi-GNSS system is analyzed through mean fusion. The experimental shows that the retrieval results of different frequencies of the multi-GNSS system have a strong correlation with the PBO snow depth, and that the accuracy is better than 10 cm. The multi-frequency mean fusion of different GNSS systems can effectively improve the retrieval accuracy, which is better than 7 cm. The joint retrieval accuracy of the multi-GNSS system is further improved, with a correlation coefficient (R) between the retrieval snow depth and the PBO snow depth of 0.99, and the accuracy is better than 3 cm. Therefore, using multi-GNSS and multi-frequency data to retrieve the snow depth has a good accuracy and feasibility. [ABSTRACT FROM AUTHOR]