Search

In the field of natural language processing, artificial intelligence (AI) technology has been utilized to solve various problems, such as text classification, similarity measurement, chatbots, machine translation, and machine reading comprehension. Significant advancements have been made in complex and rule-intensive natural language processing through deep learning, in which machines directly learn patterns. Machine reading comprehension, a natural language processing task, involves machines understanding questions and paragraphs to find answers within paragraphs. In 2019, bidirectional encoder representations from transformers (BERT) and a robust optimized BERT pretraining approach (RoBERTa) were introduced. They were then optimized for pretraining and fine-tuning, resulting in significant advancements. RoBERTa outperformed BERT in terms of training speed and performance by increasing the pretraining data and batch sizes, employing dynamic masking, and eliminating the next sentence prediction task. In RoBERTa, machine reading comprehension involves simultaneously inputting questions and paragraphs. However, this simultaneous input method suffers from the attention separate representation (ASP) problem, in which the attention distribution between the question and the paragraph spreads widely across keywords. This study proposed two methods to address the ASP problem. The existing input format, question-paragraph, was changed to three independent inputs: question, paragraph, and concatenated RoBERTa outputs. The concatenated matrix was then transformed into two matrices, and a machine reading comprehension algorithm using co-attention was proposed. An ablation study was conducted to evaluate and analyze the model’s performance, comprehension, and design efficiency. According to the experimental results, the proposed method improved the EM by 0.9% and F1 by 1.0% compared to the existing methods. Consequently, the learning performance was enhanced through attention concentration and co-attention, and it could demonstrate much better performance compared to the existing models.

Vision Transformer (ViT) has been proposed as a new image recognition method in the field of computer vision. ViT applies a Transformer structure with excellent performance in the field of natural language processing to recognize images. Unlike existing Convolutional Neural Network (CNN) models, ViT can achieve State-Of-The-Art (SOTA) image recognition without inputting Inductive Biases into the model, demonstrating that the Transformer is a useful structure in the field of computer vision. However, ViT requires large datasets such as ImageNet-21K and Joint Foto Tree (JFT) for learning. In addition, it takes a lot of time to train. Moreover, there is a problem that location information is lost by inputting images in patch units. To improve such issues, many models are being proposed. In this paper, a new model is proposed by restructuring the Convolutional neural networks Meet vision Transformers (CMT) model by applying Coordinate Attention Block, a CNN model, to improve problems of the Vision Transformer family of models. The proposed model combines Transformer, which has shown excellent performance in Long Range, and CNN, which has shown excellent performance in Local Feature, to achieve higher performance than existing models. We also compared performance of the proposed model with those of existing models with relatively small datasets such as Canadian Institute For Advanced Research-10 (CIFAR-10), Self-Taught Learning-10 (STL-10), and Tiny-ImageNet to facilitate researchers’ access to the evaluation. Despite being restructured from the smallest CMT-Tiny model, the proposed model showed better accuracy than CMT-Tiny, CMT-XS, CMT-S, and CMT-B models with CIFAR-10, STL-10, and Tiny-ImageNet datasets. The proposed model showed an accuracy of 90.21% with the CIFAR-10 dataset, higher than existing CMT models except for the CMT-S model with an accuracy of 90.6%. It had the lowest loss value of 0.3967. The proposed model is expected to be utilized as a backbone in Object Detection and Segmentation fields in the future.

In this paper, we propose a learning model for tracking the isolines of fluid based on the physical properties of particles in particle-based fluid simulations. Our method involves analyzing which weights, closely related to surface tracking among the various physical properties of fluid particles, are significant. These weights are used as input values for the learning algorithm, enabling relatively accurate isoline tracking. In addition, compared to existing learning models such as linear regression, LSTM (long short-term memory), and learning representation (1-layer) models, our method obtained superior surface tracking results without accumulating errors. By using our proposed network structure to track the fluid surface, it learns and predicts values derived from existing fluid simulation algorithms, eliminating the need for computational processes for level-set values and enabling real-time surface tracking. As the scale of the simulation increases, our method significantly reduces the time and resources consumed compared to traditional methods and can track the fluid surface without additional resource consumption. Furthermore, due to our method’s simple network structure, the time consumed in the initial process of loading the model into memory is faster than models such as CNN and LSTM. Our proposed model occupies less than 30 kb of storage space, making it suitable for use in middleware. Lastly, to verify the generality of our method, we conducted tests in a total of five scenes, and in all test scenes, visually natural fluid isolines were represented.

Although Zr-based metal–organic frameworks (MOFs) exhibit robust chemical and physical stability in the presence of moisture and acidic conditions, their susceptibility to nucleophilic attacks from bases poses a critical challenge to their overall stability. Herein, we systematically investigate the stability of Zr-based UiO-66 (UiO = University of Oslo) MOFs in basic solutions. The impact of 11 standard bases, including inorganic salts and organic bases, on the stability of these MOFs is examined. The destruction of the framework is confirmed through powder X-ray diffraction (PXRD) patterns, and the monitored dissolution of ligands from the framework is assessed using nuclear magnetic resonance (NMR) spectroscopy. Our key findings reveal a direct correlation between the strength and concentration of the base and the destruction of the MOFs. The summarized data provide valuable insights that can guide the practical application of Zr-based UiO-66 MOFs under basic conditions, offering essential information for their optimal utilization in various settings.