Search

Scene Text Recognition (STR), the critical step in OCR systems, has attracted much attention in computer vision. Recent research on modeling textual semantics with Language Model (LM) has witnessed remarkable progress. However, LM only optimizes the joint probability of the estimated characters generated from the Vision Model (VM) in a single language modality, ignoring the visual-semantic relations in different modalities. Thus, LM-based methods can hardly generalize well to some challenging conditions, in which the text has weak or multiple semantics, arbitrary shape, and so on. To migrate the above issue, in this paper, we propose Multimodal Visual-Semantic Representations Learning for Text Recognition Network (MVSTRN) to reason and combine the multimodal visual-semantic information for accurate Scene Text Recognition. Specifically, our MVSTRN builds a bridge between vision and language through its unified architecture and has the ability to reason visual semantics by guiding the network to reconstruct the original image from the latent text representation, breaking the structural gap between vision and language. Finally, the tailored multimodal Fusion (MMF) module is motivated to combine the multimodal visual and textual semantics from VM and LM to make the final predictions. Extensive experiments demonstrate our MVSTRN achieves state-of-the-art performance on several benchmarks. [ABSTRACT FROM AUTHOR]

Reverse chemical ecology has been widely applied for the functional characterization of olfactory proteins in various arthropods, but few related studies have focused on parasitic wasps. Here, the odorant carrier Niemann-Pick C2 protein of Baryscapus dioryctriae (BdioNPC2b) was studied in vitro and in vivo. Ligand binding analysis revealed that BdioNPC2b most strongly bound to 2-butyl-2-octenal and which compound could elicit an EAG response and attracted B. dioryctriae adults. Moreover, this odorant attractant significantly improved the reproductive efficiency of B. dioryctriae compared to that of the control. Then, the relationship between BdioNPC2b and 2-butyl-2-octenal was validated by RNAi, and site-directed mutagenesis revealed the involvement of three key residues of BdioNPC2b in binding to 2-butyl-2-octenal through hydrogen bonding. Our findings provide not only a deeper understanding of the olfactory function of NPC2 in wasps but also useful information for improving the performance of the parasitoid B. dioryctriae as a biological control agent.