Search

We study how to apply large language models to write grounded and organized long-form articles from scratch, with comparable breadth and depth to Wikipedia pages. This underexplored problem poses new challenges at the pre-writing stage, including how to research the topic and prepare an outline prior to writing. We propose STORM, a writing system for the Synthesis of Topic Outlines through Retrieval and Multi-perspective Question Asking. STORM models the pre-writing stage by (1) discovering diverse perspectives in researching the given topic, (2) simulating conversations where writers carrying different perspectives pose questions to a topic expert grounded on trusted Internet sources, (3) curating the collected information to create an outline. For evaluation, we curate FreshWiki, a dataset of recent high-quality Wikipedia articles, and formulate outline assessments to evaluate the pre-writing stage. We further gather feedback from experienced Wikipedia editors. Compared to articles generated by an outline-driven retrieval-augmented baseline, more of STORM's articles are deemed to be organized (by a 25% absolute increase) and broad in coverage (by 10%). The expert feedback also helps identify new challenges for generating grounded long articles, such as source bias transfer and over-association of unrelated facts., Comment: 27 pages, NAACL 2024 Main Conference

Two-dimensional (2D) materials have attracted extensive attention due to their unique characteristics and application potentials. Raman spectroscopy, as a rapid and non-destructive probe, exhibits distinct features and holds notable advantages in the structural characterization of 2D materials. However, traditional data analysis of Raman spectra relies on manual interpretation and feature extraction, which are both time-consuming and subjective. In this work, we employ deep learning techniques, including classificatory and generative deep learning, to assist the analysis of Raman spectra of typical 2D materials. For the limited and unevenly distributed Raman spectral data, we propose a data augmentation approach based on Denoising Diffusion Probabilistic Models (DDPM) to augment the training dataset and construct a four-layer Convolutional Neural Network (CNN) for 2D material classification. Experimental results illustrate the effectiveness of DDPM in addressing data limitations and significantly improved classification model performance. The proposed DDPM-CNN method shows high reliability, with 100%classification accuracy. Our work demonstrates the practicality of deep learning-assisted Raman spectroscopy for high-precision recognition and classification of 2D materials, offering a promising avenue for rapid and automated spectral analysis.

The recursive intra-frame block partitioning decision process, a crucial component of the next-generation video coding standards, exerts significant influence over the encoding time. In this paper, we propose an encoder-decoder neural network (NN) to accelerate this process. Specifically, a CNN is utilized to compress the pixel data of the largest coding unit (LCU) into a fixed-length vector. Subsequently, a Transformer decoder is employed to transcribe the fixed-length vector into a variable-length vector, which represents the block partitioning outcomes of the encoding LCU. The vector transcription process adheres to the constraints imposed by the block partitioning algorithm. By fully parallelizing the NN prediction in the intra-mode decision, substantial time savings can be attained during the decision phase. The experimental results obtained from high-definition (HD) sequences coding demonstrate that this framework achieves a remarkable 87.84\% reduction in encoding time, with a relatively small loss (8.09\%) of coding performance compared to AVS3 HPM4.0.

Raman spectroscopy provides spectral information related to the specific molecular structures of substances and has been well established as a powerful tool for studying biological tissues and diagnosing diseases. This article reviews recent advances in Raman spectroscopy and its applications in diagnosing various critical diseases, including cancers, infections, and neurodegenerative diseases, and in predicting surgical outcomes. These advances are explored through discussion of state-of-the-art forms of Raman spectroscopy, such as surface-enhanced Raman spectroscopy, resonance Raman spectroscopy, and tip-enhanced Raman spectroscopy employed in biomedical sciences. We discuss biomedical applications, including various aspects and methods of ex vivo and in vivo medical diagnosis, sample collection, data processing, and achievements in realizing the correlation between Raman spectra and biochemical information in certain diseases. Finally, we present the limitations of the current study and provide perspectives for future research.

Matters Arising in Nature on "Evidence for a single layer van der Waals multiferroic". The search for two dimensional multiferroic materials is an exciting yet challenging endeavor. Recently, Song reported the exciting discovery of type II multiferroic order in an antiferromagnetic (AFM) NiI2 single layer and concluded the ferroelectric (FE) polarization induced by a helical magnetic order1. Their finding was presented from all optical experimental evidence, based on the methods of second harmonic generation (SHG) and linear dichroism (LD). However, the all optical characterizations cannot serve as unanimous evidence of the FE existence, particularly in conjunction with magnetic orders in a single layer NiI2 multiferroic. We have designed and built a Magneto-Optical-Electric Joint-measurement Scanning Imaging system (MOEJSI) for identification of two-dimensional vdW multiferroic., Comment: 7 pages

Instead of mining coherent topics from a given text corpus in a completely unsupervised manner, seed-guided topic discovery methods leverage user-provided seed words to extract distinctive and coherent topics so that the mined topics can better cater to the user's interest. To model the semantic correlation between words and seeds for discovering topic-indicative terms, existing seed-guided approaches utilize different types of context signals, such as document-level word co-occurrences, sliding window-based local contexts, and generic linguistic knowledge brought by pre-trained language models. In this work, we analyze and show empirically that each type of context information has its value and limitation in modeling word semantics under seed guidance, but combining three types of contexts (i.e., word embeddings learned from local contexts, pre-trained language model representations obtained from general-domain training, and topic-indicative sentences retrieved based on seed information) allows them to complement each other for discovering quality topics. We propose an iterative framework, SeedTopicMine, which jointly learns from the three types of contexts and gradually fuses their context signals via an ensemble ranking process. Under various sets of seeds and on multiple datasets, SeedTopicMine consistently yields more coherent and accurate topics than existing seed-guided topic discovery approaches., Comment: 9 pages; Accepted to WSDM 2023

Given a few seed entities of a certain type (e.g., Software or Programming Language), entity set expansion aims to discover an extensive set of entities that share the same type as the seeds. Entity set expansion in software-related domains such as StackOverflow can benefit many downstream tasks (e.g., software knowledge graph construction) and facilitate better IT operations and service management. Meanwhile, existing approaches are less concerned with two problems: (1) How to deal with multiple types of seed entities simultaneously? (2) How to leverage the power of pre-trained language models (PLMs)? Being aware of these two problems, in this paper, we study the entity set co-expansion task in StackOverflow, which extracts Library, OS, Application, and Language entities from StackOverflow question-answer threads. During the co-expansion process, we use PLMs to derive embeddings of candidate entities for calculating similarities between entities. Experimental results show that our proposed SECoExpan framework outperforms previous approaches significantly., Comment: 4 pages; Accepted to IEEE BigData 2022

Electronic phase separation (EPS) originates from an incomplete transformation between electronic phases, causing the inhomogeneous spatial distribution of electronic properties. In the system of two-dimensional electron gas (2DEG), the EPS is usually identified based on a percolative metal-to-superconductor transition. Here, we report a metal-insulator transition (MIT) in KTaO3-based 2DEG with the width of conductive channel decreasing into micrometer scale. Hysteretic resistance-temperature relations are observed due to the competition between metallic and insulating phases, which is tunable by magnetic field. Such a size-dependent MIT effect is attributed to the coexistence and separation of metallic and insulating phases. Combining density functional theory calculation, we propose a theoretical model to simulate the dynamic process of the EPS using the percolation theory, demonstrating the mechanism of size-dependent MIT. Our work suggests a clear and simple 2DEG platform to achieve the spatial coexistence of metallic and insulating phases.

Ferroelectrics are essential in low-dimensional memory devices for multi-bit storage and high-density integration. A polar structure is a necessary premise for ferroelectricity, mainly existing in compounds. However, it is usually rare in elemental materials, causing a lack of spontaneous electric polarization. Here, we report an unexpected room-temperature ferroelectricity in few-chain Te nanowires. Out-of-plane ferroelectric loops and domain reversal are observed by piezoresponse force microscopy. Through density functional theory, we attribute the ferroelectricity to the ion-displacement created by the interlayer interaction between lone pair electrons. Ferroelectric polarization can induce a strong field effect on the transport along the Te chain, supporting a self-gated field-effect transistor. It enables a nonvolatile memory with high in-plane mobility, zero supply voltage, multilevel resistive states, and a high on/off ratio. Our work provides new opportunities for elemental ferroelectrics with polar structures and paves a way towards applications such as low-power dissipation electronics and computing-in-memory devices.