Search

This study presents a novel learning approach designed to enhance both mathematical reasoning and problem-solving abilities of Large Language Models (LLMs). We focus on integrating the Chain-of-Thought (CoT) and the Program-of-Thought (PoT) learning, hypothesizing that prioritizing the learning of mathematical reasoning ability is helpful for the amplification of problem-solving ability. Thus, the initial learning with CoT is essential for solving challenging mathematical problems. To this end, we propose a sequential learning approach, named SAAS (Solving Ability Amplification Strategy), which strategically transitions from CoT learning to PoT learning. Our empirical study, involving an extensive performance comparison using several benchmarks, demonstrates that our SAAS achieves state-of-the-art (SOTA) performance. The results underscore the effectiveness of our sequential learning approach, marking a significant advancement in the field of mathematical reasoning in LLMs., Comment: Accepted to EMNLP 2024 Industry Track

This research was focused on the efficient collection of experimental Metal-Organic Framework (MOF) data from scientific literature to address the challenges of accessing hard-to-find data and improving the quality of information available for machine learning studies in materials science. Utilizing a chain of advanced Large Language Models (LLMs), we developed a systematic approach to extract and organize MOF data into a structured format. Our methodology successfully compiled information from more than 40,000 research articles, creating a comprehensive and ready-to-use dataset. The findings highlight the significant advantage of incorporating experimental data over relying solely on simulated data for enhancing the accuracy of machine learning predictions in the field of MOF research.

Stimulated by the sophisticated reasoning capabilities of recent Large Language Models (LLMs), a variety of strategies for bridging video modality have been devised. A prominent strategy involves Video Language Models (VideoLMs), which train a learnable interface with video data to connect advanced vision encoders with LLMs. Recently, an alternative strategy has surfaced, employing readily available foundation models, such as VideoLMs and LLMs, across multiple stages for modality bridging. In this study, we introduce a simple yet novel strategy where only a single Vision Language Model (VLM) is utilized. Our starting point is the plain insight that a video comprises a series of images, or frames, interwoven with temporal information. The essence of video comprehension lies in adeptly managing the temporal aspects along with the spatial details of each frame. Initially, we transform a video into a single composite image by arranging multiple frames in a grid layout. The resulting single image is termed as an image grid. This format, while maintaining the appearance of a solitary image, effectively retains temporal information within the grid structure. Therefore, the image grid approach enables direct application of a single high-performance VLM without necessitating any video-data training. Our extensive experimental analysis across ten zero-shot video question answering benchmarks, including five open-ended and five multiple-choice benchmarks, reveals that the proposed Image Grid Vision Language Model (IG-VLM) surpasses the existing methods in nine out of ten benchmarks., Comment: Our code is available at https://github.com/imagegridworth/IG-VLM

Class Incremental Learning (CIL) constitutes a pivotal subfield within continual learning, aimed at enabling models to progressively learn new classification tasks while retaining knowledge obtained from prior tasks. Although previous studies have predominantly focused on backward compatible approaches to mitigate catastrophic forgetting, recent investigations have introduced forward compatible methods to enhance performance on novel tasks and complement existing backward compatible methods. In this study, we introduce an effective-Rank based Feature Richness enhancement (RFR) method, designed for improving forward compatibility. Specifically, this method increases the effective rank of representations during the base session, thereby facilitating the incorporation of more informative features pertinent to unseen novel tasks. Consequently, RFR achieves dual objectives in backward and forward compatibility: minimizing feature extractor modifications and enhancing novel task performance, respectively. To validate the efficacy of our approach, we establish a theoretical connection between effective rank and the Shannon entropy of representations. Subsequently, we conduct comprehensive experiments by integrating RFR into eleven well-known CIL methods. Our results demonstrate the effectiveness of our approach in enhancing novel-task performance while mitigating catastrophic forgetting. Furthermore, our method notably improves the average incremental accuracy across all eleven cases examined.

In this study, a versatile methodology for initiating polymerization from monomers in highly cross-linked materials is investigated. As polymerization progresses, force-field parameters undergo continuous modification due to the formation of new chemical bonds. This dynamic process not only impacts the atoms directly involved in bonding, but also influences the neighboring atomic environment. Monitoring these complex changes in highly cross-linked structures poses a challenge. To address this issue, we introduce a graph-network-based algorithm that offers both rapid and accurate predictions. The algorithm merges polymer construction protocols with LAMMPS, a large-scale molecular dynamics simulation software. The adaptability of this code has been demonstrated by its successful application to various amorphous polymers, including porous polymer networks (PPNs), and epoxy-resins, while the algorithm has been employed for additional tasks, such as implementing pore-piercing deformations and calculating material properties.

We have developed MatGD (Material Graph Digitizer), which is a tool for digitizing a data line from scientific graphs. The algorithm behind the tool consists of four steps: (1) identifying graphs within subfigures, (2) separating axes and data sections, (3) discerning the data lines by eliminating irrelevant graph objects and matching with the legend, and (4) data extraction and saving. From the 62,534 papers in the areas of batteries, catalysis, and MOFs, 501,045 figures were mined. Remarkably, our tool showcased performance with over 99% accuracy in legend marker and text detection. Moreover, its capability for data line separation stood at 66%, which is much higher compared to other existing figure mining tools. We believe that this tool will be integral to collecting both past and future data from publications, and these data can be used to train various machine learning models that can enhance material predictions and new materials discovery., Comment: 23 pages, 4 figures

Most photocatalytic and photovoltaic devices operate under broadband, constant illumination. Electron and hole dynamics in these devices, however, are usually measured using ultrafast pulsed lasers in a narrow wavelength range. In this work, we prove that steady-state, photomodulated X-ray spectra from a non-time-resolved synchrotron beamline can be used to estimate electron and hole distributions. A set of plasmonic metal core-shell nanoparticles is designed to systematically isolate photothermal, hot electron, and thermalized electron-hole pairs in a TiO2 shell. Steady-state changes in the Ti L2,3 edge are measured with and without continuous-wave illumination of the nanoparticle's localized surface plasmon resonance. Ab initio excited-state X-ray theory developed for transient X-ray measurements is then applied to model the experimental spectra in an attempt to extract the resultant steady-state carrier distributions. The results suggest that, within error, the quasi-equilibrium carrier distribution can be determined even from relatively noisy data with mixed excited-state phenomena., Comment: 41 pages, 18 figures

Electron energy-loss spectroscopy (EELS) can measure similar information to X-ray, UV-Vis, and IR spectroscopies but with atomic resolution and increased scattering cross sections. Recent advances in electron monochromators have expanded EELS capabilities from chemical identification to the realms of synchrotron-level core-loss measurements and to low-loss, 10-100 meV excitations such as phonons, excitons, and valence structure. EELS measurements are easily correlated with electron diffraction and atomic-scale real-space imaging in a transmission electron microscope (TEM) to provide detailed local pictures of quasiparticle and bonding states. This perspective provides an overview of existing high-resolution EELS (HR-EELS) capabilities while also motivating the powerful next step in the field - ultrafast EELS in a TEM. Ultrafast EELS aims to combine atomic level, element specific, and correlated temporal measurements to better understand spatially specific excited state phenomena. Ultrafast EELS measurements also add to the abilities of steady-state HR-EELS by being able to image the electromagnetic field and use electrons to excite photon-forbidden and momentum-specific transitions. We discuss the technical challenges ultrafast HR-EELS currently faces, as well as how integration with in situ and cryo measurements could expand the technique to new systems of interest, especially molecular and biological samples.

Incorporation of catalytically active materials into plasmonic metal nanostructures can efficiently merge the reactivity and energy harvesting abilities of both types of materials for visible light photocatalysis. Here we explore the influence of electromagnetic hotspots in the ability of plasmonic core-shell colloidal structures to induce chemical transformations. For this study, we developed a synthetic strategy for the fabrication of Au nanoparticle (NP) trimers in aqueous solution through fine controlled galvanic replacement between Ag nanoprisms and Au precursors. Core-shell Au@M NP trimers with catalytically active metals (M = Pd, Pt) were subsequently synthesized using Au NP trimers as templates. Our experimental and computational results highlight the synergy of geometry and composition in plasmonic catalysts for plasmon-driven chemical reactions.

Adversarial training is a defense technique that improves adversarial robustness of a deep neural network (DNN) by including adversarial examples in the training data. In this paper, we identify an overlooked problem of adversarial training in that these adversarial examples often have different semantics than the original data, introducing unintended biases into the model. We hypothesize that such non-semantics-preserving (and resultingly ambiguous) adversarial data harm the robustness of the target models. To mitigate such unintended semantic changes of adversarial examples, we propose semantics-preserving adversarial training (SPAT) which encourages perturbation on the pixels that are shared among all classes when generating adversarial examples in the training stage. Experiment results show that SPAT improves adversarial robustness and achieves state-of-the-art results in CIFAR-10 and CIFAR-100., Comment: Preprint. Under Review