Search

Digital media platforms (e.g., social media, science blogs) offer opportunities to communicate scientific content to general audiences at scale. However, these audiences vary in their scientific expertise, literacy levels, and personal backgrounds, making effective science communication challenging. To address this challenge, we designed TranSlider, an AI-powered tool that generates personalized translations of scientific text based on individual user profiles (e.g., hobbies, location, and education). Our tool features an interactive slider that allows users to steer the degree of personalization from 0 (weakly relatable) to 100 (strongly relatable), leveraging LLMs to generate the translations with given degrees. Through an exploratory study with 15 participants, we investigated both the utility of these AI-personalized translations and how interactive reading features influenced users' understanding and reading experiences. We found that participants who preferred higher degrees of personalization appreciated the relatable and contextual translations, while those who preferred lower degrees valued concise translations with subtle contextualization. Furthermore, participants reported the compounding effect of multiple translations on their understanding of scientific content. Given these findings, we discuss several implications of AI-personalized translation tools in facilitating communication in collaborative contexts., Comment: 23 pages, 5 figures, 1 table

Two-dimensional (2D) van der Waals (vdW) magnets with layer-dependent magnetic states and/or diverse magnetic interactions and anisotropies have attracted extensive research interest. Despite the advances, a notable challenge persists in effectively manipulating the tunneling anisotropic magnetoresistance (TAMR) of 2D vdW magnet-based magnetic tunnel junctions (MTJs). Here, we report the novel and anomalous tunneling magnetoresistance (TMR) oscillations and pioneering demonstration of bias and gate voltage controllable TAMR in 2D vdw MTJs, utilizing few-layer CrPS4. This material, inherently an antiferromagnet, transitions to a canted magnetic order upon application of external magnetic fields. Through TMR measurements, we unveil the novel, layer-dependent oscillations in the tunneling resistance for few-layer CrPS4 devices under both out-of-plane and in-plane magnetic fields, with a pronounced controllability via gate voltage. Intriguingly, we demonstrate that both the polarity and magnitude of TAMR in CrPS4 can be effectively tuned through either a bias or gate voltage. We further elucidate the mechanism behind this electrically tunable TAMR through first-principles calculations. The implications of our findings are far-reaching, providing new insights into 2D magnetism and opening avenues for the development of innovative spintronic devices based on 2D vdW magnets., Comment: 22 pages, 4 figures

Effective control of magnetic phases in two-dimensional magnets would constitute crucial progress in spintronics, holding great potential for future computing technologies. Here, we report a new approach of leveraging tunneling current as a tool for controlling spin states in CrI3. We reveal that a tunneling current can deterministically switch between spin-parallel and spin-antiparallel states in few-layer CrI3, depending on the polarity and amplitude of the current. We propose a mechanism involving nonequilibrium spin accumulation in the graphene electrodes in contact with the CrI3 layers. We further demonstrate tunneling current-tunable stochastic switching between multiple spin states of the CrI3 tunnel devices, which goes beyond conventional bi-stable stochastic magnetic tunnel junctions and has not been documented in two-dimensional magnets. Our findings not only address the existing knowledge gap concerning the influence of tunneling currents in controlling the magnetism in two-dimensional magnets, but also unlock possibilities for energy-efficient probabilistic and neuromorphic computing., Comment: 23 pages, 4 figures

It has been reported that LLMs can recognize their own writing. As this has potential implications for AI safety, yet is relatively understudied, we investigate the phenomenon, seeking to establish whether it robustly occurs at the behavioral level, how the observed behavior is achieved, and whether it can be controlled. First, we find that the Llama3-8b-Instruct chat model - but not the base Llama3-8b model - can reliably distinguish its own outputs from those of humans, and present evidence that the chat model is likely using its experience with its own outputs, acquired during post-training, to succeed at the writing recognition task. Second, we identify a vector in the residual stream of the model that is differentially activated when the model makes a correct self-written-text recognition judgment, show that the vector activates in response to information relevant to self-authorship, present evidence that the vector is related to the concept of "self" in the model, and demonstrate that the vector is causally related to the model's ability to perceive and assert self-authorship. Finally, we show that the vector can be used to control both the model's behavior and its perception, steering the model to claim or disclaim authorship by applying the vector to the model's output as it generates it, and steering the model to believe or disbelieve it wrote arbitrary texts by applying the vector to them as the model reads them., Comment: 10 pages, 13 figs, 2 tables, submitted to ICLR 2025

Activation engineering is becoming increasingly popular as a means of online control of large language models (LLMs). In this work, we extend the idea of inference-time steering with vectors that represent a behavioral direction of interest to tuning those vectors directly into the model, obviating the need for online control. First, we identify activation vectors related to honesty in an open-source LLM (Llama-2-13b-chat). Next, we demonstrate that model output can be made more or less honest by adding positive or negative multiples of these vectors to residual stream activations during generation. Then, we show that a similar effect can be achieved by fine-tuning the vectors directly into the model, by use of a dual loss function based on the cosine similarity of residual stream activations to the vectors combined with a standard token-based loss ("representation tuning"). Finally, we compare the generations in response to honesty-probing prompts from the resulting models to those from models fine-tuned with a token-based loss alone, and to those from the untuned model subjected to online steering. Overall, fine-tuning the vectors into the models using the cosine similarity plus token loss showed a stronger effect than online steering, and generalized better than using the standard loss, suggesting the potential utility of this approach as a safety measure. Code and data are available at https://github.com/cma1114/representation_tuning. Tuned models are available at https://huggingface.co/collections/cackerman/representation-tuning-66da1e5ab41cd1b824687d9f., Comment: 10 pages, 7 figures, 6 tables

Neuroimaging studies, such as the Human Connectome Project (HCP), often collect multi-faceted and multi-block data to study the complex human brain. However, these data are often analyzed in a pairwise fashion, which can hinder our understanding of how different brain-related measures interact with each other. In this study, we comprehensively analyze the multi-block HCP data using the Data Integration via Analysis of Subspaces (DIVAS) method. We integrate structural and functional brain connectivity, substance use, cognition, and genetics in an exhaustive five-block analysis. This gives rise to the important finding that genetics is the single data modality most predictive of brain connectivity, outside of brain connectivity itself. Nearly 14\% of the variation in functional connectivity (FC) and roughly 12\% of the variation in structural connectivity (SC) is attributed to shared spaces with genetics. Moreover, investigations of shared space loadings provide interpretable associations between particular brain regions and drivers of variability, such as alcohol consumption in the substance-use data block. Novel Jackstraw hypothesis tests are developed for the DIVAS framework to establish statistically significant loadings. For example, in the (FC, SC, and Substance Use) shared space, these novel hypothesis tests highlight largely negative functional and structural connections suggesting the brain's role in physiological responses to increased substance use. Furthermore, our findings have been validated using a subset of genetically relevant siblings or twins not studied in the main analysis., Comment: 38 pages, 6 figures

We present spectroscopic data for four metastable state clear-out transitions between 399 nm and 412 nm for all even long-lived isotopes of Yb$^+$ as well as their hyperfine structure in $^{171}$Yb$^+$. The strong $^2 \rm{D}_{3/2} \rightarrow {}^1[1/2]_{1/2}$ transition at 412 nm represents an attractive alternative for the standard 935 nm repumper used in cooling and trapping experiments, while the transition to the $^3[3/2]_{3/2}$ state at 411 nm clears out the $^2 $F$_{7/2}$ state, for which typically 638 nm or 760 nm are used. These two alternative transitions simplify the experimental setup by removing the need for infrared optics to cool and manipulate Yb$^+$ and may be of particular interest when considering integrated photonics solutions. We also present data for the transitions $^2 $D$_{3/2} \rightarrow {}^3[1/2]_{3/2}$ at 399 nm, and $^2 $D$_{3/2} \rightarrow {}^1[5/2]_{5/2}$ at 410 nm including decay branching ratios of the excited states., Comment: 7 pages, 7 figures

DaCapo is a specialized deep learning library tailored to expedite the training and application of existing machine learning approaches on large, near-isotropic image data. In this correspondence, we introduce DaCapo's unique features optimized for this specific domain, highlighting its modular structure, efficient experiment management tools, and scalable deployment capabilities. We discuss its potential to improve access to large-scale, isotropic image segmentation and invite the community to explore and contribute to this open-source initiative.

We evaluate the robustness of several large language models on multiple datasets. Robustness here refers to the relative insensitivity of the model's answers to meaning-preserving variants of their input. Benchmark datasets are constructed by introducing naturally-occurring, non-malicious perturbations, or by generating semantically equivalent paraphrases of input questions or statements. We further propose a novel metric for assessing a model robustness, and demonstrate its benefits in the non-adversarial scenario by empirical evaluation of several models on the created datasets., Comment: Published in the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP) findings

In this work, we analyze two large-scale surveys to examine how individuals think about sharing smartphone access with romantic partners as a function of trust in relationships. We find that the majority of couples have access to each others' devices, but may have explicit or implicit boundaries on how this access is to be used. Investigating these boundaries and related social norms, we find that there is little consensus about the level of smartphone access (i.e., transparency), or lack thereof (i.e., privacy) that is desirable in romantic contexts. However, there is broad agreement that the level of access should be mutual and consensual. Most individuals understand trust to be the basis of their decisions about transparency and privacy. Furthermore, we find individuals have crossed these boundaries, violating their partners' privacy and betraying their trust. We examine how, when, why, and by whom these betrayals occur. We consider the ramifications of these boundary violations in the case of intimate partner violence. Finally, we provide recommendations for design changes to enable technological enforcement of boundaries currently enforced by trust, bringing access control in line with users' sharing preferences.

This paper presents a routine to align an optical tweezer on a single trapped ion and use the ion as a probe to characterize the tweezer. We find a smallest tweezer waist of $2.3(2)\,\mu$m, which is in agreement with the theoretical minimal attainable waist of $2.5(2)\,\mu$m in our setup. We characterize the spatial dependence of the tweezer Rabi frequency which is suppressed by a factor of 19(3) in the immediate surrounding of the ion. We investigate the effects of optical forces and coherent population trapping on the ion. Finally, we show that the challenges posed by these forces can be overcome, and that the number of tweezers can be easily scaled up to reach several ions by using a spatial light modulator.

A long-standing open conjecture of Branko Gr\"unbaum from 1972 states that any simple arrangement of $n$ pairwise intersecting pseudocircles in the plane can have at most $2n-2$ digons. Agarwal et al. proved this conjecture for arrangements of pairwise intersecting pseudocircles in which there is a common point surrounded by all pseudocircles. Recently, Felsner, Roch and Scheucher showed that Gr\"unbaum's conjecture is true for arrangements of pairwise intersecting pseudocircles in which there are three pseudocircles every pair of which create a digon. In this paper we prove this over 50-year-old conjecture of Gr\"unbaum for any simple arrangement of pairwise intersecting circles in the plane.

We introduce a novel LLM based solution design approach that utilizes combinatorial optimization and sampling. Specifically, a set of factors that influence the quality of the solution are identified. They typically include factors that represent prompt types, LLM inputs alternatives, and parameters governing the generation and design alternatives. Identifying the factors that govern the LLM solution quality enables the infusion of subject matter expert knowledge. Next, a set of interactions between the factors are defined and combinatorial optimization is used to create a small subset $P$ that ensures all desired interactions occur in $P$. Each element $p \in P$ is then developed into an appropriate benchmark. Applying the alternative solutions on each combination, $p \in P$ and evaluating the results facilitate the design of a high quality LLM solution pipeline. The approach is especially applicable when the design and evaluation of each benchmark in $P$ is time-consuming and involves manual steps and human evaluation. Given its efficiency the approach can also be used as a baseline to compare and validate an autoML approach that searches over the factors governing the solution.

This research paper discusses the advances made in the past decade in biomedicine and Large Language Models. To understand how the advances have been made hand-in-hand with one another, the paper also discusses the integration of Natural Language Processing techniques and tools into biomedicine. Finally, the goal of this paper is to expand on a survey conducted last year (2023) by introducing a new list of questions and prompts for the top two language models. Through this survey, this paper seeks to quantify the improvement made in the reasoning abilities in LLMs and to what extent those improvements are felt by the average user. Additionally, this paper seeks to extend research on retrieval of biological literature by prompting the LLM to answer open-ended questions in great depth., Comment: 19 pages, 5 figures

Language Models have demonstrated remarkable capabilities on some tasks while failing dramatically on others. The situation has generated considerable interest in understanding and comparing the capabilities of various Language Models (LMs) but those efforts have been largely ad hoc with results that are often little more than anecdotal. This is in stark contrast with testing and evaluation processes used in healthcare, radar signal processing, and other defense areas. In this paper, we describe Test and Evaluation of Language Models (TEL'M) as a principled approach for assessing the value of current and future LMs focused on high-value commercial, government and national security applications. We believe that this methodology could be applied to other Artificial Intelligence (AI) technologies as part of the larger goal of "industrializing" AI.

Social media systems are as varied as they are pervasive. They have been almost universally adopted for a broad range of purposes including work, entertainment, activism, and decision making. As a result, they have also diversified, with many distinct designs differing in content type, organization, delivery mechanism, access control, and many other dimensions. In this work, we aim to characterize and then distill a concise design space of social media systems that can help us understand similarities and differences, recognize potential consequences of design choices, and identify spaces for innovation. Our model, which we call Form-From, characterizes social media based on (1) the form of the content, either threaded or flat, and (2) from where or from whom one might receive content, ranging from spaces to networks to the commons. We derive Form-From inductively from a larger set of 62 dimensions organized into 10 categories. To demonstrate the utility of our model, we trace the history of social media systems as they traverse the Form-From space over time, and we identify common design patterns within cells of the model.

We study semantic models of probabilistic programming languages over graphs, and establish a connection to graphons from graph theory and combinatorics. We show that every well-behaved equational theory for our graph probabilistic programming language corresponds to a graphon, and conversely, every graphon arises in this way. We provide three constructions for showing that every graphon arises from an equational theory. The first is an abstract construction, using Markov categories and monoidal indeterminates. The second and third are more concrete. The second is in terms of traditional measure theoretic probability, which covers 'black-and-white' graphons. The third is in terms of probability monads on the nominal sets of Gabbay and Pitts. Specifically, we use a variation of nominal sets induced by the theory of graphs, which covers Erd\H{o}s-R\'enyi graphons. In this way, we build new models of graph probabilistic programming from graphons., Comment: Accepted for POPL 2024

We provide a characterization of when a countably infinite set of finite sets contains an infinite sunflower. We also show that the collection of such sets is Turing equivalent to the set of programs such that whenever the program converges it returns the code of a program with finite range.

Semantic consistency of a language model is broadly defined as the model's ability to produce semantically-equivalent outputs, given semantically-equivalent inputs. We address the task of assessing question-answering (QA) semantic consistency of contemporary large language models (LLMs) by manually creating a benchmark dataset with high-quality paraphrases for factual questions, and release the dataset to the community. We further combine the semantic consistency metric with additional measurements suggested in prior work as correlating with LLM QA accuracy, for building and evaluating a framework for factual QA reference-less performance prediction -- predicting the likelihood of a language model to accurately answer a question. Evaluating the framework on five contemporary LLMs, we demonstrate encouraging, significantly outperforming baselines, results., Comment: EMNLP2023 GEM workshop, 17 pages

We study sunflowers within the context of finitely generated substructures of ultrahomogeneous structures. In particular, we look at bounds on how large a set system is needed to guarantee the existence of sunflowers of a given size. We show that if we fix the size of the sunflower, the function which takes the size of the substructures in our set system and outputs the size of a set system needed to guarantee a sunflower of the desired size can grow arbitrarily slowly.

A corpus of vector-embedded text documents has some empirical distribution. Given two corpora, we want to calculate a single metric of distance (e.g., Mauve, Frechet Inception) between them. We describe an abstract quality, called `distributionality', of such metrics. A non-distributional metric tends to use very local measurements, or uses global measurements in a way that does not fully reflect the distributions' true distance. For example, if individual pairwise nearest-neighbor distances are low, it may judge the two corpora to have low distance, even if their two distributions are in fact far from each other. A more distributional metric will, in contrast, better capture the distributions' overall distance. We quantify this quality by constructing a Known-Similarity Corpora set from two paraphrase corpora and calculating the distance between paired corpora from it. The distances' trend shape as set element separation increases should quantify the distributionality of the metric. We propose that Average Hausdorff Distance and energy distance between corpora are representative examples of non-distributional and distributional distance metrics, to which other metrics can be compared, to evaluate how distributional they are., Comment: Published in the August 2023 Joint Statistical Meetings proceedings

Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the detection of anomalies in logs, providing assistance to site reliability engineers (SREs) in system diagnosis. Log patterns change over time, necessitating updates to the LAD model defining the `normal' log activity profile. In this paper, we introduce a Bayes Factor-based drift detection method that identifies when intervention, retraining, and updating of the LAD model are required with human involvement. We illustrate our method using sequences of log activity, both from unaltered data, and simulated activity with controlled levels of anomaly contamination, based on real collected log data.

Suppose $\mathscr{L}^-\subseteq \mathscr{L}$ are languages where $\mathscr{L} \setminus\mathscr{L}^-$ is relational. Additionally, let $\mathbf{K}$ be a strong $\textrm{Fra\"iss\'e}$ class in $\mathscr{L}$. We consider the partial ordering, under substructure, of those elements in $\mathbf{K}$ whose reduct to $\mathscr{L}^-$ are substructures of a fixed $\mathscr{L}^-$-structure $\mathcal{M}^-$. In this paper, we establish that, under general conditions, this partial order satisfies the $|\mathcal{M}^-|$-chain condition. Furthermore, under these conditions, we demonstrate that any generic for such a partial order satisfies the theory of the \Fraisse\ limit of $\mathbf{K}$, provided $\mathcal{M}^-$ satisfies the theory of$\textrm{Fra\"iss\'e}$ limit of its age. We also provide general conditions that guarantee all such generics to be rigid, as well as conditions ensuring that these generics possess large automorphism groups.