Search

The rich diversity of multi-planetary systems and their architectures is greatly contrasted by the uniformity exhibited within many of these systems. Previous studies have shown that compact Kepler systems tend to exhibit a peas-in-a-pod architecture: Planets in the same system tend to have similar sizes and masses and be regularly spaced in orbits with low eccentricities and mutual inclinations. This work extends on previous research and examines a larger and more diverse sample comprising all the systems with a minimum of three confirmed planets, resulting in 282 systems and 991 planets. We investigated the system architectures, focusing on the orbital spacings between adjacent planets as well as their relationships with the planets' sizes and masses. We also quantified the similarities of the sizes, masses, and spacings of planets within each system, conducting both intra- and inter-system analyses. Our results corroborate previous research showing that planets orbiting the same star tend to be regularly spaced and that pairs of adjacent planets with radii<1 R_Earth predominantly have orbital period ratios (PRs)<2. In contrast to other studies, we identified a significant similarity of adjacent orbital spacings not only at PRs<4 but also at 1.17

Recent state-of-the-art authorship attribution methods learn authorship representations of texts in a latent, non-interpretable space, hindering their usability in real-world applications. Our work proposes a novel approach to interpreting these learned embeddings by identifying representative points in the latent space and utilizing LLMs to generate informative natural language descriptions of the writing style of each point. We evaluate the alignment of our interpretable space with the latent one and find that it achieves the best prediction agreement compared to other baselines. Additionally, we conduct a human evaluation to assess the quality of these style descriptions, validating their utility as explanations for the latent space. Finally, we investigate whether human performance on the challenging AA task improves when aided by our system's explanations, finding an average improvement of around +20% in accuracy., Comment: 8 pages, 8 figures, under review

Explanations form the foundation of knowledge sharing and build upon communication principles, social dynamics, and learning theories. We focus specifically on conversational approaches for explanations because the context is highly adaptive and interactive. Our research leverages previous work on explanatory acts, a framework for understanding the different strategies that explainers and explainees employ in a conversation to both explain, understand, and engage with the other party. We use the 5-Levels dataset was constructed from the WIRED YouTube series by Wachsmuth et al., and later annotated by Booshehri et al. with explanatory acts. These annotations provide a framework for understanding how explainers and explainees structure their response when crafting a response. With the rise of generative AI in the past year, we hope to better understand the capabilities of Large Language Models (LLMs) and how they can augment expert explainer's capabilities in conversational settings. To achieve this goal, the 5-Levels dataset (We use Booshehri et al.'s 2023 annotated dataset with explanatory acts.) allows us to audit the ability of LLMs in engaging in explanation dialogues. To evaluate the effectiveness of LLMs in generating explainer responses, we compared 3 different strategies, we asked human annotators to evaluate 3 different strategies: human explainer response, GPT4 standard response, GPT4 response with Explanation Moves., Comment: 6 figures, 5 pages

The New York Times Connections game has emerged as a popular and challenging pursuit for word puzzle enthusiasts. We collect 438 Connections games to evaluate the performance of state-of-the-art large language models (LLMs) against expert and novice human players. Our results show that even the best performing LLM, Claude 3.5 Sonnet, which has otherwise shown impressive reasoning abilities on a wide variety of benchmarks, can only fully solve 18% of the games. Novice and expert players perform better than Claude 3.5 Sonnet, with expert human players significantly outperforming it. We create a taxonomy of the knowledge types required to successfully cluster and categorize words in the Connections game. We find that while LLMs perform relatively well on categorizing words based on semantic relations they struggle with other types of knowledge such as Encyclopedic Knowledge, Multiword Expressions or knowledge that combines both Word Form and Meaning. Our results establish the New York Times Connections game as a challenging benchmark for evaluating abstract reasoning capabilities in AI systems.

Large Vision-Language Models (VLMs) have demonstrated strong capabilities in tasks requiring a fine-grained understanding of literal meaning in images and text, such as visual question-answering or visual entailment. However, there has been little exploration of these models' capabilities when presented with images and captions containing figurative meaning, such as metaphors or humor. To close this gap, we propose a new task framing the figurative meaning understanding problem as an explainable visual entailment task, where the model has to predict whether the image (premise) entails a caption (hypothesis) and justify the predicted label with a textual explanation. The figurative phenomena can be present either in the image, the caption, or both. Utilizing a human-AI collaboration approach, we build the accompanying expert-verified dataset V-FLUTE, containing 6,027 {image, caption, label, explanation} instances spanning five diverse figurative phenomena: metaphors, similes, idioms, sarcasm, and humor. Through automatic evaluation, we find that VLMs struggle to generalize from literal to figurative meaning, particularly when it is present in images. Further, we identify common types of errors in VLM reasoning via human evaluation.

Digital education has gained popularity in the last decade, especially after the COVID-19 pandemic. With the improving capabilities of large language models to reason and communicate with users, envisioning intelligent tutoring systems (ITSs) that can facilitate self-learning is not very far-fetched. One integral component to fulfill this vision is the ability to give accurate and effective feedback via hints to scaffold the learning process. In this survey article, we present a comprehensive review of prior research on hint generation, aiming to bridge the gap between research in education and cognitive science, and research in AI and Natural Language Processing. Informed by our findings, we propose a formal definition of the hint generation task, and discuss the roadmap of building an effective hint generation system aligned with the formal definition, including open challenges, future directions and ethical considerations., Comment: Submitted to TACL'24

Recognizing fallacies is crucial for ensuring the quality and validity of arguments across various domains. However, computational fallacy recognition faces challenges due to the diverse genres, domains, and types of fallacies found in datasets. This leads to a highly multi-class, and even multi-label, setup with substantial class imbalance. In this study, we aim to enhance existing models for fallacy recognition by incorporating additional context and by leveraging large language models to generate synthetic data, thus increasing the representation of the infrequent classes. We experiment with GPT3.5 to generate synthetic examples and we examine the impact of prompt settings for this. Moreover, we explore zero-shot and few-shot scenarios to evaluate the effectiveness of using the generated examples for training smaller models within a unified fallacy recognition framework. Furthermore, we analyze the overlap between the synthetic data and existing fallacy datasets. Finally, we investigate the usefulness of providing supplementary context for detecting fallacy types that need such context, e.g., diversion fallacies. Our evaluation results demonstrate consistent improvements across fallacy types, datasets, and generators. The code and the synthetic datasets are all publicly available.

In the last decade, the United States has lost more than 500,000 people from an overdose involving prescription and illicit opioids making it a national public health emergency (USDHHS, 2017). Medical practitioners require robust and timely tools that can effectively identify at-risk patients. Community-based social media platforms such as Reddit allow self-disclosure for users to discuss otherwise sensitive drug-related behaviors. We present a moderate size corpus of 2500 opioid-related posts from various subreddits labeled with six different phases of opioid use: Medical Use, Misuse, Addiction, Recovery, Relapse, Not Using. For every post, we annotate span-level extractive explanations and crucially study their role both in annotation quality and model development. We evaluate several state-of-the-art models in a supervised, few-shot, or zero-shot setting. Experimental results and error analysis show that identifying the phases of opioid use disorder is highly contextual and challenging. However, we find that using explanations during modeling leads to a significant boost in classification accuracy demonstrating their beneficial role in a high-stakes domain such as studying the opioid use disorder continuum., Comment: NAACL 2024 Findings (Camera-Ready Version). Codes and Data are available at https://github.com/yangalan123/OpioidID

Natural language instructions are a powerful interface for editing the outputs of text-to-image diffusion models. However, several challenges need to be addressed: 1) underspecification (the need to model the implicit meaning of instructions) 2) grounding (the need to localize where the edit has to be performed), 3) faithfulness (the need to preserve the elements of the image not affected by the edit instruction). Current approaches focusing on image editing with natural language instructions rely on automatically generated paired data, which, as shown in our investigation, is noisy and sometimes nonsensical, exacerbating the above issues. Building on recent advances in segmentation, Chain-of-Thought prompting, and visual question answering, we significantly improve the quality of the paired data. In addition, we enhance the supervision signal by highlighting parts of the image that need to be changed by the instruction. The model fine-tuned on the improved data is capable of performing fine-grained object-centric edits better than state-of-the-art baselines, mitigating the problems outlined above, as shown by automatic and human evaluations. Moreover, our model is capable of generalizing to domains unseen during training, such as visual metaphors., Comment: Findings of EMNLP 2023 (Long paper)

Social norms fundamentally shape interpersonal communication. We present NormDial, a high-quality dyadic dialogue dataset with turn-by-turn annotations of social norm adherences and violations for Chinese and American cultures. Introducing the task of social norm observance detection, our dataset is synthetically generated in both Chinese and English using a human-in-the-loop pipeline by prompting large language models with a small collection of expert-annotated social norms. We show that our generated dialogues are of high quality through human evaluation and further evaluate the performance of existing large language models on this task. Our findings point towards new directions for understanding the nuances of social norms as they manifest in conversational contexts that span across languages and cultures., Comment: EMNLP 2023 Main Conference, Short Paper; Data at https://github.com/Aochong-Li/NormDial

Researchers have argued that large language models (LLMs) exhibit high-quality writing capabilities from blogs to stories. However, evaluating objectively the creativity of a piece of writing is challenging. Inspired by the Torrance Test of Creative Thinking (TTCT), which measures creativity as a process, we use the Consensual Assessment Technique [3] and propose the Torrance Test of Creative Writing (TTCW) to evaluate creativity as a product. TTCW consists of 14 binary tests organized into the original dimensions of Fluency, Flexibility, Originality, and Elaboration. We recruit 10 creative writers and implement a human assessment of 48 stories written either by professional authors or LLMs using TTCW. Our analysis shows that LLM-generated stories pass 3-10X less TTCW tests than stories written by professionals. In addition, we explore the use of LLMs as assessors to automate the TTCW evaluation, revealing that none of the LLMs positively correlate with the expert assessments., Comment: ACM CHI 2024

The development of large language models (LLMs) capable of following instructions and engaging in conversational interactions sparked increased interest in their utilization across various support tools. We investigate the utility of modern LLMs in assisting professional writers via an empirical user study (n=30). The design of our collaborative writing interface is grounded in the cognitive process model of writing that views writing as a goal-oriented thinking process encompassing non-linear cognitive activities: planning, translating, and reviewing. Participants are asked to submit a post-completion survey to provide feedback on the potential and pitfalls of LLMs as writing collaborators. Upon analyzing the writer-LLM interactions, we find that while writers seek LLM's help across all three types of cognitive activities, they find LLMs more helpful in translation and reviewing. Our findings from analyzing both the interactions and the survey responses highlight future research directions in creative writing assistance using LLMs.

While state-of-the-art large language models (LLMs) can excel at adapting text from one style to another, current work does not address the explainability of style transfer models. Recent work has explored generating textual explanations from larger teacher models and distilling them into smaller student models. One challenge with such approach is that LLM outputs may contain errors that require expertise to correct, but gathering and incorporating expert feedback is difficult due to cost and availability. To address this challenge, we propose ICLEF, a novel human-AI collaboration approach to model distillation that incorporates scarce expert human feedback by combining in-context learning and model self-critique. We show that our method leads to generation of high-quality synthetic explainable style transfer datasets for formality (e-GYAFC) and subjective bias (e-WNC). Via automatic and human evaluation, we show that specialized student models fine-tuned on our datasets outperform generalist teacher models on the explainable style transfer task in one-shot settings, and perform competitively compared to few-shot teacher models, highlighting the quality of the data and the role of expert feedback. In an extrinsic task of authorship attribution, we show that explanations generated by smaller models fine-tuned on e-GYAFC are more predictive of authorship than explanations generated by few-shot teacher models., Comment: ACL 2024 Main, Camera Ready

Visual metaphors are powerful rhetorical devices used to persuade or communicate creative ideas through images. Similar to linguistic metaphors, they convey meaning implicitly through symbolism and juxtaposition of the symbols. We propose a new task of generating visual metaphors from linguistic metaphors. This is a challenging task for diffusion-based text-to-image models, such as DALL$\cdot$E 2, since it requires the ability to model implicit meaning and compositionality. We propose to solve the task through the collaboration between Large Language Models (LLMs) and Diffusion Models: Instruct GPT-3 (davinci-002) with Chain-of-Thought prompting generates text that represents a visual elaboration of the linguistic metaphor containing the implicit meaning and relevant objects, which is then used as input to the diffusion-based text-to-image models.Using a human-AI collaboration framework, where humans interact both with the LLM and the top-performing diffusion model, we create a high-quality dataset containing 6,476 visual metaphors for 1,540 linguistic metaphors and their associated visual elaborations. Evaluation by professional illustrators shows the promise of LLM-Diffusion Model collaboration for this task . To evaluate the utility of our Human-AI collaboration framework and the quality of our dataset, we perform both an intrinsic human-based evaluation and an extrinsic evaluation using visual entailment as a downstream task., Comment: ACL 2023 (Findings)

The TOI-1130 is a known planetary system around a K-dwarf consisting of a gas giant planet, TOI-1130 c, on an 8.4-day orbit, accompanied by an inner Neptune-sized planet, TOI-1130 b, with an orbital period of 4.1 days. We collected precise radial velocity (RV) measurements of TOI-1130 with the HARPS and PFS spectrographs as part of our ongoing RV follow-up program. We perform a photodynamical modeling of the HARPS and PFS RVs, and transit photometry from the Transiting Exoplanet Survey Satellite (TESS) and the TESS Follow-up Observing Program. We determine the planet masses and radii of TOI-1130 b and TOI-1130 c to be Mb = 19.28 $\pm$ 0.97 M$_\oplus$ and Rb = 3.56 $\pm$ 0.13 R$_\oplus$, and Mc = 325.59 $\pm$ 5.59 M$_\oplus$ and Rc = 13.32+1.55-1.41 R$_\oplus$, respectively. We spectroscopically confirm TOI-1130 b that was previously only validated. We find that the two planets orbit with small eccentricities in a 2:1 resonant configuration. This is the first known system with a hot Jupiter and an inner lower mass planet locked in a mean-motion resonance. TOI-1130 belongs to the small yet increasing population of hot Jupiters with an inner low-mass planet that challenges the pathway for hot Jupiter formation. We also detect a linear RV trend possibly due to the presence of an outer massive companion., Comment: 19 pages, Accepted to A&A

Designing systems that can reason across cultures requires that they are grounded in the norms of the contexts in which they operate. However, current research on developing computational models of social norms has primarily focused on American society. Here, we propose a novel approach to discover and compare descriptive social norms across Chinese and American cultures. We demonstrate our approach by leveraging discussions on a Chinese Q&A platform (Zhihu) and the existing SocialChemistry dataset as proxies for contrasting cultural axes, align social situations cross-culturally, and extract social norms from texts using in-context learning. Embedding Chain-of-Thought prompting in a human-AI collaborative framework, we build a high-quality dataset of 3,069 social norms aligned with social situations across Chinese and American cultures alongside corresponding free-text explanations. To test the ability of models to reason about social norms across cultures, we introduce the task of explainable social norm entailment, showing that existing models under 3B parameters have significant room for improvement in both automatic and human evaluation. Further analysis of cross-cultural norm differences based on our dataset shows empirical alignment with the social orientations framework, revealing several situational and descriptive nuances in norms across these cultures., Comment: EMNLP 2023 Main Conference (Long Paper)

We explore how weak supervision on abundant unlabeled data can be leveraged to improve few-shot performance in aspect-based sentiment analysis (ABSA) tasks. We propose a pipeline approach to construct a noisy ABSA dataset, and we use it to adapt a pre-trained sequence-to-sequence model to the ABSA tasks. We test the resulting model on three widely used ABSA datasets, before and after fine-tuning. Our proposed method preserves the full fine-tuning performance while showing significant improvements (15.84% absolute F1) in the few-shot learning scenario for the harder tasks. In zero-shot (i.e., without fine-tuning), our method outperforms the previous state of the art on the aspect extraction sentiment classification (AESC) task and is, additionally, capable of performing the harder aspect sentiment triplet extraction (ASTE) task.

Fallacies are used as seemingly valid arguments to support a position and persuade the audience about its validity. Recognizing fallacies is an intrinsically difficult task both for humans and machines. Moreover, a big challenge for computational models lies in the fact that fallacies are formulated differently across the datasets with differences in the input format (e.g., question-answer pair, sentence with fallacy fragment), genre (e.g., social media, dialogue, news), as well as types and number of fallacies (from 5 to 18 types per dataset). To move towards solving the fallacy recognition task, we approach these differences across datasets as multiple tasks and show how instruction-based prompting in a multitask setup based on the T5 model improves the results against approaches built for a specific dataset such as T5, BERT or GPT-3. We show the ability of this multitask prompting approach to recognize 28 unique fallacies across domains and genres and study the effect of model size and prompt choice by analyzing the per-class (i.e., fallacy type) results. Finally, we analyze the effect of annotation quality on model performance, and the feasibility of complementing this approach with external knowledge., Comment: In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 8172 - 8187

We used TESS light curves and HARPS-N spectrograph radial velocity measurements to establish the physical properties of the transiting exoplanet candidate found around the star HD 20329 (TOI-4524). We performed a joint fit of the light curves and radial velocity time series to measure the mass, radius, and orbital parameters of the candidate. We confirm and characterize HD 20329b, an ultra-short-period (USP) planet transiting a solar-type star. The host star (HD 20329, $V = 8.74$ mag, $J = 7.5$ mag) is characterized by its G5 spectral type with $\mathrm{M}_\star= 0.90 \pm 0.05$ M$_\odot$, $\mathrm{R}_\star = 1.13 \pm 0.02$ R$_\odot$, and $\mathrm{T}_{\mathrm{eff}} = 5596 \pm 50$ K; it is located at a distance $d= 63.68 \pm 0.29$ pc. By jointly fitting the available TESS transit light curves and follow-up radial velocity measurements, we find an orbital period of $0.9261 \pm (0.5\times 10^{-4})$ days, a planetary radius of $1.72 \pm 0.07$ $\mathrm{R}_\oplus$, and a mass of $7.42 \pm 1.09$ $\mathrm{M}_\oplus$, implying a mean density of $\rho_\mathrm{p} = 8.06 \pm 1.53$ g cm$^{-3}$. HD 20329b joins the $\sim$30 currently known USP planets with radius and Doppler mass measurements., Comment: Accepted for publication in A&A, 26 pages

HD 191939 (TOI-1339) is a nearby (d=54pc), bright (V=9mag), and inactive Sun-like star (G9 V) known to host a multi-planet transiting system. Ground-based spectroscopic observations confirmed the planetary nature of the three transiting sub-Neptunes (HD 191939 b, c, and d) originally detected by TESS and were used to measure the masses for planets b and c with 3$\sigma$ precision. These previous observations also reported the discovery of an additional Saturn-mass planet (HD 191939 e) and evidence for a further, very long-period companion (HD 191939 f). Here, we report the discovery of a new non-transiting planet in the system and a refined mass determination of HD 191939 d. The new planet, HD 191939 g, has a minimum mass of 13.5$\pm$2.0 M$_\oplus$ and a period of about 280 d. This period places the planet within the conservative habitable zone of the host star, and near a 1:3 resonance with HD 191939 e. The compilation of 362 radial velocity measurements with a baseline of 677 days from four different high-resolution spectrographs also allowed us to refine the properties of the previously known planets, including a 4.6$\sigma$ mass determination for planet d, for which only a 2$\sigma$ upper limit had been set until now. We confirm the previously suspected low density of HD 191939 d, which makes it an attractive target for attempting atmospheric characterisation. Overall, the planetary system consists of three sub-Neptunes interior to a Saturn-mass and a Uranus-mass planet plus a high-mass long-period companion. This particular configuration has no counterpart in the literature and makes HD 191939 an exceptional multi-planet transiting system with an unusual planet demographic worthy of future observation., Comment: Accepted for publication in A&A. 20 pages, 8 figures

Recent work on question generation has largely focused on factoid questions such as who, what, where, when about basic facts. Generating open-ended why, how, what, etc. questions that require long-form answers have proven more difficult. To facilitate the generation of open-ended questions, we propose CONSISTENT, a new end-to-end system for generating open-ended questions that are answerable from and faithful to the input text. Using news articles as a trustworthy foundation for experimentation, we demonstrate our model's strength over several baselines using both automatic and human=based evaluations. We contribute an evaluation dataset of expert-generated open-ended questions.We discuss potential downstream applications for news media organizations., Comment: EMNLP 2022 Findings

The current architecture of a given multi-planetary system is a key fingerprint of its past formation and dynamical evolution history. Long-term follow-up observations are key to complete their picture. In this paper we focus on the confirmation and characterization of the components of the TOI-969 planetary system, where TESS detected a Neptune-size planet candidate in a very close-in orbit around a late K-dwarf star. We use a set of precise radial velocity observations from HARPS, PFS and CORALIE instruments covering more than two years in combination with the TESS photometric light curve and other ground-based follow-up observations to confirm and characterize the components of this planetary system. We find that TOI-969 b is a transiting close-in ($P_b\sim 1.82$ days) mini-Neptune planet ($m_b=9.1^{+1.1}_{-1.0}$ M$_{\oplus}$, $R_b=2.765^{+0.088}_{-0.097}$ R$_{\oplus}$), thus placing it on the {lower boundary} of the hot-Neptune desert ($T_{\rm eq,b}=941\pm31$ K). The analysis of its internal structure shows that TOI-969 b is a volatile-rich planet, suggesting it underwent an inward migration. The radial velocity model also favors the presence of a second massive body in the system, TOI-969 c, with a long period of $P_c=1700^{+290}_{-280}$ days and a minimum mass of $m_{c}\sin{i_c}=11.3^{+1.1}_{-0.9}$ M$_{\rm Jup}$, and with a highly-eccentric orbit of $e_c=0.628^{+0.043}_{-0.036}$. The TOI-969 planetary system is one of the few around K-dwarfs known to have this extended configuration going from a very close-in planet to a wide-separation gaseous giant. TOI-969 b has a transmission spectroscopy metric of 93, and it orbits a moderately bright ($G=11.3$ mag) star, thus becoming an excellent target for atmospheric studies. The architecture of this planetary system can also provide valuable information about migration and formation of planetary systems., Comment: Accepted for publication in A&A. 25 pages, 15 figures, 12 tables

Affective responses to music are highly personal. Despite consensus that idiosyncratic factors play a key role in regulating how listeners emotionally respond to music, precisely measuring the marginal effects of these variables has proved challenging. To address this gap, we develop computational methods to measure affective responses to music from over 403M listener comments on a Chinese social music platform. Building on studies from music psychology in systematic and quasi-causal analyses, we test for musical, lyrical, contextual, demographic, and mental health effects that drive listener affective responses. Finally, motivated by the social phenomenon known as w\v{a}ng-y\`i-y\'un, we identify influencing factors of platform user self-disclosures, the social support they receive, and notable differences in discloser user activity., Comment: EMNLP 2022 Main Conference; see Github https://github.com/skychwang/music-emotions

Norm discovery is important for understanding and reasoning about the acceptable behaviors and potential violations in human communication and interactions. We introduce NormSage, a framework for addressing the novel task of conversation-grounded multi-lingual, multi-cultural norm discovery, based on language model prompting and self-verification. NormSAGE leverages the expressiveness and implicit knowledge of the pretrained GPT-3 language model backbone, to elicit knowledge about norms through directed questions representing the norm discovery task and conversation context. It further addresses the risk of language model hallucination with a self-verification mechanism ensuring that the norms discovered are correct and are substantially grounded to their source conversations. Evaluation results show that our approach discovers significantly more relevant and insightful norms for conversations on-the-fly compared to baselines (>10+% in Likert scale rating). The norms discovered from Chinese conversation are also comparable to the norms discovered from English conversation in terms of insightfulness and correctness (<3% difference). In addition, the culture-specific norms are promising quality, allowing for 80% accuracy in culture pair human identification. Finally, our grounding process in norm discovery self-verification can be extended for instantiating the adherence and violation of any norm for a given conversation on-the-fly, with explainability and transparency. NormSAGE achieves an AUC of 95.4% in grounding, with natural language explanation matching human-written quality.

Aspect-based Sentiment Analysis (ABSA) is a fine-grained sentiment analysis task which involves four elements from user-generated texts: aspect term, aspect category, opinion term, and sentiment polarity. Most computational approaches focus on some of the ABSA sub-tasks such as tuple (aspect term, sentiment polarity) or triplet (aspect term, opinion term, sentiment polarity) extraction using either pipeline or joint modeling approaches. Recently, generative approaches have been proposed to extract all four elements as (one or more) quadruplets from text as a single task. In this work, we take a step further and propose a unified framework for solving ABSA, and the associated sub-tasks to improve the performance in few-shot scenarios. To this end, we fine-tune a T5 model with instructional prompts in a multi-task learning fashion covering all the sub-tasks, as well as the entire quadruple prediction task. In experiments with multiple benchmark datasets, we show that the proposed multi-task prompting approach brings performance boost (by absolute 8.29 F1) in the few-shot learning setting., Comment: Camera ready copy for WASSA at ACL 2023

Context. Despite being a prominent subset of the exoplanet population discovered in the past three decades, the nature and provenance of sub-Neptune-sized planets are still one of the open questions in exoplanet science. Aims. For planets orbiting bright stars, precisely measuring the orbital and planet parameters of the system is the best approach to distinguish between competing theories regarding their formation and evolution. Methods. We obtained 69 new radial velocity observations of the mid-M dwarf G 9-40 with the CARMENES instrument to measure for the first time the mass of its transiting sub-Neptune planet, G 9-40 b, discovered in data from the K2 mission. Results. Combined with new observations from the TESS mission during Sectors 44, 45, and 46, we are able to measure the radius of the planet to an uncertainty of 3.4% (Rb = 1.900 +- 0.065 Re) and determine its mass with a precision of 16% (Mb = 4.00 +- 0.63 Me). The resulting bulk density of the planet is inconsistent with a terrestrial composition and suggests the presence of either a water-rich core or a significant hydrogen-rich envelope. Conclusions. G 9-40 b is referred to as a keystone planet due to its location in period-radius space within the radius valley. Several theories offer explanations for the origin and properties of this population and this planet is a valuable target for testing the dependence of those models on stellar host mass. By virtue of its brightness and small size of the host, it joins L 98-59 d as one of the two best warm (Teq ~ 400 K) sub-Neptunes for atmospheric characterization with JWST, which will probe cloud formation in sub-Neptune-sized planets and break the degeneracies of internal composition models., Comment: Accepted for publication in A&A

Highly irradiated planets in the hot Neptune desert are usually either small (R < 2 Rearth) and rocky or they are gas giants with radii of >1 Rjup. Here, we report on the intermediate-sized planet TOI-2196 on a 1.2 day orbit around a G-type star discovered by TESS in sector 27. We collected 42 radial velocity measurements with the HARPS spectrograph to determine the mass. The radius of TOI-2196 b is 3.51 +/- 0.15 Rearth, which, combined with the mass of 26.0 +/- 1.3 Mearth, results in a bulk density of 3.31+0.51-0.43 g/cm3. Hence, the radius implies that this planet is a sub-Neptune, although the density is twice than that of Neptune. A significant trend in the HARPS radial velocities points to the presence of a distant companion with a lower limit on the period and mass of 220 days and 0.65 Mjup, respectively, assuming zero eccentricity. The short period of planet b implies a high equilibrium temperature of 1860 +/- 20 K, for zero albedo and isotropic emission. This places the planet in the hot Neptune desert, joining a group of very few planets in this parameter space discovered in recent years. These planets suggest that the hot Neptune desert may be divided in two parts for planets with equilibrium temperatures of > 1800 K: a hot sub-Neptune desert devoid of planets with radii of 1.8-3 Rearth and a sub-Jovian desert for radii of 5-12 Rearth. More planets in this parameter space are needed to further investigate this finding. Planetary interior structure models of TOI-2196 b are consistent with a H/He atmosphere mass fraction between 0.4 % and 3 %, with a mean value of 0.7 % on top of a rocky interior. We estimated the amount of mass this planet might have lost at a young age, and we find that while the mass loss could have been significant, the planet had not changed in terms of character: it was born as a small volatile-rich planet, and it remains one at present., Comment: 17 pages, 15 figures, 7 tables, accepted 11 July 2022 for publication in Astronomy & Astrophysics

Figurative language understanding has been recently framed as a recognizing textual entailment (RTE) task (a.k.a. natural language inference, or NLI). However, similar to classical RTE/NLI datasets, the current benchmarks suffer from spurious correlations and annotation artifacts. To tackle this problem, work on NLI has built explanation-based datasets such as e-SNLI, allowing us to probe whether language models are right for the right reasons.Yet no such data exists for figurative language, making it harder to assess genuine understanding of such expressions. To address this issue, we release FLUTE, a dataset of 9,000 figurative NLI instances with explanations, spanning four categories: Sarcasm, Simile, Metaphor, and Idioms. We collect the data through a model-in-the-loop framework based on GPT-3, crowd workers, and expert annotators. We show how utilizing GPT-3 in conjunction with human annotators (novices and experts) can aid in scaling up the creation of datasets even for such complex linguistic phenomena as figurative language. The baseline performance of the T5 model fine-tuned on FLUTE shows that our dataset can bring us a step closer to developing models that understand figurative language through textual explanations., Comment: EMNLP 2022 Main Conference (Long Paper)

Recent work on large language models relies on the intuition that most natural language processing tasks can be described via natural language instructions. Language models trained on these instructions show strong zero-shot performance on several standard datasets. However, these models even though impressive still perform poorly on a wide range of tasks outside of their respective training and evaluation sets. To address this limitation, we argue that a model should be able to keep extending its knowledge and abilities, without forgetting previous skills. In spite of the limited success of Continual Learning we show that Language Models can be continual learners. We empirically investigate the reason for this success and conclude that Continual Learning emerges from self-supervision pre-training. Our resulting model Continual-T0 (CT0) is able to learn diverse new tasks, while still maintaining good performance on previous tasks, spanning remarkably through 70 datasets in total. Finally, we show that CT0 is able to combine instructions in ways it was never trained for, demonstrating some compositionality.

We report the discovery of TOI-1268b, a transiting Saturn-mass planet from the TESS space mission. With an age of less than one Gyr, derived from various age indicators, TOI-1268b is the youngest Saturn-mass planet known to date and contributes to the small sample of well characterised young planets. It has an orbital period of $P\,=\,8.1577080\pm0.0000044$ days, and transits an early K dwarf star with a mass of $M_\star$ = $ 0.96 \pm 0.04$ $M_{\odot}$, a radius of $R_\star$ = $ 0.92 \pm 0.06$ $R_{\odot}$, an effective temperature of $T_\mathrm{eff}\,=\,5300\pm100$ K, and a metallicity of $0.36\pm0.06$ dex. By combining TESS photometry with high-resolution spectra acquired with the Tull spectrograph at McDonald observatory, and the high-resolution spectrographs at Tautenburg and Ondrejov observatories, we measured a planetary mass of $M_\mathrm{p}\,=\,96.4 \pm 8.3\,M_{\oplus}$ and a radius of $R_\mathrm{p}\,=\,9.1 \pm 0.6\,R_{\oplus}$. TOI-1268 is an ideal system to study the role of star-planet tidal interactions for non-inflated Saturn-mass planets. We used system parameters derived in this paper to constrain the planet tidal quality factor to the range of $10^{4.5-5.3}$. When compared with the sample of other non-inflated Saturn-mass planets, TOI-1268b is one of the best candidates for transmission spectroscopy studies., Comment: 21 pages, 17 figures, accepted for publication in Astronomy & Astrophysics; see independent work by Dong et al. for Rossiter-McLaughlin measurement of TOI-1268b

We present the discovery and characterisation of two transiting planets observed by \textit{TESS} in the light curves of the young and bright (V=9.67) star HD73583 (TOI-560). We perform an intensive spectroscopic and photometric space- and ground-based follow-up in order to confirm and characterise the system. We found that HD73583 is a young ($\sim 500$~Myr) active star with a rotational period of $12.08 \pm 0.11 $\,d, and a mass and radius of $ 0.73 \pm 0.02 M_\odot$ and $0.65 \pm 0.02 R_\odot$, respectively. HD73583 b ($P_b=6.3980420 _{ - 0.0000062 }^{+0.0000067}$ d) has a mass and radius of $10.2 _{-3.1}^{+3.4} M_\oplus$ and$2.79 \pm 0.10 R_\oplus$, respectively, that gives a density of $2.58 _{-0.81}^{ 0.95} {\rm g\,cm^{-3}}$. HD73583 c ($P_c= 18.87974 _{-0.00074 }^{+0.00086}$) has a mass and radius of $9.7_{-1.7} ^ {+1.8} M_\oplus$ and $2.39_{-0.09}^{+0.10} R_\oplus$, respectively, this translates to a density of $3.88 _{-0.80}^{+0.91} {\rm g\,cm^{-3}}$. Both planets are consistent with worlds made of a solid core surrounded by a volatile envelope. Because of their youth and host star brightness, they both are excellent candidates to perform transmission spectroscopy studies. We expect ongoing atmospheric mass-loss for both planets caused by stellar irradiation. We estimate that the detection of evaporating signatures on H and He would be challenging, but doable with present and future instruments., Comment: Accepted for publication in MNRAS

Enthymemes are defined as arguments where a premise or conclusion is left implicit. We tackle the task of generating the implicit premise in an enthymeme, which requires not only an understanding of the stated conclusion and premise but also additional inferences that could depend on commonsense knowledge. The largest available dataset for enthymemes (Habernal et al., 2018) consists of 1.7k samples, which is not large enough to train a neural text generation model. To address this issue, we take advantage of a similar task and dataset: Abductive reasoning in narrative text (Bhagavatula et al., 2020). However, we show that simply using a state-of-the-art seq2seq model fine-tuned on this data might not generate meaningful implicit premises associated with the given enthymemes. We demonstrate that encoding discourse-aware commonsense during fine-tuning improves the quality of the generated implicit premises and outperforms all other baselines both in automatic and human evaluations on three different datasets., Comment: EMNLP 2021 Camera ready

Despite constant improvements in machine translation quality, automatic poetry translation remains a challenging problem due to the lack of open-sourced parallel poetic corpora, and to the intrinsic complexities involved in preserving the semantics, style, and figurative nature of poetry. We present an empirical investigation for poetry translation along several dimensions: 1) size and style of training data (poetic vs. non-poetic), including a zero-shot setup; 2) bilingual vs. multilingual learning; and 3) language-family-specific models vs. mixed-multilingual models. To accomplish this, we contribute a parallel dataset of poetry translations for several language pairs. Our results show that multilingual fine-tuning on poetic text significantly outperforms multilingual fine-tuning on non-poetic text that is 35X larger in size, both in terms of automatic metrics (BLEU, BERTScore) and human evaluation metrics such as faithfulness (meaning and poetic style). Moreover, multilingual fine-tuning on poetic data outperforms \emph{bilingual} fine-tuning on poetic data., Comment: EMNLP 2021 Camera ready

We study the problem of deconvolution for light-sheet microscopy, where the data is corrupted by spatially varying blur and a combination of Poisson and Gaussian noise. The spatial variation of the point spread function (PSF) of a light-sheet microscope is determined by the interaction between the excitation sheet and the detection objective PSF. First, we introduce a model of the image formation process that incorporates this interaction, therefore capturing the main characteristics of this imaging modality. Then, we formulate a variational model that accounts for the combination of Poisson and Gaussian noise through a data fidelity term consisting of the infimal convolution of the single noise fidelities, first introduced in L. Calatroni et al. "Infimal convolution of data discrepancies for mixed noise removal", SIAM Journal on Imaging Sciences 10.3 (2017), 1196-1233. We establish convergence rates in a Bregman distance under a source condition for the infimal convolution fidelity and a discrepancy principle for choosing the value of the regularisation parameter. The inverse problem is solved by applying the primal-dual hybrid gradient (PDHG) algorithm in a novel way. Finally, numerical experiments performed on both simulated and real data show superior reconstruction results in comparison with other methods., Comment: 34 pages, 13 figures

Detecting what emotions are expressed in text is a well-studied problem in natural language processing. However, research on finer grained emotion analysis such as what causes an emotion is still in its infancy. We present solutions that tackle both emotion recognition and emotion cause detection in a joint fashion. Considering that common-sense knowledge plays an important role in understanding implicitly expressed emotions and the reasons for those emotions, we propose novel methods that combine common-sense knowledge via adapted knowledge models with multi-task learning to perform joint emotion classification and emotion cause tagging. We show performance improvement on both tasks when including common-sense reasoning and a multitask framework. We provide a thorough analysis to gain insights into model performance., Comment: 15 pages, 6 figures. Findings of ACL 2021

We introduce a FEVER-like dataset COVID-Fact of $4,086$ claims concerning the COVID-19 pandemic. The dataset contains claims, evidence for the claims, and contradictory claims refuted by the evidence. Unlike previous approaches, we automatically detect true claims and their source articles and then generate counter-claims using automatic methods rather than employing human annotators. Along with our constructed resource, we formally present the task of identifying relevant evidence for the claims and verifying whether the evidence refutes or supports a given claim. In addition to scientific claims, our data contains simplified general claims from media sources, making it better suited for detecting general misinformation regarding COVID-19. Our experiments indicate that COVID-Fact will provide a challenging testbed for the development of new systems and our approach will reduce the costs of building domain-specific datasets for detecting misinformation., Comment: ACL 2021 Camera Ready

Social media has become a valuable resource for the study of suicidal ideation and the assessment of suicide risk. Among social media platforms, Reddit has emerged as the most promising one due to its anonymity and its focus on topic-based communities (subreddits) that can be indicative of someone's state of mind or interest regarding mental health disorders such as r/SuicideWatch, r/Anxiety, r/depression. A challenge for previous work on suicide risk assessment has been the small amount of labeled data. We propose an empirical investigation into several classes of weakly-supervised approaches, and show that using pseudo-labeling based on related issues around mental health (e.g., anxiety, depression) helps improve model performance for suicide risk assessment., Comment: ACL 2021 short paper. Code is available at https://github.com/yangalan123/WM-SRA (under construction)

Generating metaphors is a difficult task as it requires understanding nuanced relationships between abstract concepts. In this paper, we aim to generate a metaphoric sentence given a literal expression by replacing relevant verbs. Guided by conceptual metaphor theory, we propose to control the generation process by encoding conceptual mappings between cognitive domains to generate meaningful metaphoric expressions. To achieve this, we develop two methods: 1) using FrameNet-based embeddings to learn mappings between domains and applying them at the lexical level (CM-Lex), and 2) deriving source/target pairs to train a controlled seq-to-seq generation model (CM-BART). We assess our methods through automatic and human evaluation for basic metaphoricity and conceptual metaphor presence. We show that the unsupervised CM-Lex model is competitive with recent deep learning metaphor generation systems, and CM-BART outperforms all other models both in automatic and human evaluations., Comment: 13 pages, 3 figures, to be published in the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)

We introduce a collection of recognizing textual entailment (RTE) datasets focused on figurative language. We leverage five existing datasets annotated for a variety of figurative language -- simile, metaphor, and irony -- and frame them into over 12,500 RTE examples.We evaluate how well state-of-the-art models trained on popular RTE datasets capture different aspects of figurative language. Our results and analyses indicate that these models might not sufficiently capture figurative language, struggling to perform pragmatic inference and reasoning about world knowledge. Ultimately, our datasets provide a challenging testbed for evaluating RTE models., Comment: ACL 2021 (Findings)

Generating metaphors is a challenging task as it requires a proper understanding of abstract concepts, making connections between unrelated concepts, and deviating from the literal meaning. In this paper, we aim to generate a metaphoric sentence given a literal expression by replacing relevant verbs. Based on a theoretically-grounded connection between metaphors and symbols, we propose a method to automatically construct a parallel corpus by transforming a large number of metaphorical sentences from the Gutenberg Poetry corpus (Jacobs, 2018) to their literal counterpart using recent advances in masked language modeling coupled with commonsense inference. For the generation task, we incorporate a metaphor discriminator to guide the decoding of a sequence to sequence model fine-tuned on our parallel data to generate high-quality metaphors. Human evaluation on an independent test set of literal statements shows that our best model generates metaphors better than three well-crafted baselines 66% of the time on average. A task-based evaluation shows that human-written poems enhanced with metaphors proposed by our model are preferred 68% of the time compared to poems without metaphors., Comment: NAACL 2021