Search

Logical reasoning is central to complex human activities, such as thinking, debating, and planning; it is also a central component of many AI systems as well. In this paper, we investigate the extent to which encoder-only transformer language models (LMs) can reason according to logical rules. We ask whether those LMs can deduce theorems in propositional calculus and first-order logic; if their relative success in these problems reflects general logical capabilities; and which layers contribute the most to the task. First, we show for several encoder-only LMs that they can be trained, to a reasonable degree, to determine logical validity on various datasets. Next, by cross-probing fine-tuned models on these datasets, we show that LMs have difficulty in transferring their putative logical reasoning ability, which suggests that they may have learned dataset-specific features, instead of a general capability. Finally, we conduct a layerwise probing experiment, which shows that the hypothesis classification task is mostly solved through higher layers.

Melkersson-Rosenthal syndrome is an uncommon disorder of uncertain aetiology characterized by orofacial oedema, facial nerve palsy and lingua plicata. The triad is seldom seen in its complete form, and oligo-symptomatic or mono-symptomatic forms are more common. An unusual case of Melkersson-Rosenthal syndrome involving the left upper eyelid is presented. The pathology, clinical features and management of this disorder are discussed.