Is This Just Fantasy? Language Model Representations Reflect Human Judgments of Event Plausibility

arXiv:2507.12553v3 Announce Type: replace-cross Abstract: Language models (LMs) are used for a diverse range of tasks, from question answering to writing fantastical stories. In order to reliably accomplish these tasks, LMs must be able to discern the modal category of a sentence (i.e., whether it describes something that is possible, impossible, completely nonsensical, etc.). However, recent studies have called into question the ability of LMs to categorize sentences according to modality (Mich