1. Stochastic Time-Series Analyses Highlight the Day-To-Day Dynamics of Lexical Frequencies.
- Author
-
Holdaway C and Piantadosi ST
- Subjects
- Humans, Bayes Theorem, Language, Communication, Models, Theoretical, Linguistics
- Abstract
Standard models in quantitative linguistics assume that word usage follows a fixed frequency distribution, often Zipf's law or a close relative. This view, however, does not capture the near daily variations in topics of conversation, nor the short-term dynamics of language change. In order to understand the dynamics of human language use, we present a corpus of daily word frequency variation scraped from online news sources every 20 min for more than 2 years. We construct a simple time-varying model with a latent state, which is observed via word frequency counts. We use Bayesian techniques to infer the parameters of this model for 20,000 words, allowing us to convert complex word-frequency trajectories into low-dimensional parameters in word usage. By analyzing the inferred parameters of this model, we quantify the relative mobility and drift of words on a day-to-day basis, while accounting for sampling error. We quantify this variation and show evidence against "rich-get-richer" models of word use, which have been previously hypothesized to explain statistical patterns in language., (© 2022 Cognitive Science Society LLC.)
- Published
- 2022
- Full Text
- View/download PDF