no code implementations • 16 Jan 2024 • Shangmin Guo, Yi Ren, Stefano V. Albrecht, Kenny Smith
Although much research has been done on proposing new models or loss functions to improve the generalisation of artificial neural networks (ANNs), less attention has been directed to the impact of the training data on generalisation.
no code implementations • 25 May 2023 • Juan Guerrero Montero, Andres Karjus, Kenny Smith, Richard A. Blythe
Language change is a cultural evolutionary process in which variants of linguistic variables change in frequency through processes analogous to mutation, selection and genetic drift.
no code implementations • ICLR 2022 • Shangmin Guo, Yi Ren, Kory Wallace Mathewson, Simon Kirby, Stefano V Albrecht, Kenny Smith
Researchers are using deep learning models to explore the emergence of language in various language games, where simulated agents interact and develop an emergent language to solve a task.
1 code implementation • ACL 2021 • Henry Conklin, Bailin Wang, Kenny Smith, Ivan Titov
Natural language is compositional; the meaning of a sentence is a function of the meaning of its parts.
1 code implementation • 7 Jun 2021 • Shangmin Guo, Yi Ren, Kory Mathewson, Simon Kirby, Stefano V. Albrecht, Kenny Smith
Researchers are using deep learning models to explore the emergence of language in various language games, where agents interact and develop an emergent language to solve tasks.
1 code implementation • 12 Apr 2021 • Robert D. Hawkins, Michael Franke, Michael C. Frank, Adele E. Goldberg, Kenny Smith, Thomas L. Griffiths, Noah D. Goodman
Languages are powerful solutions to coordination problems: they provide stable, shared expectations about how the words we say correspond to the beliefs and intentions in our heads.
1 code implementation • 19 Mar 2021 • Andres Karjus, Richard A. Blythe, Simon Kirby, Tianyu Wang, Kenny Smith
Colexification refers to the phenomenon of multiple meanings sharing one word in a language.
1 code implementation • 16 Jun 2020 • Andres Karjus, Richard A. Blythe, Simon Kirby, Kenny Smith
By contrast, in topics which are increasing in importance for language users, near-synonymous words tend not to compete directly and can coexist.
no code implementations • 11 Oct 2019 • Shangmin Guo, Yi Ren, Serhii Havrylov, Stella Frank, Ivan Titov, Kenny Smith
Since first introduced, computer simulation has been an increasingly important tool in evolutionary linguistics.
1 code implementation • 3 Nov 2018 • Andres Karjus, Richard A. Blythe, Simon Kirby, Kenny Smith
Newberry et al. (Detecting evolutionary forces in language change, Nature 551, 2017) tackle an important but difficult problem in linguistics, the testing of selective theories of language change against a null model of drift.
1 code implementation • 2 Jun 2018 • Andres Karjus, Richard A. Blythe, Simon Kirby, Kenny Smith
In this work, we introduce a simple model for controlling for topical fluctuations in corpora - the topical-cultural advection model - and demonstrate how it provides a robust baseline of variability in word frequency changes over time.
no code implementations • 9 Mar 2017 • Vanessa Ferdinand, Simon Kirby, Kenny Smith
Regularization occurs when the output a learner produces is less variable than the linguistic data they observed.
no code implementations • 8 Dec 2014 • Richard A. Blythe, Andrew D. M. Smith, Kenny Smith
Language learners must learn the meanings of many thousands of words, despite those words occurring in complex environments in which infinitely many meanings might be inferred by the learner as a word's true meaning.
no code implementations • 22 Feb 2013 • Rainer Reisenauer, Kenny Smith, Richard A. Blythe
We study the time taken by a language learner to correctly identify the meaning of all words in a lexicon under conditions where many plausible meanings can be inferred whenever a word is uttered.