no code implementations • 9 Feb 2023 • Uri Berger, Lea Frermann, Gabriel Stanovsky, Omri Abend
We study the relation between visual input and linguistic choices by training classifiers to predict the probability of expressing a property from raw images, and find evidence supporting the claim that linguistic properties are constrained by visual context across languages.
1 code implementation • NAACL 2022 • Uri Berger, Gabriel Stanovsky, Omri Abend, Lea Frermann
Recent advances in self-supervised modeling of text and images open new opportunities for computational models of child language acquisition, which is believed to rely heavily on cross-modal signals.