Search Results for author: Eric Elmoznino

Found 5 papers, 1 papers with code

Amortizing intractable inference in large language models

1 code implementation6 Oct 2023 Edward J. Hu, Moksh Jain, Eric Elmoznino, Younesse Kaddar, Guillaume Lajoie, Yoshua Bengio, Nikolay Malkin

Autoregressive large language models (LLMs) compress knowledge from their training data through next-token conditional distributions.

Bayesian Inference

Discrete, compositional, and symbolic representations through attractor dynamics

no code implementations3 Oct 2023 Andrew Nam, Eric Elmoznino, Nikolay Malkin, Chen Sun, Yoshua Bengio, Guillaume Lajoie

Compositionality is an important feature of discrete symbolic systems, such as language and programs, as it enables them to have infinite capacity despite a finite symbol set.

Quantization

Sources of Richness and Ineffability for Phenomenally Conscious States

no code implementations13 Feb 2023 Xu Ji, Eric Elmoznino, George Deane, Axel Constant, Guillaume Dumas, Guillaume Lajoie, Jonathan Simon, Yoshua Bengio

Conscious states (states that there is something it is like to be in) seem both rich or full of detail, and ineffable or hard to fully describe or recall.

Philosophy

Visual representations derived from multiplicative interactions

no code implementations NeurIPS Workshop SVRHM 2020 Eric Elmoznino, Michael Bonner

Biological sensory systems appear to rely on canonical nonlinear computations that can be readily adapted to a broad range of representational objectives.

Cannot find the paper you are looking for? You can Submit a new open access paper.