Search Results for author: Andreas S. Tolias

Found 20 papers, 10 papers with code

Generalization properties of contrastive world models

no code implementations29 Dec 2023 Kandan Ramakrishnan, R. James Cotton, Xaq Pitkow, Andreas S. Tolias

We systematically test the model under a number of different OOD generalization scenarios such as extrapolation to new object attributes, introducing new conjunctions or new attributes.

Object

The Dynamic Sensorium competition for predicting large-scale mouse visual cortex activity from videos

1 code implementation31 May 2023 Polina Turishcheva, Paul G. Fahey, Laura Hansel, Rachel Froebe, Kayla Ponder, Michaela Vystrčilová, Konstantin F. Willeke, Mohammad Bashiri, Eric Wang, Zhiwei Ding, Andreas S. Tolias, Fabian H. Sinz, Alexander S. Ecker

We hope this competition will continue to strengthen the accompanying Sensorium benchmarks collection as a standard tool to measure progress in large-scale neural system identification models of the entire mouse visual hierarchy and beyond.

Understanding robustness and generalization of artificial neural networks through Fourier masks

1 code implementation16 Mar 2022 Nikos Karantzas, Emma Besier, Josue Ortega Caro, Xaq Pitkow, Andreas S. Tolias, Ankit B. Patel, Fabio Anselmi

Our results also indicate that the essential frequencies in question are effectively the ones used to achieve generalization in the first place.

Data Augmentation

Learning Dynamics and Structure of Complex Systems Using Graph Neural Networks

no code implementations22 Feb 2022 Zhe Li, Andreas S. Tolias, Xaq Pitkow

In this work we trained graph neural networks to fit time series from an example nonlinear dynamical system, the belief propagation algorithm.

Inductive Bias Time Series +1

Class-Incremental Learning with Generative Classifiers

1 code implementation20 Apr 2021 Gido M. van de Ven, Zhe Li, Andreas S. Tolias

As a proof-of-principle, here we implement this strategy by training a variational autoencoder for each class to be learned and by using importance sampling to estimate the likelihoods p(x|y).

Class Incremental Learning Incremental Learning

Generalization in data-driven models of primary visual cortex

no code implementations ICLR 2021 Konstantin-Klemens Lurz, Mohammad Bashiri, Konstantin Willeke, Akshay Jagadish, Eric Wang, Edgar Y. Walker, Santiago A Cadena, Taliah Muhammad, Erick Cobos, Andreas S. Tolias, Alexander S Ecker, Fabian H. Sinz

With this new readout we train our network on neural responses from mouse primary visual cortex (V1) and obtain a gain in performance of 7% compared to the previous state-of-the-art network.

Transfer Learning

Exploring representation learning for flexible few-shot tasks

no code implementations1 Jan 2021 Mengye Ren, Eleni Triantafillou, Kuan-Chieh Wang, James Lucas, Jake Snell, Xaq Pitkow, Andreas S. Tolias, Richard Zemel

In this work, we consider a realistic setting where the relationship between examples can change from episode to episode depending on the task context, which is not given to the learner.

Few-Shot Learning Representation Learning

Probing Few-Shot Generalization with Attributes

no code implementations10 Dec 2020 Mengye Ren, Eleni Triantafillou, Kuan-Chieh Wang, James Lucas, Jake Snell, Xaq Pitkow, Andreas S. Tolias, Richard Zemel

Despite impressive progress in deep learning, generalizing far beyond the training distribution is an important open challenge.

Attribute Few-Shot Learning +1

Factorized Neural Processes for Neural Processes: $K$-Shot Prediction of Neural Responses

1 code implementation22 Oct 2020 R. James Cotton, Fabian H. Sinz, Andreas S. Tolias

We overcome this limitation by formulating the problem as $K$-shot prediction to directly infer a neuron's tuning function from a small set of stimulus-response pairs using a Neural Process.

Rotation-invariant clustering of neuronal responses in primary visual cortex

no code implementations ICLR 2020 Ivan Ustyuzhaninov, Santiago A. Cadena, Emmanouil Froudarakis, Paul G. Fahey, Edgar Y. Walker, Erick Cobos, Jacob Reimer, Fabian H. Sinz, Andreas S. Tolias, Matthias Bethge, Alexander S. Ecker

Similar to a convolutional neural network (CNN), the mammalian retina encodes visual information into several dozen nonlinear feature maps, each formed by one ganglion cell type that tiles the visual space in an approximately shift-equivariant manner.

Clustering Open-Ended Question Answering

Three scenarios for continual learning

8 code implementations15 Apr 2019 Gido M. van de Ven, Andreas S. Tolias

Standard artificial neural networks suffer from the well-known issue of catastrophic forgetting, making continual or lifelong learning difficult for machine learning.

Class Incremental Learning Incremental Learning +1

Generative replay with feedback connections as a general strategy for continual learning

5 code implementations27 Sep 2018 Gido M. van de Ven, Andreas S. Tolias

A major obstacle to developing artificial intelligence applications capable of true lifelong learning is that artificial neural networks quickly or catastrophically forget previously learned tasks when trained on a new one.

Continual Learning Permuted-MNIST

Three continual learning scenarios and a case for generative replay

no code implementations27 Sep 2018 Gido M. van de Ven, Andreas S. Tolias

To enable more meaningful comparisons, we identified three distinct continual learning scenarios based on whether task identity is known and, if it is not, whether it needs to be inferred.

Continual Learning Permuted-MNIST

A rotation-equivariant convolutional neural network model of primary visual cortex

1 code implementation ICLR 2019 Alexander S. Ecker, Fabian H. Sinz, Emmanouil Froudarakis, Paul G. Fahey, Santiago A. Cadena, Edgar Y. Walker, Erick Cobos, Jacob Reimer, Andreas S. Tolias, Matthias Bethge

We present a framework to identify common features independent of individual neurons' orientation selectivity by using a rotation-equivariant convolutional neural network, which automatically extracts every feature at multiple different orientations.

Cannot find the paper you are looking for? You can Submit a new open access paper.