Search Results for author: Mattia Opper

Found 3 papers, 0 papers with code

Self-StrAE at SemEval-2024 Task 1: Making Self-Structuring AutoEncoders Learn More With Less

no code implementations2 Apr 2024 Mattia Opper, N. Siddharth

This paper presents two simple improvements to the Self-Structuring AutoEncoder (Self-StrAE).

On the effect of curriculum learning with developmental data for grammar acquisition

no code implementations31 Oct 2023 Mattia Opper, J. Morrison, N. Siddharth

Using BabyBERTa as a probe, we find that grammar acquisition is largely driven by exposure to speech data, and in particular through exposure to two of the BabyLM training corpora: AO-Childes and Open Subtitles.

StrAE: Autoencoding for Pre-Trained Embeddings using Explicit Structure

no code implementations9 May 2023 Mattia Opper, Victor Prokhorov, N. Siddharth

This work presents StrAE: a Structured Autoencoder framework that through strict adherence to explicit structure, and use of a novel contrastive objective over tree-structured representations, enables effective learning of multi-level representations.

Inductive Bias Informativeness +1

Cannot find the paper you are looking for? You can Submit a new open access paper.