Search Results for author: Giovanni Puccetti

Found 5 papers, 1 papers with code

The Invalsi Benchmark: measuring Language Models Mathematical and Language understanding in Italian

no code implementations27 Mar 2024 Andrea Esuli, Giovanni Puccetti

This results in a lower number of available benchmarks to evaluate the performance of language models in Italian.

Language Modelling

Outliers Dimensions that Disrupt Transformers Are Driven by Frequency

1 code implementation23 May 2022 Giovanni Puccetti, Anna Rogers, Aleksandr Drozd, Felice Dell'Orletta

While Transformer-based language models are generally very robust to pruning, there is the recently discovered outlier phenomenon: disabling only 48 out of 110M parameters in BERT-base drops its performance by nearly 30% on MNLI.

Cannot find the paper you are looking for? You can Submit a new open access paper.