Search Results for author: Zach Furman

Found 2 papers, 1 papers with code

Estimating the Local Learning Coefficient at Scale

no code implementations6 Feb 2024 Zach Furman, Edmund Lau

The \textit{local learning coefficient} (LLC) is a principled way of quantifying model complexity, originally derived in the context of Bayesian statistics using singular learning theory (SLT).

Learning Theory

Eliciting Latent Predictions from Transformers with the Tuned Lens

2 code implementations14 Mar 2023 Nora Belrose, Zach Furman, Logan Smith, Danny Halawi, Igor Ostrovsky, Lev McKinney, Stella Biderman, Jacob Steinhardt

We analyze transformers from the perspective of iterative inference, seeking to understand how model predictions are refined layer by layer.

Language Modelling

Cannot find the paper you are looking for? You can Submit a new open access paper.