Search Results for author: Fady Rezk

Found 2 papers, 0 papers with code

On Training Implicit Meta-Learning With Applications to Inductive Weighing in Consistency Regularization

no code implementations28 Oct 2023 Fady Rezk

In this study, we start by conducting a systematic comparative analysis of the various approximation methods and their effect when incorporated into IML training routines.

Meta-Learning

Is Scaling Learned Optimizers Worth It? Evaluating The Value of VeLO's 4000 TPU Months

no code implementations27 Oct 2023 Fady Rezk, Antreas Antoniou, Henry Gouk, Timothy Hospedales

We analyze VeLO (versatile learned optimizer), the largest scale attempt to train a general purpose "foundational" optimizer to date.

Cannot find the paper you are looking for? You can Submit a new open access paper.