Search Results for author: Wyatt Lake

Found 1 papers, 0 papers with code

KNIFE: Distilling Reasoning Knowledge From Free-Text Rationales

no code implementations19 Dec 2022 Aaron Chan, Zhiyuan Zeng, Wyatt Lake, Brihi Joshi, Hanjie Chen, Xiang Ren

First, KNIFE finetunes a teacher LM (given task input and FTR) to predict the task output, transferring reasoning knowledge from the FTRs to the teacher's hidden states.

Knowledge Distillation Language Modelling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.