Search Results for author:
Found 2 papers, 1 papers with code
Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models
In this work, we highlight the following pitfall of prefilling: for batches containing high-varying prompt lengths, significant computation is wasted by the standard practice of padding sequences to the maximum length.
Group Preference Optimization: Few-Shot Alignment of Large Language Models
We introduce Group Preference Optimization (GPO), an alignment framework that steers language models to preferences of individual groups in a few-shot manner.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
