no code implementations • 23 Mar 2024 • Feng Lin, Dong Jae Kim, Tse-Husn, Chen
Results indicate LCGScrum outperforms other models, achieving Pass@1 scores of 75. 2, 65. 5, 82. 5, and 56. 7 in HumanEval, HumanEval-ET, MBPP, and MBPP-ET, respectively - an average 15% improvement over GPT.
Ranked #6 on Code Generation on MBPP