StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code

no code implementations • 7 Jun 2023 • Hannah McLean Babe, Sydney Nguyen, Yangtian Zi, Arjun Guha, Molly Q Feldman, Carolyn Jane Anderson

We use StudentEval to evaluate 5 Code LLMs and find that StudentEval is a better discriminator of model performance than existing benchmarks.

Code Generation