Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for Code

1 code implementation • 22 Dec 2023 • Shahin Honarvar, Mark van der Wilk, Alastair Donaldson

Thus, from a single question template, it is possible to ask an LLM a $\textit{neighbourhood}$ of very similar programming questions, and assess the correctness of the result returned for each question.

Code Generation