Understanding the Role of Temperature in Diverse Question Generation by GPT-4

no code implementations • 14 Apr 2024 • Arav Agarwal, Karthik Mittal, Aidan Doyle, Pragnya Sridhar, Zipiao Wan, Jacob Arthur Doughty, Jaromir Savelka, Majd Sakr

We conduct a preliminary study of the effect of GPT's temperature parameter on the diversity of GPT4-generated questions.

Question Generation Question-Generation

A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education

no code implementations • 5 Dec 2023 • Jacob Doughty, Zipiao Wan, Anishka Bompelli, Jubahed Qayum, Taozhi Wang, Juran Zhang, Yujia Zheng, Aidan Doyle, Pragnya Sridhar, Arav Agarwal, Christopher Bogart, Eric Keylor, Can Kultur, Jaromir Savelka, Majd Sakr

While there is a growing body of research in computing education on utilizing large language models (LLMs) in generation and engagement with coding exercises, the use of LLMs for generating programming MCQs has not been extensively explored.

Multiple-choice

Harnessing LLMs in Curricular Design: Using GPT-4 to Support Authoring of Learning Objectives

no code implementations • 30 Jun 2023 • Pragnya Sridhar, Aidan Doyle, Arav Agarwal, Christopher Bogart, Jaromir Savelka, Majd Sakr

We evaluated 127 LOs that were automatically generated based on a carefully crafted prompt (detailed guidelines on high-quality LOs authoring) submitted to GPT-4 for conceptual modules and projects of an AI Practitioner course.