Search Results for author: Danielle R. Thomas

Found 5 papers, 0 papers with code

How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

no code implementations2 May 2024 Jionghao Lin, Zifei Han, Danielle R. Thomas, Ashish Gurung, Shivang Gupta, Vincent Aleven, Kenneth R. Koedinger

Our findings indicate that: 1) using a few-shot approach, the GPT-4 model effectively identifies correct/incorrect trainees' responses from three training lessons with an average F1 score of 0. 84 and an AUC score of 0. 85; and 2) using the few-shot approach, the GPT-4 model adeptly rephrases incorrect trainees' responses into desired responses, achieving performance comparable to that of human experts.

How Can I Improve? Using GPT to Highlight the Desired and Undesired Parts of Open-ended Responses

no code implementations1 May 2024 Jionghao Lin, Eason Chen, Zeifei Han, Ashish Gurung, Danielle R. Thomas, Wei Tan, Ngoc Dang Nguyen, Kenneth R. Koedinger

To quantify the quality of highlighted praise components identified by GPT models, we introduced a Modified Intersection over Union (M-IoU) score.

Improving Assessment of Tutoring Practices using Retrieval-Augmented Generation

no code implementations4 Feb 2024 Zifei, Han, Jionghao Lin, Ashish Gurung, Danielle R. Thomas, Eason Chen, Conrad Borchers, Shivang Gupta, Kenneth R. Koedinger

The results indicate that the RAG prompt demonstrated more accurate performance (assessed by the level of hallucination and correctness in the generated assessment texts) and lower financial costs than the other strategies evaluated.

Hallucination Math +1

Using Large Language Models to Provide Explanatory Feedback to Human Tutors

no code implementations27 Jun 2023 Jionghao Lin, Danielle R. Thomas, Feifei Han, Shivang Gupta, Wei Tan, Ngoc Dang Nguyen, Kenneth R. Koedinger

Research demonstrates learners engaging in the process of producing explanations to support their reasoning, can have a positive impact on learning.

Binary Classification Data Augmentation +4

Cannot find the paper you are looking for? You can Submit a new open access paper.