Search Results for author: Xiaoming Zhai

Found 18 papers, 2 papers with code

Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era

1 code implementation13 Mar 2024 Xuansheng Wu, Haiyan Zhao, Yaochen Zhu, Yucheng Shi, Fan Yang, Tianming Liu, Xiaoming Zhai, Wenlin Yao, Jundong Li, Mengnan Du, Ninghao Liu

Therefore, in this paper, we introduce Usable XAI in the context of LLMs by analyzing (1) how XAI can benefit LLMs and AI systems, and (2) how LLMs can contribute to the advancement of XAI.

G-SciEdBERT: A Contextualized LLM for Science Assessment Tasks in German

no code implementations9 Feb 2024 Ehsan Latif, Gyeong-Geon Lee, Knut Neuman, Tamara Kastorff, Xiaoming Zhai

The advancement of natural language processing has paved the way for automated scoring systems in various languages, such as German (e. g., German BERT [G-BERT]).

Language Modelling Large Language Model

Can generative AI and ChatGPT outperform humans on cognitive-demanding problem-solving tasks in science?

no code implementations7 Jan 2024 Xiaoming Zhai, Matthew Nyaaba, Wenchao Ma

We compared the performance of ChatGPT and GPT-4 on 2019 NAEP science assessments with students by cognitive demands of the items.

Gemini Pro Defeated by GPT-4V: Evidence from Education

no code implementations27 Dec 2023 Gyeong-Geon Lee, Ehsan Latif, Lehong Shi, Xiaoming Zhai

This study compared the classification performance of Gemini Pro and GPT-4V in educational settings.

Image Classification Question Answering +1

Knowledge Distillation of LLM for Automatic Scoring of Science Education Assessments

no code implementations26 Dec 2023 Ehsan Latif, Luyang Fang, Ping Ma, Xiaoming Zhai

We compared accuracy with state-of-the-art (SOTA) distilled models, TinyBERT, and artificial neural network (ANN) models.

Knowledge Distillation Mathematical Reasoning

Collaborative Learning with Artificial Intelligence Speakers (CLAIS): Pre-Service Elementary Science Teachers' Responses to the Prototype

no code implementations20 Dec 2023 Gyeong-Geon Lee, Seonyeong Mun, Myeong-Kyeong Shin, Xiaoming Zhai

This research aims to demonstrate that AI can function not only as a tool for learning, but also as an intelligent agent with which humans can engage in collaborative learning (CL) to change epistemic practices in science classrooms.

speech-recognition Speech Recognition

Multimodality of AI for Education: Towards Artificial General Intelligence

no code implementations10 Dec 2023 Gyeong-Geon Lee, Lehong Shi, Ehsan Latif, Yizhu Gao, Arne Bewersdorff, Matthew Nyaaba, Shuchen Guo, Zihao Wu, Zhengliang Liu, Hui Wang, Gengchen Mai, Tiaming Liu, Xiaoming Zhai

This paper presents a comprehensive examination of how multimodal artificial intelligence (AI) approaches are paving the way towards the realization of Artificial General Intelligence (AGI) in educational contexts.

Automatic Scoring of Students' Science Writing Using Hybrid Neural Network

no code implementations2 Dec 2023 Ehsan Latif, Xiaoming Zhai

We also have observed that HNN is x2 more efficient in training and inferencing than BERT and has comparable efficiency to the lightweight but less accurate Naive Bayes model.

regression

Applying Large Language Models and Chain-of-Thought for Automatic Scoring

no code implementations30 Nov 2023 Gyeong-Geon Lee, Ehsan Latif, Xuansheng Wu, Ninghao Liu, Xiaoming Zhai

We found a more balanced accuracy across different proficiency categories when CoT was used with a scoring rubric, highlighting the importance of domain-specific reasoning in enhancing the effectiveness of LLMs in scoring tasks.

Few-Shot Learning Prompt Engineering +1

NERIF: GPT-4V for Automatic Scoring of Drawn Models

no code implementations21 Nov 2023 Gyeong-Geon Lee, Xiaoming Zhai

The results of this study show that utilizing GPT-4V for automatic scoring of student-drawn models is promising.

Few-Shot Learning

Using GPT-4 to Augment Unbalanced Data for Automatic Scoring

no code implementations25 Oct 2023 Luyang Fang, Gyeong-Geon Lee, Xiaoming Zhai

The average maximum increase observed across two items is: 3. 5% for accuracy, 30. 6% for precision, 21. 1% for recall, and 24. 2% for F1 score.

Data Augmentation Language Modelling +1

Fine-tuning ChatGPT for Automatic Scoring

no code implementations16 Oct 2023 Ehsan Latif, Xiaoming Zhai

In this study, we fine-tuned GPT-3. 5 on six assessment tasks with a diverse dataset of middle-school and high-school student responses and expert scoring.

Language Modelling

Elucidating STEM Concepts through Generative AI: A Multi-modal Exploration of Analogical Reasoning

no code implementations21 Aug 2023 Chen Cao, Zijian Ding, Gyeong-Geon Lee, Jiajun Jiao, Jionghao Lin, Xiaoming Zhai

Our study demonstrates the potential of applying large language models to educational practice on STEM subjects.

AGI: Artificial General Intelligence for Education

no code implementations24 Apr 2023 Ehsan Latif, Gengchen Mai, Matthew Nyaaba, Xuansheng Wu, Ninghao Liu, Guoyu Lu, Sheng Li, Tianming Liu, Xiaoming Zhai

AGI, driven by the recent large pre-trained models, represents a significant leap in the capability of machines to perform tasks that require human-level intelligence, such as reasoning, problem-solving, decision-making, and even understanding human emotions and social interactions.

Decision Making Fairness

Context Matters: A Strategy to Pre-train Language Model for Science Education

no code implementations27 Jan 2023 Zhengliang Liu, Xinyu He, Lei Liu, Tianming Liu, Xiaoming Zhai

However, the ideal type of data to contextualize pre-trained language model and improve the performance in automatically scoring student written responses remains unclear.

Language Modelling

Matching Exemplar as Next Sentence Prediction (MeNSP): Zero-shot Prompt Learning for Automatic Scoring in Science Education

1 code implementation20 Jan 2023 Xuansheng Wu, Xinyu He, Tianming Liu, Ninghao Liu, Xiaoming Zhai

Developing models to automatically score students' written responses to science problems is critical for science education.

Sentence

Pseudo AI Bias

no code implementations14 Oct 2022 Xiaoming Zhai, Joseph Krajcik

Pseudo Artificial Intelligence bias (PAIB) is broadly disseminated in the literature, which can result in unnecessary AI fear in society, exacerbate the enduring inequities and disparities in access to and sharing the benefits of AI applications, and waste social capital invested in AI research.

Cannot find the paper you are looking for? You can Submit a new open access paper.