Search Results for author: Noel Ngu

Found 2 papers, 2 papers with code

Diversity Measures: Domain-Independent Proxies for Failure in Language Model Queries

1 code implementation22 Aug 2023 Noel Ngu, Nathaniel Lee, Paulo Shakarian

In this paper, we present measures for quantification of error in the response of a large language model based on the diversity of responses to a given prompt - hence independent of the underlying application.

Language Modelling Large Language Model

An Independent Evaluation of ChatGPT on Mathematical Word Problems (MWP)

1 code implementation23 Feb 2023 Paulo Shakarian, Abhinav Koyyalamudi, Noel Ngu, Lakshmivihari Mareedu

We study the performance of a commercially available large language model (LLM) known as ChatGPT on math word problems (MWPs) from the dataset DRAW-1K.

Language Modelling Large Language Model +1

Cannot find the paper you are looking for? You can Submit a new open access paper.