Search Results for author: Javier Conde

Found 5 papers, 2 papers with code

Concurrent Linguistic Error Detection (CLED) for Large Language Models

no code implementations25 Mar 2024 Jinhua Zhu, Javier Conde, Zhen Gao, Pedro Reviriego, Shanshan Liu, Fabrizio Lombardi

Since the proposed error detection mechanism only relies on the outputs of the model, then it can be used on LLMs in which there is no access to the internal nodes.

News Summarization valid

Open Source Conversational LLMs do not know most Spanish words

no code implementations21 Mar 2024 Javier Conde, Miguel González, Nina Melero, Raquel Ferrando, Gonzalo Martínez, Elena Merino-Gómez, José Alberto Hernández, Pedro Reviriego

The growing interest in Large Language Models (LLMs) and in particular in conversational models with which users can interact has led to the development of a large number of open-source chat LLMs.

Fairness

Establishing Vocabulary Tests as a Benchmark for Evaluating Large Language Models

1 code implementation23 Oct 2023 Gonzalo Martínez, Javier Conde, Elena Merino-Gómez, Beatriz Bermúdez-Margaretto, José Alberto Hernández, Pedro Reviriego, Marc Brysbaert

Vocabulary tests, once a cornerstone of language modeling evaluation, have been largely overlooked in the current landscape of Large Language Models (LLMs) like Llama, Mistral, and GPT.

Language Modelling Llama

How many words does ChatGPT know? The answer is ChatWords

1 code implementation28 Sep 2023 Gonzalo Martínez, Javier Conde, Pedro Reviriego, Elena Merino-Gómez, José Alberto Hernández, Fabrizio Lombardi

The benefits of ChatWords are illustrated with two case studies: evaluating the knowledge that ChatGPT has of the Spanish lexicon (taken from the official dictionary of the "Real Academia Espa\~nola") and of the words that appear in the Quixote, the well-known novel written by Miguel de Cervantes.

Playing with Words: Comparing the Vocabulary and Lexical Richness of ChatGPT and Humans

no code implementations14 Aug 2023 Pedro Reviriego, Javier Conde, Elena Merino-Gómez, Gonzalo Martínez, José Alberto Hernández

Therefore, further research is needed to understand how the use of ChatGPT and more broadly generative AI tools will affect the vocabulary and lexical richness in different types of text and languages.

Cannot find the paper you are looking for? You can Submit a new open access paper.