Search Results for author: Oskar Holmström

Found 3 papers, 2 papers with code

Understanding the Effects of Noise in Text-to-SQL: An Examination of the BIRD-Bench Benchmark

1 code implementation19 Feb 2024 Niklas Wretblad, Fredrik Gordh Riseby, Rahul Biswas, Amin Ahmadi, Oskar Holmström

This study provides an in-depth analysis of the distribution and types of noise in the widely used BIRD-Bench benchmark and the impact of noise on models.

Text-To-SQL

How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs?

no code implementations16 Feb 2024 Ehsan Doostmohammadi, Oskar Holmström, Marco Kuhlmann

Work on instruction-tuned Large Language Models (LLMs) has used automatic methods based on text overlap and LLM judgments as cost-effective alternatives to human evaluation.

Cross-Lingual Transfer

The Impact of Language Adapters in Cross-Lingual Transfer for NLU

1 code implementation31 Jan 2024 Jenny Kunz, Oskar Holmström

Modular deep learning has been proposed for the efficient adaption of pre-trained models to new tasks, domains and languages.

Natural Language Understanding Zero-Shot Cross-Lingual Transfer

Cannot find the paper you are looking for? You can Submit a new open access paper.