Podcast Metadata and Content: Episode Relevance andAttractiveness in Ad Hoc Search

no code implementations • 25 Aug 2021 • Ben Carterette, Rosie Jones, Gareth F. Jones, Maria Eskevich, Sravana Reddy, Ann Clifton, Yongze Yu, Jussi Karlgren, Ian Soboroff

We describe a set of diverse podcast information needs and different approaches to assessing retrieved content for relevance.

TREC 2020 Podcasts Track Overview

no code implementations • 29 Mar 2021 • Rosie Jones, Ben Carterette, Ann Clifton, Maria Eskevich, Gareth J. F. Jones, Jussi Karlgren, Aasish Pappu, Sravana Reddy, Yongze Yu

The Podcast Track is new at the Text Retrieval Conference (TREC) in 2020.

Information Retrieval Retrieval +1

100,000 Podcasts: A Spoken English Document Corpus

no code implementations • COLING 2020 • Ann Clifton, Sravana Reddy, Yongze Yu, Aasish Pappu, Rezvaneh Rezapour, Hamed Bonab, Maria Eskevich, Gareth Jones, Jussi Karlgren, Ben Carterette, Rosie Jones

Paired with the audio files, they are also a resource for speech processing and the study of paralinguistic, sociolinguistic, and acoustic aspects of the domain.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Assessing Human-Parity in Machine Translation on the Segment Level

no code implementations • Findings of the Association for Computational Linguistics 2020 • Yvette Graham, Christian Federmann, Maria Eskevich, Barry Haddow

Recent machine translation shared tasks have shown top-performing systems to tie or in some cases even outperform human translation.

Machine Translation Translation

CLARIN: Distributed Language Resources and Technology in a European Infrastructure

no code implementations • LREC 2020 • Maria Eskevich, Franciska de Jong, Alex K{\"o}nig, er, Darja Fi{\v{s}}er, Dieter van Uytvanck, Tero Aalto, Lars Borin, Olga Gerassimenko, Jan Hajic, Henk van den Heuvel, Neeme Kahusk, Krista Liin, Martin Matthiesen, Stelios Piperidis, Kadri Vider

CLARIN is a European Research Infrastructure providing access to digital language resources and tools from across Europe and beyond to researchers in the humanities and social sciences.

LR4SSHOC: The Future of Language Resources in the Context of the Social Sciences and Humanities Open Cloud

no code implementations • LREC 2020 • Daan Broeder, Maria Eskevich, Monica Monachini

This paper outlines the future of language resources and identifies their potential contribution for creating and sustaining the social sciences and humanities (SSH) component of the European Open Science Cloud (EOSC).

Social Sciences and Humanities Pathway Towards the European Open Science Cloud

no code implementations • LREC 2020 • Francesca Di Donato, Monica Monachini, Maria Eskevich, Stefanie Pohle, Yoann Moranville, Suzanne Dumouchel

The paper presents a journey, which starts from various social sciences and humanities (SSH) Research Infrastructures in Europe and arrives at the comprehensive {``}ecosystem of infrastructures{''}, namely the European Open Science Cloud (EOSC).

Is all that Glitters in Machine Translation Quality Estimation really Gold?

no code implementations • COLING 2016 • Yvette Graham, Timothy Baldwin, Meghan Dowling, Maria Eskevich, Teresa Lynn, Lamia Tounsi

Human-targeted metrics provide a compromise between human evaluation of machine translation, where high inter-annotator agreement is difficult to achieve, and fully automatic metrics, such as BLEU or TER, that lack the validity of human assessment.

Machine Translation Translation

Creating a Data Collection for Evaluating Rich Speech Retrieval

no code implementations • LREC 2012 • Maria Eskevich, Gareth J. F. Jones, Martha Larson, Roel Ordelman,

We describe the development of a test collection for the investigation of speech retrieval beyond identification of relevant content.

Benchmarking Retrieval