Search Results for author: Jonas F. Lotz

Found 3 papers, 2 papers with code

Text Rendering Strategies for Pixel Language Models

no code implementations1 Nov 2023 Jonas F. Lotz, Elizabeth Salesky, Phillip Rust, Desmond Elliott

Pixel-based language models process text rendered as images, which allows them to handle any script, making them a promising approach to open vocabulary language modelling.

Language Modelling Sentence

The Role of Data Curation in Image Captioning

1 code implementation5 May 2023 Wenyan Li, Jonas F. Lotz, Chen Qiu, Desmond Elliott

Image captioning models are typically trained by treating all samples equally, neglecting to account for mismatched or otherwise difficult data points.

Few-Shot Learning Image Captioning +2

Language Modelling with Pixels

1 code implementation14 Jul 2022 Phillip Rust, Jonas F. Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam de Lhoneux, Desmond Elliott

We pretrain the 86M parameter PIXEL model on the same English data as BERT and evaluate on syntactic and semantic tasks in typologically diverse languages, including various non-Latin scripts.

Language Modelling Named Entity Recognition (NER)

Cannot find the paper you are looking for? You can Submit a new open access paper.