Search Results for author: Ulme Wennberg

Found 4 papers, 2 papers with code

Exploring Internal Numeracy in Language Models: A Case Study on ALBERT

no code implementations25 Apr 2024 Ulme Wennberg, Gustav Eje Henter

It has been found that Transformer-based language models have the ability to perform basic quantitative reasoning.

The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models

1 code implementation ACL 2021 Ulme Wennberg, Gustav Eje Henter

In this paper, we analyze the position embeddings of existing language models, finding strong evidence of translation invariance, both for the embeddings themselves and for their effect on self-attention.

Position Translation

Entity, Relation, and Event Extraction with Contextualized Span Representations

3 code implementations IJCNLP 2019 David Wadden, Ulme Wennberg, Yi Luan, Hannaneh Hajishirzi

We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction.

Event Extraction Joint Entity and Relation Extraction +5

Cannot find the paper you are looking for? You can Submit a new open access paper.