no code implementations • SemEval (NAACL) 2022 • Fadi Hassan, Wondimagegnhue Tufa, Guillem Collell, Piek Vossen, Lisa Beinborn, Adrian Flanagan, Kuan Eeik Tan
This paper presents our system used to participate in task 11 (MultiCONER) of the SemEval 2022 competition.
no code implementations • 2 Apr 2024 • Alberto Blanco-Justicia, Najeeb Jebreel, Benet Manzanares, David Sánchez, Josep Domingo-Ferrer, Guillem Collell, Kuan Eeik Tan
The objective of digital forgetting is, given a model with undesirable knowledge or behavior, obtain a new model where the detected issues are no longer present.
1 code implementation • Findings of the Association for Computational Linguistics 2020 • Gorjan Radevski, Guillem Collell, Marie-Francine Moens, Tinne Tuytelaars
We address the problem of multimodal spatial understanding by decoding a set of language-expressed spatial relations to a set of 2D spatial arrangements in a multi-object and multi-relationship setting.
no code implementations • 19 Mar 2020 • Thierry Deruyttere, Guillem Collell, Marie-Francine Moens
We propose a new spatial memory module and a spatial reasoner for the Visual Grounding (VG) task.
Ranked #10 on Referring Expression Comprehension on Talk2Car
no code implementations • ACL 2018 • Guillem Collell, Marie-Francine Moens
Feed-forward networks are widely used in cross-modal applications to bridge modalities by mapping distributed vectors of one modality to the other, or to a shared space.
1 code implementation • TACL 2018 • Guillem Collell, Marie-Francine Moens
Here, we move one step forward in this direction and learn such representations by leveraging a task consisting in predicting continuous 2D spatial arrangements of objects given object-relationship-object instances (e. g., {``}cat under chair{''}) and a simple neural network model that learns the task from annotated images.
1 code implementation • 18 Nov 2017 • Guillem Collell, Luc van Gool, Marie-Francine Moens
In contrast with prior work that restricts spatial templates to explicit spatial prepositions (e. g., "glass on table"), here we extend this concept to implicit spatial language, i. e., those relationships (generally actions) for which the spatial arrangement of the objects is only implicitly implied (e. g., "man riding horse").
no code implementations • 25 Mar 2017 • Guillem Collell, Teddy Zhang, Marie-Francine Moens
Integrating visual and linguistic information into a single multimodal representation is an unsolved problem with wide-reaching applications to both natural language processing and computer vision.
no code implementations • COLING 2016 • Guillem Collell, Marie-Francine Moens
Human concept representations are often grounded with visual information, yet some aspects of meaning cannot be visually represented or are better described with language.
no code implementations • 28 Jun 2016 • Guillem Collell, Drazen Prelec, Kaustubh Patil
An alternative is to use a so-called threshold-moving method that a posteriori changes the decision threshold of a model to counteract the imbalance, thus has a potential to adapt to the performance measure of interest.