Walking a Tightrope -- Evaluating Large Language Models in High-Risk Domains

no code implementations • 25 Nov 2023 • Chia-Chien Hung, Wiem Ben Rim, Lindsay Frost, Lars Bruckner, Carolin Lawrence

High-risk domains pose unique challenges that require language models to provide accurate and safe responses.

Question Answering

KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models

no code implementations • 23 Aug 2022 • Haris Widjaja, Kiril Gashteovski, Wiem Ben Rim, PengFei Liu, Christopher Malon, Daniel Ruffinelli, Carolin Lawrence, Graham Neubig

Knowledge Graphs (KGs) store information in the form of (head, predicate, tail)-triples.

Link Prediction

A Human-Centric Assessment Framework for AI

no code implementations • 25 May 2022 • Sascha Saralajew, Ammar Shaker, Zhao Xu, Kiril Gashteovski, Bhushan Kotnis, Wiem Ben Rim, Jürgen Quittek, Carolin Lawrence

Inspired by the Turing test, we introduce a human-centric assessment framework where a leading domain expert accepts or rejects the solutions of an AI system and another domain expert.

Behavioral Testing of Knowledge Graph Embedding Models for Link Prediction

no code implementations • AKBC 2021 • Wiem Ben Rim, Carolin Lawrence, Kiril Gashteovski, Mathias Niepert, Naoaki Okazaki

With an extensive set of experiments, we perform and analyze these tests for several KGE models.

Knowledge Graph Embedding Knowledge Graphs +1

SWAGex at SemEval-2020 Task 4: Commonsense Explanation as Next Event Prediction

no code implementations • SEMEVAL 2020 • Wiem Ben Rim, Naoaki Okazaki

We describe the system submitted by the SWAGex team to the SemEval-2020 Commonsense Validation and Explanation Task.

Language Modelling