no code implementations • MTSummit 2021 • Fabrizio Nunnari, Judith Bauerdiek, Lucas Bernhard, Cristina España-Bonet, Corinna Jäger, Amelie Unger, Kristoffer Waldow, Sonja Wecker, Elisabeth André, Stephan Busemann, Christian Dold, Arnulph Fuhrmann, Patrick Gebhard, Yasser Hamidullah, Marcel Hauck, Yvonne Kossel, Martin Misiak, Dieter Wallach, Alexander Stricker
This paper presents an overview of AVASAG; an ongoing applied-research project developing a text-to-sign-language translation system for public services.
no code implementations • CoNLL (EMNLP) 2021 • Katharina Weitz, Lindsey Vanderlyn, Ngoc Thang Vu, Elisabeth André
We conclude that creating shared mental models between users and AI systems is important to achieving successful dialogs.
no code implementations • 8 May 2024 • Silvan Mertes, Tobias Huber, Christina Karle, Katharina Weitz, Ruben Schlagowski, Cristina Conati, Elisabeth André
To this end, we present a GAN-based approach to generate these alterfactual explanations for binary image classifiers.
no code implementations • 6 May 2024 • Pooja Prajod, Bhargavi Mahesh, Elisabeth André
Our findings reveal a crucial factor affecting model generalizability: stressor type.
no code implementations • 18 Mar 2024 • Tobias Hallmen, Fabian Deuser, Norbert Oswald, Elisabeth André
In this study, we propose a methodology for the Emotional Mimicry Intensity (EMI) Estimation task within the context of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild.
no code implementations • 23 Feb 2024 • Silvan Mertes, Dominik Schiller, Michael Dietz, Elisabeth André, Florian Lingenfelser
In the field of affective computing, where research continually advances at a rapid pace, the demand for user-friendly tools has become increasingly apparent.
no code implementations • 1 Feb 2024 • Marta Mondellini, Matteo Lavit Nicora, Pooja Prajod, Elisabeth André, Rocco Vertechy, Alessandro Antonietti, Matteo Malosio
In industrial scenarios, there is widespread use of collaborative robots (cobots), and growing interest is directed at evaluating and measuring the impact of some characteristics of the cobot on the human factor.
no code implementations • 11 Dec 2023 • Pooja Prajod, Matteo Lavit Nicora, Marta Mondellini, Giovanni Tauro, Rocco Vertechy, Matteo Malosio, Elisabeth André
To the best of our knowledge, this is the first study to analyze the natural gaze behavior of participants working on a joint activity with a robot during a collaborative assembly task.
no code implementations • 17 Aug 2023 • Klaus Weber, Annalena Aicher, Wolfang Minker, Stefan Ultes, Elisabeth André
To support a fair and unbiased opinion-building process, we propose a chatbot system that engages in a deliberative dialogue with a human.
no code implementations • 16 Aug 2023 • Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, Dominik Schiller, Mohammed Guermal, Dominike Thomas, François Brémond, Jan Alexandersson, Elisabeth André, Andreas Bulling
This paper describes the MultiMediate'23 challenge and presents novel sets of annotations for both tasks.
no code implementations • 15 May 2023 • Dominik Müller, Niklas Schröter, Silvan Mertes, Fabio Hellmann, Miriam Elia, Wolfgang Reif, Bernhard Bauer, Elisabeth André, Frank Kramer
COVID-19 presence classification and severity prediction via (3D) thorax computed tomography scans have become important tasks in recent times.
1 code implementation • 3 May 2023 • Fabio Hellmann, Silvan Mertes, Mohamed Benouis, Alexander Hustinx, Tzung-Chien Hsieh, Cristina Conati, Peter Krawitz, Elisabeth André
The effectiveness of the approach was assessed by evaluating its performance in removing identifiable facial attributes to increase the anonymity of the given individual face.
no code implementations • 30 Mar 2023 • Pooja Prajod, Matteo Lavit Nicora, Matteo Malosio, Elisabeth André
We performed an additional validation of our models using the video snippets collected from participants working as an operator in the presented assembly scenario.
no code implementations • 14 Mar 2023 • Alexander Heimerl, Pooja Prajod, Silvan Mertes, Tobias Baur, Matthias Kraus, Ailin Liu, Helen Risack, Nicolas Rohleder, Elisabeth André, Linda Becker
We present a multi-modal stress dataset that uses digital job interviews to induce stress.
2 code implementations • 24 Feb 2023 • Tobias Huber, Maximilian Demmler, Silvan Mertes, Matthew L. Olson, Elisabeth André
However, research focusing on counterfactual explanations, specifically for RL agents with visual input, is scarce and does not go beyond identifying defective agents.
no code implementations • 3 Feb 2023 • Pol van Rijn, Yue Sun, Harin Lee, Raja Marjieh, Ilia Sucholutsky, Francesca Lanzarini, Elisabeth André, Nori Jacoby
Six behavioral experiments (N=236) in six countries and eight languages show that (a) our test can distinguish between native speakers of closely related languages, (b) the test is reliable ($r=0. 82$), and (c) performance strongly correlates with existing tests (LexTale) and self-reports.
1 code implementation • 12 Nov 2022 • Alexander Hustinx, Fabio Hellmann, Ömer Sümer, Behnam Javanmardi, Elisabeth André, Peter Krawitz, Tzung-Chien Hsieh
Because of the overall scarcity of patients with ultra-rare disorders, it is infeasible to directly train a model on them.
no code implementations • 23 Oct 2022 • Ömer Sümer, Fabio Hellmann, Alexander Hustinx, Tzung-Chien Hsieh, Elisabeth André, Peter Krawitz
Furthermore, we created simple baselines of few-shot meta-learning methods to improve our base feature descriptor.
no code implementations • 21 Oct 2022 • Yael Septon, Tobias Huber, Elisabeth André, Ofra Amir
Methods that help users understand the behavior of such agents can roughly be divided into local explanations that analyze specific decisions of the agents and global explanations that convey the general strategy of the agents.
no code implementations • 12 Oct 2022 • Pooja Prajod, Elisabeth André
To the best of our knowledge, this is the first work to compare the cross-dataset generalizability between ECG-based deep learning models and HRV models.
no code implementations • 7 Oct 2022 • Katharina Weitz, Chi Tai Dang, Elisabeth André
By providing insights into employees' needs and attitudes towards (X)AI, our project report contributes to the development of XAI solutions that meet the requirements of companies and their employees, ultimately driving the successful adoption of AI technologies in the business context.
no code implementations • 7 Oct 2022 • Katharina Weitz, Alexander Zellner, Elisabeth André
In healthcare, AI systems support clinicians and patients in diagnosis, treatment, and monitoring, but many systems' poor explainability remains challenging for practical application.
no code implementations • 6 Oct 2022 • Andreas Triantafyllopoulos, Björn W. Schuller, Gökçe İymen, Metin Sezgin, Xiangheng He, Zijiang Yang, Panagiotis Tzirakis, Shuo Liu, Silvan Mertes, Elisabeth André, Ruibo Fu, JianHua Tao
Speech is the fundamental mode of human communication, and its synthesis has long been a core priority in human-computer interaction research.
1 code implementation • 28 Sep 2022 • Tobias Hallmen, Silvan Mertes, Dominik Schiller, Elisabeth André
Affective speech analysis is an ongoing topic of research.
no code implementations • 19 Jul 2022 • Silvan Mertes, Christina Karle, Tobias Huber, Katharina Weitz, Ruben Schlagowski, Elisabeth André
We evaluate our approach in an extensive user study, revealing that it is able to significantly contribute to the participants' understanding of an AI.
no code implementations • 3 Jul 2022 • Mani Kumar Tellamekala, Ömer Sümer, Björn W. Schuller, Elisabeth André, Timo Giesbrecht, Michel Valstar
We also study how 3D face shapes performed on AU intensity estimation on BP4D and DISFA datasets, and report that 3D face features were on par with 2D appearance features in AUs 4, 6, 10, 12, and 25, but not the entire set of AUs.
no code implementations • 12 Jun 2022 • Mani Kumar Tellamekala, Shahin Amiriparian, Björn W. Schuller, Elisabeth André, Timo Giesbrecht, Michel Valstar
In particular, we impose Calibration and Ordinal Ranking constraints on the variance vectors of audiovisual latent distributions.
no code implementations • 8 Jun 2022 • Alexander Heimerl, Silvan Mertes, Tanja Schneeberger, Tobias Baur, Ailin Liu, Linda Becker, Nicolas Rohleder, Patrick Gebhard, Elisabeth André
This feedback can be helpful concerning the improvement of behavioral skills needed for job interviews.
no code implementations • 3 Jun 2022 • Rhythm Arora, Matteo Lavit Nicora, Pooja Prajod, Daniele Panzeri, Elisabeth André, Patrick Gebhard, Matteo Malosio
In today's world, many patients with cognitive impairments and motor dysfunction seek the attention of experts to perform specific conventional therapies to improve their situation.
no code implementations • 9 May 2022 • Silvan Mertes, Andreas Margraf, Steffen Geinitz, Elisabeth André
However, a precise examination of the resulting images indicate that WGAN and image-to-image translation achieve good segmentation results and only deviate to a small degree from traditional data augmentation.
no code implementations • 26 Apr 2022 • Silvan Mertes, Dominik Schiller, Florian Lingenfelser, Thomas Kiderle, Valentin Kroner, Lama Diab, Elisabeth André
This is especially a problem if not only random new images are to be generated, but specific (continuous) features are to be co-modeled.
no code implementations • 19 Aug 2021 • Tobias Huber, Silvan Mertes, Stanislava Rangelova, Simon Flutura, Elisabeth André
As a proof-of-concept, we implement an initial prototype in which the player must traverse a maze that includes several exercise rooms, whereby the generation of the maze is realized by a neural network.
no code implementations • 5 May 2021 • Pol van Rijn, Silvan Mertes, Dominik Schiller, Peter M. C. Harrison, Pauline Larrouy-Maestri, Elisabeth André, Nori Jacoby
Recent TTS systems are able to generate prosodically varied and realistic speech.
no code implementations • 15 Apr 2021 • Pooja Prajod, Dominik Schiller, Tobias Huber, Elisabeth André
We then fine-tune successively larger parts of this network to learn suitable representations for the task of automatic pain recognition.
1 code implementation • 18 Jan 2021 • Tobias Huber, Benedikt Limmer, Elisabeth André
One of the most prominent methods for explaining the behavior of Deep Reinforcement Learning (DRL) agents is the generation of saliency maps that show how much each pixel attributed to the agents' decision.
1 code implementation • 22 Dec 2020 • Silvan Mertes, Tobias Huber, Katharina Weitz, Alexander Heimerl, Elisabeth André
By doing so, the users of counterfactual explanation systems are equipped with a completely different kind of explanatory information.
no code implementations • 15 Dec 2020 • Patrick Gebhard, Tanja Schneeberger, Michael Dietz, Elisabeth André, Nida ul Habib Bajwa
Using Social Agents as health-care assistants or trainers is one focus area of IVA research.
no code implementations • 30 Sep 2020 • Dominik Schiller, Silvan Mertes, Elisabeth André
Traditional approaches to automatic emotion recognition are relying on the application of handcrafted features.
1 code implementation • 18 May 2020 • Tobias Huber, Katharina Weitz, Elisabeth André, Ofra Amir
Specifically, we augment strategy summaries that extract important trajectories of states from simulations of the agent with saliency maps which show what information the agent attends to.
1 code implementation • 7 Feb 2018 • Johannes Wagner, Tobias Baur, Yue Zhang, Michel F. Valstar, Björn Schuller, Elisabeth André
Scientific disciplines, such as Behavioural Psychology, Anthropology and recently Social Signal Processing are concerned with the systematic exploration of human behaviour.
no code implementations • 20 Feb 2014 • Hazael Jones, Nicolas Sabouret, Ionut Damian, Tobias Baur, Elisabeth André, Kaśka Porayska-Pomsta, Paola Rizzo
In this paper we describe a mechanism of generating credible affective reactions in a virtual recruiter during an interaction with a user.