Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language Understanding

1 code implementation • 23 Oct 2023 • Shuwen Deng, Paul Prasse, David R. Reich, Tobias Scheffer, Lena A. Jäger

We develop a model that integrates synthetic scanpath generation with a scanpath-augmented language model, eliminating the need for human gaze data.

Language Modelling Natural Language Understanding

Eyettention: An Attention-based Dual-Sequence Model for Predicting Human Scanpaths during Reading

1 code implementation • 21 Apr 2023 • Shuwen Deng, David R. Reich, Paul Prasse, Patrick Haller, Tobias Scheffer, Lena A. Jäger

In this paper, we develop Eyettention, the first dual-sequence model that simultaneously processes the sequence of words and the chronological sequence of fixations.

Detection of ADHD based on Eye Movements during Natural Viewing

1 code implementation • 4 Jul 2022 • Shuwen Deng, Paul Prasse, David R. Reich, Sabine Dziemian, Maja Stegenwallner-Schütz, Daniel Krakowczyk, Silvia Makowski, Nicolas Langer, Tobias Scheffer, Lena A. Jäger

Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder that is highly prevalent and requires clinical specialists to diagnose.