Search Results for author: Paul Lukowicz

Found 46 papers, 7 papers with code

BeSound: Bluetooth-Based Position Estimation Enhancing with Cross-Modality Distillation

no code implementations24 Apr 2024 Hymalai Bello, Sungho Suh, Bo Zhou, Paul Lukowicz

Once the student model is trained, the model only takes as inputs the BLE-RSSI data for inference, retaining the advantages of ubiquity and low cost of BLE RSSI.

Knowledge Distillation Position

Text me the data: Generating Ground Pressure Sequence from Textual Descriptions for HAR

no code implementations22 Feb 2024 Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh, Lars Krupp, Vitor Fortes Rey, Paul Lukowicz

We show that the combination of vector quantization of sensor data along with simple text conditioned auto regressive strategy allows us to obtain high-quality generated pressure sequences from textual descriptions with the help of discrete latent correlation between text and pressure maps.

Human Activity Recognition Quantization

iMove: Exploring Bio-impedance Sensing for Fitness Activity Recognition

no code implementations31 Jan 2024 Mengxi Liu, Vitor Fortes Rey, Yu Zhang, Lala Shakti Swarup Ray, Bo Zhou, Paul Lukowicz

While IMUs are currently the prominent fitness tracking modality, through iMove, we show bio-impedence can help improve IMU-based fitness tracking through sensor fusion and contrastive learning. To evaluate our methods, we conducted an experiment including six upper body fitness activities performed by ten subjects over five days to collect synchronized data from bio-impedance across two wrists and IMU on the left wrist. The contrastive learning framework uses the two modalities to train a better IMU-only classification model, where bio-impedance is only required at the training phase, by which the average Macro F1 score with the input of a single IMU was improved by 3. 22 \% reaching 84. 71 \% compared to the 81. 49 \% of the IMU baseline model.

Contrastive Learning Human Activity Recognition +1

Body-Area Capacitive or Electric Field Sensing for Human Activity Recognition and Human-Computer Interaction: A Comprehensive Survey

no code implementations11 Jan 2024 Sizhen Bian, Mengxi Liu, Bo Zhou, Paul Lukowicz, Michele Magno

To this end, we first sorted the explorations into three domains according to the involved body forms: body-part electric field, whole-body electric field, and body-to-body electric field, and enumerated the state-of-art works in the domains with a detailed survey of the backed sensing tricks and targeted applications.

Human Activity Recognition

CoSS: Co-optimizing Sensor and Sampling Rate for Data-Efficient AI in Human Activity Recognition

no code implementations3 Jan 2024 Mengxi Liu, Zimin Zhao, Daniel Geißler, Bo Zhou, Sungho Suh, Paul Lukowicz

Recent advancements in Artificial Neural Networks have significantly improved human activity recognition using multiple time-series sensors.

Human Activity Recognition Time Series

The Power of Training: How Different Neural Network Setups Influence the Energy Demand

no code implementations3 Jan 2024 Daniel Geißler, Bo Zhou, Mengxi Liu, Sungho Suh, Paul Lukowicz

This work offers a heuristic evaluation of the effects of variations in machine learning training regimes and learning paradigms on the energy consumption of computing, especially HPC hardware with a life-cycle aware perspective.

Transfer Learning

Remaining Useful Life Prediction of Lithium-ion Batteries using Spatio-temporal Multimodal Attention Networks

no code implementations29 Oct 2023 Sungho Suh, Dhruv Aditya Mittal, Hymalai Bello, Bo Zhou, Mayank Shekhar Jha, Paul Lukowicz

The proposed ST-MAN is to capture the complex spatio-temporal dependencies in the battery data, including the features that are often neglected in existing works.

Unreflected Acceptance -- Investigating the Negative Consequences of ChatGPT-Assisted Problem Solving in Physics Education

no code implementations21 Aug 2023 Lars Krupp, Steffen Steinert, Maximilian Kiefer-Emmanouilidis, Karina E. Avila, Paul Lukowicz, Jochen Kuhn, Stefan Küchemann, Jakob Karolus

In a study, students with a background in physics were assigned to solve physics exercises, with one group having access to an internet search engine (N=12) and the other group being allowed to use ChatGPT (N=27).

Worker Activity Recognition in Manufacturing Line Using Near-body Electric Field

no code implementations7 Aug 2023 Sungho Suh, Vitor Fortes Rey, Sizhen Bian, Yu-Chi Huang, Jože M. Rožanec, Hooman Tavakoli Ghinani, Bo Zhou, Paul Lukowicz

This paper presents a novel wearable sensing prototype that combines IMU and body capacitance sensing modules to recognize worker activities in the manufacturing line.

Activity Recognition Time Series

Two-stage Early Prediction Framework of Remaining Useful Life for Lithium-ion Batteries

no code implementations7 Aug 2023 Dhruv Mittal, Hymalai Bello, Bo Zhou, Mayank Shekhar Jha, Sungho Suh, Paul Lukowicz

Early prediction of remaining useful life (RUL) is crucial for effective battery management across various industries, ranging from household appliances to large-scale applications.

Management

Selecting the motion ground truth for loose-fitting wearables: benchmarking optical MoCap methods

1 code implementation21 Jul 2023 Lala Shakti Swarup Ray, Bo Zhou, Sungho Suh, Paul Lukowicz

To help smart wearable researchers choose the optimal ground truth methods for motion capturing (MoCap) for all types of loose garments, we present a benchmark, DrapeMoCapBench (DMCB), specifically designed to evaluate the performance of optical marker-based and marker-less MoCap.

Benchmarking

Origami Single-end Capacitive Sensing for Continuous Shape Estimation of Morphing Structures

no code implementations3 Jul 2023 Lala Shakti Swarup Ray, Daniel Geißler, Bo Zhou, Paul Lukowicz, Berit Greinke

It was observed through embedding areas of origami structures with conductive materials as single-end capacitive sensing patches, that the sensor signals change coherently with the motion of the structure.

Don't freeze: Finetune encoders for better Self-Supervised HAR

no code implementations3 Jul 2023 Vitor Fortes Rey, Dominique Nshimyimana, Paul Lukowicz

Recently self-supervised learning has been proposed in the field of human activity recognition as a solution to the labelled data availability problem.

Human Activity Recognition Self-Supervised Learning

ClothFit: Cloth-Human-Attribute Guided Virtual Try-On Network Using 3D Simulated Dataset

no code implementations24 Jun 2023 Yunmin Cho, Lala Shakti Swarup Ray, Kundan Sai Prabhu Thota, Sungho Suh, Paul Lukowicz

The proposed method utilizes a U-Net-based network architecture that incorporates cloth and human attributes to guide the realistic virtual try-on synthesis.

Attribute Virtual Try-on

Social AI and the Challenges of the Human-AI Ecosystem

no code implementations23 Jun 2023 Dino Pedreschi, Luca Pappalardo, Ricardo Baeza-Yates, Albert-Laszlo Barabasi, Frank Dignum, Virginia Dignum, Tina Eliassi-Rad, Fosca Giannotti, Janos Kertesz, Alistair Knott, Yannis Ioannidis, Paul Lukowicz, Andrea Passarella, Alex Sandy Pentland, John Shawe-Taylor, Alessandro Vespignani

In order to understand the impact of AI on socio-technical systems and design next-generation AIs that team with humans to help overcome societal problems rather than exacerbate them, we propose to build the foundations of Social AI at the intersection of Complex Systems, Network Science and AI.

MeciFace: Mechanomyography and Inertial Fusion-based Glasses for Edge Real-Time Recognition of Facial and Eating Activities

no code implementations19 Jun 2023 Hymalai Bello, Sungho Suh, Bo Zhou, Paul Lukowicz

The increasing prevalence of stress-related eating behaviors and their impact on overall health highlights the importance of effective and ubiquitous monitoring systems.

Facial Expression Recognition Management +1

CaptAinGlove: Capacitive and Inertial Fusion-Based Glove for Real-Time on Edge Hand Gesture Recognition for Drone Control

no code implementations7 Jun 2023 Hymalai Bello, Sungho Suh, Daniel Geißler, Lala Ray, Bo Zhou, Paul Lukowicz

We present CaptAinGlove, a textile-based, low-power (1. 15Watts), privacy-conscious, real-time on-the-edge (RTE) glove-based solution with a tiny memory footprint (2MB), designed to recognize hand gestures used for drone control.

Hand Gesture Recognition Hand-Gesture Recognition +1

Unsupervised Statistical Feature-Guided Diffusion Model for Sensor-based Human Activity Recognition

no code implementations30 May 2023 Si Zuo, Vitor Fortes Rey, Sungho Suh, Stephan Sigg, Paul Lukowicz

The proposed method aims to generate synthetic time-series sensor data without relying on labeled data, addressing the scarcity and annotation difficulties associated with real-world sensor data.

Generative Adversarial Network Human Activity Recognition +1

FieldHAR: A Fully Integrated End-to-end RTL Framework for Human Activity Recognition with Neural Networks from Heterogeneous Sensors

no code implementations22 May 2023 Mengxi Liu, Bo Zhou, Zimin Zhao, Hyeonseok Hong, Hyun Kim, Sungho Suh, Vitor Fortes Rey, Paul Lukowicz

In this work, we propose an open-source scalable end-to-end RTL framework FieldHAR, for complex human activity recognition (HAR) from heterogeneous sensors using artificial neural networks (ANN) optimized for FPGA or ASIC integration.

Human Activity Recognition

A Knowledge Distillation framework for Multi-Organ Segmentation of Medaka Fish in Tomographic Image

no code implementations24 Feb 2023 Jwalin Bhatt, Yaroslav Zharov, Sungho Suh, Tilo Baumbach, Vincent Heuveline, Paul Lukowicz

Morphological atlases are an important tool in organismal studies, and modern high-throughput Computed Tomography (CT) facilities can produce hundreds of full-body high-resolution volumetric images of organisms.

Computed Tomography (CT) Image Segmentation +4

Non-contact, real-time eye blink detection with capacitive sensing

no code implementations10 Nov 2022 Mengxi Liu, Sizhen Bian, Paul Lukowicz

This work described a novel non-contact, wearable, real-time eye blink detection solution based on capacitive sensing technology.

The Contribution of Human Body Capacitance/Body-Area Electric Field To Individual and Collaborative Activity Recognition

1 code implementation26 Oct 2022 Sizhen Bian, Vitor Fortes Rey, Siyu Yuan, Paul Lukowicz

In the second case, we tried to recognize actions related to manipulating objects and physical collaboration between users by using a wrist-worn HBC sensing unit.

Activity Recognition

Smart Cup: An impedance sensing based fluid intake monitoring system for beverages classification and freshness detection

no code implementations8 Oct 2022 Mengxi Liu, Sizhen Bian, Bo Zhou, Agnes Grünerbl, Paul Lukowicz

We studied the frequency sensitivity of the electrochemical impedance spectrum regarding distinct beverages and the importance of features like amplitude, phase, and real and imaginary components for beverage classification.

Learning from the Best: Contrastive Representations Learning Across Sensor Locations for Wearable Activity Recognition

no code implementations4 Oct 2022 Vitor Fortes Rey, Sungho Suh, Paul Lukowicz

To mitigate this problem we propose a method that facilitates the use of information from sensors that are only present during the training process and are unavailable during the later use of the system.

Activity Recognition Wearable Activity Recognition

TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillation

no code implementations14 Sep 2022 Sungho Suh, Vitor Fortes Rey, Paul Lukowicz

In this work, we propose a novel Transformer-based Adversarial learning framework for human activity recognition using wearable sensors via Self-KnowledgE Distillation (TASKED), that accounts for individual sensor orientations and spatial and temporal features.

Human Activity Recognition Self-Knowledge Distillation

Magnetic Field Based Hand Tracking

no code implementations18 Jul 2022 Sizhen Bian, Kexuan Guo, Mengxi Liu, Bo Zhou, Paul Lukowicz

In more detail, the transmitters generate the oscillating magnetic fields with a registered sequence, the receiver senses the strength of the induced magnetic field by a customized three axes coil, which is configured as the LC oscillator with the same oscillating frequency so that an induced current shows up when the receiver is located in the field of the generated magnetic field.

Estimation of 3D Body Shape and Clothing Measurements from Frontal- and Side-view Images

no code implementations28 May 2022 Kundan Sai Prabhu Thota, Sungho Suh, Bo Zhou, Paul Lukowicz

The estimation of 3D human body shape and clothing measurements is crucial for virtual try-on and size recommendation problems in the fashion industry but has always been a challenging problem due to several conditions, such as lack of publicly available realistic datasets, ambiguity in multiple camera resolutions, and the undefinable human shape space.

Virtual Try-on

Adversarial Deep Feature Extraction Network for User Independent Human Activity Recognition

no code implementations23 Oct 2021 Sungho Suh, Vitor Fortes Rey, Paul Lukowicz

The proposed network is based on the adversarial encoder-decoder structure with the MMD realign the data distribution over multiple subjects.

Human Activity Recognition

Generalized multiscale feature extraction for remaining useful life prediction of bearings with generative adversarial networks

1 code implementation26 Sep 2021 Sungho Suh, Paul Lukowicz, Yong Oh Lee

The experimental results show that the proposed feature extraction method can effectively predict the RUL and outperforms the conventional RUL prediction approaches based on deep neural networks.

Detecting Video Game Player Burnout with the Use of Sensor Data and Machine Learning

1 code implementation29 Nov 2020 Anton Smerdov, Andrey Somov, Evgeny Burnaev, Bo Zhou, Paul Lukowicz

In this article, we propose the methods based on the sensor data analysis for predicting whether a player will win the future encounter.

BIG-bench Machine Learning Interpretable Machine Learning +8

Yet it moves: Learning from Generic Motions to Generate IMU data from YouTube videos

no code implementations23 Nov 2020 Vitor Fortes Rey, Kamalveer Kaur Garewal, Paul Lukowicz

Furthermore we show that by either including a small amount of real sensor data for model calibration or simply leveraging the fact that (in general) we can easily generate much more simulated data from video than we can collect in terms of real sensor data the advantage of real sensor data can be eventually equalized.

Human Activity Recognition regression

Discriminative feature generation for classification of imbalanced data

1 code implementation24 Oct 2020 Sungho Suh, Paul Lukowicz, Yong Oh Lee

In this paper, we propose a novel supervised discriminative feature generation (DFG) method for a minority class dataset.

Classification Data Augmentation +2

Two-stage generative adversarial networks for document image binarization with color noise and background removal

1 code implementation20 Oct 2020 Sungho Suh, Jihun Kim, Paul Lukowicz, Yong Oh Lee

Document image enhancement and binarization methods are often used to improve the accuracy and efficiency of document image analysis tasks such as text recognition.

Binarization Image Enhancement

Fusion of Global-Local Features for Image Quality Inspection of Shipping Label

no code implementations26 Aug 2020 Sungho Suh, Paul Lukowicz, Yong Oh Lee

These results are expected to improve the shipping address recognition and verification system by applying different image preprocessing steps based on the classified conditions.

object-detection Object Detection

Collaborative Interactive Learning -- A clarification of terms and a differentiation from other research fields

no code implementations16 May 2019 Tom Hanika, Marek Herde, Jochen Kuhn, Jan Marco Leimeister, Paul Lukowicz, Sarah Oeste-Reiß, Albrecht Schmidt, Bernhard Sick, Gerd Stumme, Sven Tomforde, Katharina Anna Zweig

The field of collaborative interactive learning (CIL) aims at developing and investigating the technological foundations for a new generation of smart systems that support humans in their everyday life.

Active Learning

Self-Adaptation of Activity Recognition Systems to New Sensors

no code implementations30 Jan 2017 David Bannach, Martin Jänicke, Vitor F. Rey, Sven Tomforde, Bernhard Sick, Paul Lukowicz

Traditional activity recognition systems work on the basis of training, taking a fixed set of sensors into account.

Activity Recognition Clustering

Transforming Sensor Data to the Image Domain for Deep Learning - an Application to Footstep Detection

no code implementations4 Jan 2017 Monit Shah Singh, Vinaychandran Pondenkandath, Bo Zhou, Paul Lukowicz, Marcus Liwicki

Convolutional Neural Networks (CNNs) have become the state-of-the-art in various computer vision tasks, but they are still premature for most sensor data, especially in pervasive and wearable computing.

General Classification Transfer Learning

A New Vision of Collaborative Active Learning

no code implementations1 Apr 2015 Adrian Calma, Tobias Reitmaier, Bernhard Sick, Paul Lukowicz, Mark Embrechts

Active learning (AL) is a learning paradigm where an active learner has to train a model (e. g., a classifier) which is in principal trained in a supervised way, but in AL it has to be done by means of a data set with initially unlabeled samples.

Active Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.