no code implementations • 14 Mar 2024 • Wenjie Yin, Xuejiao Zhao, Yi Yu, Hang Yin, Danica Kragic, Mårten Björkman
First, we propose LM2D, a novel probabilistic architecture that incorporates a multimodal diffusion model with consistency distillation, designed to create dance conditioned on both music and lyrics in one diffusion generation step.
no code implementations • 12 Dec 2023 • Wenjie Yin, Yi Yu, Hang Yin, Danica Kragic, Mårten Björkman
Current training of motion style transfer systems relies on consistency losses across style domains to preserve contents, hindering its scalable application to a large number of domains and private data.
1 code implementation • 30 Sep 2023 • Wenjie Yin, Qingyuan Yao, Yi Yu, Hang Yin, Danica Kragic, Mårten Björkman
To complement it, we introduce JustLMD, a new multimodal dataset of 3D dance motion with music and lyrics.
1 code implementation • 24 Aug 2023 • Jia Fu, Jiarui Tan, Wenjie Yin, Sepideh Pashami, Mårten Björkman
Motion analysis of improvised dance can be challenging due to its unique dynamics.
no code implementations • 3 Aug 2023 • Fangkai Yang, Wenjie Yin, Lu Wang, Tianci Li, Pu Zhao, Bo Liu, Paul Wang, Bo Qiao, Yudong Liu, Mårten Björkman, Saravan Rajmohan, QIngwei Lin, Dongmei Zhang
However, they suffer from poor data quality like data missing in model training and prediction, which limits the performance.
no code implementations • 3 Apr 2023 • Wenjie Yin, Ruibo Tu, Hang Yin, Danica Kragic, Hedvig Kjellström, Mårten Björkman
Data-driven and controllable human motion synthesis and prediction are active research areas with various applications in interactive media and social robotics.
1 code implementation • 7 Mar 2023 • Hannah Rose Kirk, Wenjie Yin, Bertie Vidgen, Paul Röttger
Online sexism is a widespread and harmful phenomenon.
no code implementations • 20 Dec 2022 • Wenjie Yin, Vibhor Agarwal, Aiqi Jiang, Arkaitz Zubiaga, Nishanth Sastry
During training, the model associates annotators with their label choices given a piece of text; during evaluation, when label information is not available, the model predicts the aggregated label given by the participating annotators by utilising the learnt association.
no code implementations • 19 Aug 2022 • Wenjie Yin, Hang Yin, Kim Baraka, Danica Kragic, Mårten Björkman
We present CycleDance, a dance style transfer system to transform an existing motion clip in one dance style to a motion clip in another dance style while attempting to preserve motion context of the dance.
no code implementations • 3 May 2022 • Wenjie Yin, Arkaitz Zubiaga
While social media offers freedom of self-expression, abusive language carry significant negative social impact.
no code implementations • 31 Aug 2021 • Wenjie Yin, Rabab Alkhalifa, Arkaitz Zubiaga
There is however a gap in the longitudinal study of how sentiment evolved in social media over the years.
no code implementations • 7 Apr 2021 • Wenjie Yin, Hang Yin, Danica Kragic, Mårten Björkman
Data-driven approaches for modeling human skeletal motion have found various applications in interactive media and social robotics.
no code implementations • 17 Feb 2021 • Wenjie Yin, Arkaitz Zubiaga
Hate speech is one type of harmful online content which directly attacks or promotes hate towards a group or an individual member based on their actual or perceived aspects of identity, such as ethnicity, religion, and sexual orientation.
1 code implementation • Medical Image Computing and Computer Assisted Intervention 2020 • Donglai Wei, Zudi Lin, Daniel Franco-Barranco, Nils Wendt, Xingyu Liu, Wenjie Yin, Xin Huang, Aarush Gupta, Won-Dong Jang, Xueying Wang, Ignacio Arganda-Carreras, Jeff Lichtman, Hanspeter Pfister
On MitoEM, we find existing instance segmentation methods often fail to correctly segment mitochondria with complex shapes or close contacts with other instances.
Ranked #2 on 3D Instance Segmentation on MitoEM (AP75-R-Test metric)
no code implementations • 2 Jul 2020 • Ali Ghadirzadeh, Xi Chen, Wenjie Yin, Zhengrong Yi, Mårten Björkman, Danica Kragic
We present a reinforcement learning based framework for human-centered collaborative systems.