2 code implementations • 26 Apr 2024 • Zheng Lian, Haiyang Sun, Licai Sun, Zhuofan Wen, Siyuan Zhang, Shun Chen, Hao Gu, Jinming Zhao, Ziyang Ma, Xie Chen, Jiangyan Yi, Rui Liu, Kele Xu, Bin Liu, Erik Cambria, Guoying Zhao, Björn W. Schuller, JianHua Tao
In addition to expanding the dataset size, we introduce a new track around open-vocabulary emotion recognition.
no code implementations • 16 Apr 2024 • Bin Liu, Siqi Wu, Jin Wang, Xin Deng, Ao Zhou
Specifically, HiGraphDTI learns hierarchical drug representations from triple-level molecular graphs to thoroughly exploit chemical information embedded in atoms, motifs, and molecules.
no code implementations • 12 Apr 2024 • Yujie Li, Yanbin Wang, Haitao Xu, Bin Liu, Jianguo Sun, Zhenhao Guo, Wenrui Ma
Unlike data-driven classifiers, TMDC, guided by Bayesian principles, utilizes the conditional likelihood from diffusion models to determine the class probabilities of input images, thereby insulating against the influences of data shift and the limitations of adversarial training.
no code implementations • 27 Mar 2024 • Ao Zhou, Bin Liu, Jin Wang, Grigorios Tsoumakas
However, the intrinsic class imbalance in multi-label data may bias the model towards majority labels, since samples relevant to minority labels may be underrepresented in each mini-batch.
no code implementations • 22 Mar 2024 • Zhuofan Wen, Fengyu Zhang, Siyuan Zhang, Haiyang Sun, Mingyu Xu, Licai Sun, Zheng Lian, Bin Liu, JianHua Tao
Multimodal fusion is a significant method for most multimodal tasks.
no code implementations • 18 Mar 2024 • Howard Zhang, Yunhao Ba, Ethan Yang, Rishi Upadhyay, Alex Wong, Achuta Kadambi, Yun Guo, Xueyao Xiao, Xiaoxiong Wang, Yi Li, Yi Chang, Luxin Yan, Chaochao Zheng, Luping Wang, Bin Liu, Sunder Ali Khowaja, Jiseok Yoon, Ik-Hyun Lee, Zhao Zhang, Yanyan Wei, Jiahuan Ren, Suiyi Zhao, Huan Zheng
This report reviews the results of the GT-Rain challenge on single image deraining at the UG2+ workshop at CVPR 2023.
no code implementations • 12 Mar 2024 • Shipeng Song, Bin Liu, Fei Teng, Tianrui Li
Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering.
no code implementations • 11 Mar 2024 • Bo Li, Yi-ke Li, Zhi-fen He, Bin Liu, Yun-Kun Lai
3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision.
1 code implementation • 4 Mar 2024 • Tianxiang Chen, Zhentao Tan, Tao Gong, Qi Chu, Yue Wu, Bin Liu, Jieping Ye, Nenghai Yu
Inspired by the recent basic model with linear complexity for long-distance modeling, called Mamba, we explore the potential of this state space model for ISTD task in terms of effectiveness and efficiency in the paper.
no code implementations • 18 Feb 2024 • Kang Chen, Zheng Lian, Haiyang Sun, Bin Liu, JianHua Tao
To address data scarcity, this paper proposes a new data collection pipeline.
1 code implementation • 9 Feb 2024 • Ziqiao Shang, Bin Liu, Fei Teng, Tianrui Li
To address the challenge posed by noisy AU labels, we augment the supervised signal through the introduction of a self-supervised signal.
no code implementations • 4 Feb 2024 • Tianxiang Chen, Zhentao Tan, Tao Gong, Qi Chu, Yue Wu, Bin Liu, Le Lu, Jieping Ye, Nenghai Yu
This bidirectional interaction narrows the modality imbalance, facilitating more effective learning of integrated audio-visual representations.
no code implementations • 3 Feb 2024 • Tianxiang Chen, Zhentao Tan, Qi Chu, Yue Wu, Bin Liu, Nenghai Yu
We abstract this process as the directional movement of feature map pixels to target areas through convolution, pooling and interactions with surrounding pixels, which can be analogous to the movement of thermal particles constrained by surrounding variables and particles.
1 code implementation • 1 Feb 2024 • Xiang Zhang, Jingyang Huang, Huan Yan, Peng Zhao, Guohang Zhuang, Zhi Liu, Bin Liu
This uncertainty, resulting from noise and domains, leads to widely scattered and irregular data distributions in collected Wi-Fi sensing data.
1 code implementation • 11 Jan 2024 • Licai Sun, Zheng Lian, Bin Liu, JianHua Tao
Audio-Visual Emotion Recognition (AVER) has garnered increasing attention in recent years for its critical role in creating emotion-ware intelligent machines.
Ranked #3 on Dynamic Facial Expression Recognition on MAFW
Contrastive Learning Dynamic Facial Expression Recognition +3
1 code implementation • 31 Dec 2023 • Licai Sun, Zheng Lian, Kexin Wang, Yu He, Mingyu Xu, Haiyang Sun, Bin Liu, JianHua Tao
Video-based facial affect analysis has recently attracted increasing attention owing to its critical role in human-computer interaction.
Ranked #3 on Dynamic Facial Expression Recognition on FERV39k
Dynamic Facial Expression Recognition Emotion Recognition +2
1 code implementation • 7 Dec 2023 • Zheng Lian, Licai Sun, Haiyang Sun, Kang Chen, Zhuofan Wen, Hao Gu, Bin Liu, JianHua Tao
To bridge this gap, we present the quantitative evaluation results of GPT-4V on 21 benchmark datasets covering 6 tasks: visual sentiment analysis, tweet sentiment analysis, micro-expression recognition, facial emotion recognition, dynamic facial emotion recognition, and multimodal emotion recognition.
no code implementations • 5 Dec 2023 • Dianmo Sheng, Dongdong Chen, Zhentao Tan, Qiankun Liu, Qi Chu, Jianmin Bao, Tao Gong, Bin Liu, Shengwei Xu, Nenghai Yu
Thanks to this design, the model is capable of handling in-context vision understanding tasks with multimodal output in a unified pipeline. Experimental results demonstrate that our model achieves competitive performance compared with specialized models and previous ICL baselines.
1 code implementation • 22 Nov 2023 • ZiHao Zhou, Bin Hu, Chenyang Zhao, Pu Zhang, Bin Liu
By incorporating the guidance from the teacher agent, the student agent can distill the prior knowledge of the LLM into its own model.
1 code implementation • 10 Oct 2023 • Bojue Wang, Chunmei Ma, Bin Liu, Nianbo Liu, Jinqi Zhu
In this paper, we propose a new structured pruning method.
no code implementations • 22 Sep 2023 • Jiazhen Wang, Bin Liu, Changtao Miao, Zhiwei Zhao, Wanyi Zhuang, Qi Chu, Nenghai Yu
Existing methods for multi-modal manipulation detection and grounding primarily focus on fusing vision-language features to make predictions, while overlooking the importance of modality-specific features, leading to sub-optimal results.
1 code implementation • 21 Sep 2023 • Rui Liu, Bin Liu, Haizhou Li
Prosodic phrasing is crucial to the naturalness and intelligibility of end-to-end Text-to-Speech (TTS).
2 code implementations • 12 Sep 2023 • Anthony Cioppa, Silvio Giancola, Vladimir Somers, Floriane Magera, Xin Zhou, Hassan Mkhallati, Adrien Deliège, Jan Held, Carlos Hinojosa, Amir M. Mansourian, Pierre Miralles, Olivier Barnich, Christophe De Vleeschouwer, Alexandre Alahi, Bernard Ghanem, Marc Van Droogenbroeck, Abdullah Kamal, Adrien Maglo, Albert Clapés, Amr Abdelaziz, Artur Xarles, Astrid Orcesi, Atom Scott, Bin Liu, Byoungkwon Lim, Chen Chen, Fabian Deuser, Feng Yan, Fufu Yu, Gal Shitrit, Guanshuo Wang, Gyusik Choi, Hankyul Kim, Hao Guo, Hasby Fahrudin, Hidenari Koguchi, Håkan Ardö, Ibrahim Salah, Ido Yerushalmy, Iftikar Muhammad, Ikuma Uchida, Ishay Be'ery, Jaonary Rabarisoa, Jeongae Lee, Jiajun Fu, Jianqin Yin, Jinghang Xu, Jongho Nang, Julien Denize, Junjie Li, Junpei Zhang, Juntae Kim, Kamil Synowiec, Kenji Kobayashi, Kexin Zhang, Konrad Habel, Kota Nakajima, Licheng Jiao, Lin Ma, Lizhi Wang, Luping Wang, Menglong Li, Mengying Zhou, Mohamed Nasr, Mohamed Abdelwahed, Mykola Liashuha, Nikolay Falaleev, Norbert Oswald, Qiong Jia, Quoc-Cuong Pham, Ran Song, Romain Hérault, Rui Peng, Ruilong Chen, Ruixuan Liu, Ruslan Baikulov, Ryuto Fukushima, Sergio Escalera, Seungcheon Lee, Shimin Chen, Shouhong Ding, Taiga Someya, Thomas B. Moeslund, Tianjiao Li, Wei Shen, Wei zhang, Wei Li, Wei Dai, Weixin Luo, Wending Zhao, Wenjie Zhang, Xinquan Yang, Yanbiao Ma, Yeeun Joo, Yingsen Zeng, Yiyang Gan, Yongqiang Zhu, Yujie Zhong, Zheng Ruan, Zhiheng Li, Zhijian Huang, Ziyu Meng
More information on the tasks, challenges, and leaderboards are available on https://www. soccer-net. org.
1 code implementation • 5 Sep 2023 • Zezhen Zeng, Bin Liu
Deep generative models have been demonstrated as problematic in the unsupervised out-of-distribution (OOD) detection task, where they tend to assign higher likelihoods to OOD samples.
Out-of-Distribution Detection Out of Distribution (OOD) Detection
no code implementations • 24 Aug 2023 • Mohsen Nayebi Kerdabadi, Arya Hadizadeh Moghaddam, Bin Liu, Mei Liu, Zijun Yao
Therefore, in this paper, we propose a novel Ontology-aware Temporality-based Contrastive Survival (OTCSurv) analysis framework that utilizes survival durations from both censored and observed data to define temporal distinctiveness and construct negative sample pairs with adjustable hardness for contrastive learning.
no code implementations • 13 Aug 2023 • Yutao Jin, Bin Liu, Jing Wang
The application of video captioning models aims at translating the content of videos by using accurate natural language.
1 code implementation • 29 Jul 2023 • Bin Liu, Qin Luo, Bang Wang
Learning contrastive representations from pairwise comparisons has achieved remarkable success in various fields, such as natural language processing, computer vision, and information retrieval.
no code implementations • 7 Jul 2023 • Chuanbo Hu, Bin Liu, Xin Li, Yanfang Ye
By integrating prior knowledge and the proposed prompts, ChatGPT can effectively identify and label drug trafficking activities on social networks, even in the presence of deceptive language and euphemisms used by drug dealers to evade detection.
1 code implementation • 5 Jul 2023 • Licai Sun, Zheng Lian, Bin Liu, JianHua Tao
Dynamic facial expression recognition (DFER) is essential to the development of intelligent and empathetic machines.
Ranked #2 on Dynamic Facial Expression Recognition on FERV39k
Dynamic Facial Expression Recognition Facial Expression Recognition
no code implementations • 19 Jun 2023 • Yaqi Zhang, Di Huang, Bin Liu, Shixiang Tang, Yan Lu, Lu Chen, Lei Bai, Qi Chu, Nenghai Yu, Wanli Ouyang
Generating realistic human motion from given action descriptions has experienced significant advancements because of the emerging requirement of digital humans.
no code implementations • 16 Jun 2023 • Yaqi Zhang, Yan Lu, Bin Liu, Zhiwei Zhao, Qi Chu, Nenghai Yu
Transformer is popular in recent 3D human pose estimation, which utilizes long-term modeling to lift 2D keypoints into the 3D space.
Ranked #85 on 3D Human Pose Estimation on Human3.6M
no code implementations • 11 Jun 2023 • Minglei Yin, Bin Liu, Neil Zhenqiang Gong, Xin Li
Our proposed method can simultaneously (1) secure VARS from adversarial attacks characterized by local perturbations by image reconstruction based on global vision transformers; and (2) accurately detect adversarial examples using a novel contrastive learning approach.
1 code implementation • 9 Jun 2023 • Luping Wang, Hao Guo, Bin Liu
We first generated several variants of the E2E-Spot model, resulting in a candidate model set.
1 code implementation • 6 Jun 2023 • Bin Hu, Chenyang Zhao, Pu Zhang, ZiHao Zhou, Yuanhang Yang, Zenglin Xu, Bin Liu
In this paper, we explore how to enable intelligent cost-effective interactions between the agent and an LLM.
1 code implementation • 2 Jun 2023 • Bin Liu, Erjia Chen, Bang Wang
To achieve this win-win situation, we propose to intervene in model training through negative sampling thereby modifying model predictions.
1 code implementation • 18 May 2023 • Changtao Miao, Qi Chu, Zhentao Tan, Zhenchao Jin, Wanyi Zhuang, Yue Wu, Bin Liu, Honggang Hu, Nenghai Yu
Next, a novel Multi-Spectral Class Center Network (MSCCNet) is proposed for face manipulation detection and localization.
no code implementations • 10 May 2023 • Xulin Li, Yan Lu, Bin Liu, Yuenan Hou, Yating Liu, Qi Chu, Wanli Ouyang, Nenghai Yu
Clothes-invariant feature extraction is critical to the clothes-changing person re-identification (CC-ReID).
1 code implementation • 9 May 2023 • Chaochao Zheng, Luping Wang, Bin Liu
It consists of four main modules: the single-image de-raining module (Restormer-X), the median filtering module, the weighted averaging module, and the post-processing module.
3 code implementations • 18 Apr 2023 • Zheng Lian, Haiyang Sun, Licai Sun, Kang Chen, Mingyu Xu, Kexin Wang, Ke Xu, Yu He, Ying Li, Jinming Zhao, Ye Liu, Bin Liu, Jiangyan Yi, Meng Wang, Erik Cambria, Guoying Zhao, Björn W. Schuller, JianHua Tao
The first Multimodal Emotion Recognition Challenge (MER 2023) was successfully held at ACM Multimedia.
1 code implementation • 10 Apr 2023 • Luping Wang, Bin Liu
In contrast, DeMix elaborately selects a semantically rich patch, located by a pre-trained DETR.
1 code implementation • 1 Apr 2023 • Chenyang Zhao, ZiHao Zhou, Bin Liu
Offline Meta Reinforcement Learning (OMRL) aims to learn transferable knowledge from offline datasets to enhance the learning process for new target tasks.
no code implementations • 29 Mar 2023 • Min Hu, Zhizhong Tan, Bin Liu, Guosheng Yin
This study aims to address the challenges of futures price prediction in high-frequency trading (HFT) by proposing a continuous learning factor predictor based on graph neural networks.
1 code implementation • 16 Mar 2023 • Pu Zhang, Tianhua Chen, Bin Liu
To achieve accurate fine-grained detection, one needs to employ a large enough model and a vast amount of data annotations.
no code implementations • 7 Mar 2023 • Xin Li, Bin Liu, Shuo Wang
At the intersection of computational neuroscience (CN) and data mining (DM), we advocate a holistic view toward their rich connections.
no code implementations • 24 Feb 2023 • Bin Liu, Xiaolin Wei, Bo Li, Junjie Cao, Yu-Kun Lai
In this paper, a novel pose-controllable 3D facial animation synthesis method is proposed by utilizing hierarchical audio-vertex attention.
no code implementations • 11 Feb 2023 • Bo Li, Xiaolin Wei, Fengwei Chen, Bin Liu
In shape prediction module, the reference RGB image is first encoded into a high-level shape feature and then the shape feature is utilized as a condition to predict the reverse geometric noise in diffusion model.
no code implementations • NeurIPS 2023 • Yunchang Yang, Han Zhong, Tianhao Wu, Bin Liu, LiWei Wang, Simon S. Du
We study stochastic delayed feedback in general multi-agent sequential decision making, which includes bandits, single-agent Markov decision processes (MDPs), and Markov games (MGs).
1 code implementation • 27 Jan 2023 • Bin Liu, Bang Wang, Tianrui Li
Recent years have witnessed many successful applications of contrastive learning in diverse domains, yet its self-supervised version still remains many exciting challenges.
1 code implementation • 11 Dec 2022 • Kailin Liang, Bin Liu, Yifan Hu, Rui Liu, Feilong Bao, Guanglai Gao
Text-to-Speech (TTS) synthesis for low-resource languages is an attractive research issue in academia and industry nowadays.
1 code implementation • 1 Dec 2022 • Bin Liu, Jin Wang, Kaiwei Sun, Grigorios Tsoumakas
Recently, with the availability of abundant heterogeneous biological information from diverse data sources, computational methods have been able to leverage multiple drug and target similarities to boost the performance of DTI prediction.
1 code implementation • 9 Nov 2022 • Zheng Lian, Mingyu Xu, Lan Chen, Licai Sun, Bin Liu, JianHua Tao
In this paper, we relax this assumption and focus on a more general problem, noisy PLL, where the ground-truth label may not exist in the candidate set.
no code implementations • 9 Oct 2022 • Wenlong Deng, Lang Lang, Zhen Liu, Bin Liu
In light of the smoothness property brought by skip connections in ResNet, this paper proposed the Skip Logit to introduce the skip connection mechanism that fits arbitrary DNN dimensions and embraces similar properties to ResNet.
no code implementations • 3 Sep 2022 • Huiyi Guo, wei he, Bin Liu
We study the revenue-maximizing mechanism when a buyer's value evolves endogenously because of learning-by-consuming.
1 code implementation • 24 Aug 2022 • Qianqian Shen, Yanan Li, Jiyong Jin, Bin Liu
Deep learning has achieved tremendous success in computer vision, while medical image segmentation (MIS) remains a challenge, due to the scarcity of data annotations.
1 code implementation • 16 Aug 2022 • Licai Sun, Zheng Lian, Bin Liu, JianHua Tao
With the proliferation of user-generated online videos, Multimodal Sentiment Analysis (MSA) has attracted increasing attention recently.
no code implementations • 1 Aug 2022 • Xulin Li, Yan Lu, Bin Liu, Yating Liu, Guojun Yin, Qi Chu, Jinyang Huang, Feng Zhu, Rui Zhao, Nenghai Yu
But we find existing graph-based methods in the visible-infrared person re-identification task (VI-ReID) suffer from bad generalization because of two issues: 1) train-test modality balance gap, which is a property of VI-ReID task.
no code implementations • 31 Jul 2022 • Bin Liu, Jiwen Wang, Ruirui Wang, Yaxu Wang, Guangzu Zhao
This method is verified in the field of the Second Water Source Channel of Hangzhou, China, resulting in the average penetration rate increased by 11. 3%, and the total cost decreased by 10. 0%, which proves the practicability and effectiveness of the developed decision-making model.
no code implementations • 23 Jul 2022 • Haiyang Sun, Zheng Lian, Bin Liu, JianHua Tao, Licai Sun, Cong Cai
In this paper, we propose the solution to the Multi-Task Learning (MTL) Challenge of the 4th Affective Behavior Analysis in-the-wild (ABAW) competition.
no code implementations • 8 Jul 2022 • Wanyi Zhuang, Qi Chu, Haojie Yuan, Changtao Miao, Bin Liu, Nenghai Yu
Existing face forgery detection methods usually treat face forgery detection as a binary classification problem and adopt deep convolution neural networks to learn discriminative features.
1 code implementation • 29 Jun 2022 • Lele Wang, Bin Liu
In this paper, we propose a novel adversarial en-semble training approach that jointly learns the label dependencies and member models.
no code implementations • 30 May 2022 • Chengfei Lv, Chaoyue Niu, Renjie Gu, Xiaotang Jiang, Zhaode Wang, Bin Liu, Ziqi Wu, Qiulin Yao, Congyu Huang, Panos Huang, Tao Huang, Hui Shu, Jinde Song, Bin Zou, Peng Lan, Guohuan Xu, Fei Wu, Shaojie Tang, Fan Wu, Guihai Chen
Walle consists of a deployment platform, distributing ML tasks to billion-scale devices in time; a data pipeline, efficiently preparing task input; and a compute container, providing a cross-platform and high-performance execution environment, while facilitating daily task iteration.
no code implementations • 20 May 2022 • Xiuxiu Bai, Zhe Liu, Yao Gao, Bin Liu, Yongqiang Hao
Artificial neural networks have realized incredible successes at image recognition, but the underlying mechanism of visual space representation remains a huge mystery.
1 code implementation • CVPR 2023 • Bo Li, Kaitao Xue, Bin Liu, Yu-Kun Lai
In this paper, a novel image-to-image translation method based on the Brownian Bridge Diffusion Model (BBDM) is proposed, which models image-to-image translation as a stochastic Brownian bridge process, and learns the translation between two domains directly through the bidirectional diffusion process rather than a conditional generation process.
no code implementations • 5 Apr 2022 • Qiankun Liu, Bin Liu, Yue Wu, Weihai Li, Nenghai Yu
Recent online Multi-Object Tracking (MOT) methods have achieved desirable tracking performance.
1 code implementation • 2 Apr 2022 • Bin Liu, Bang Wang
Although previous studies have proposed some approaches to sample informative instances, few has been done to discriminating false negative from true negative for unbiased negative sampling.
1 code implementation • 1 Apr 2022 • Yao Yao, Bin Liu, Haoxun He, Dakui Sheng, Ke Wang, Li Xiao, Huanhuan Cao
Noisy features and inappropriate embedding dimension assignments can deteriorate the performance of recommender systems and introduce unnecessary complexity in model training and online serving.
no code implementations • 25 Mar 2022 • Haiyang Sun, Zheng Lian, Bin Liu, Ying Li, Licai Sun, Cong Cai, JianHua Tao, Meng Wang, Yuan Cheng
Speech emotion recognition (SER) is an important research topic in human-computer interaction.
1 code implementation • 4 Mar 2022 • Zheng Lian, Lan Chen, Licai Sun, Bin Liu, JianHua Tao
To this end, we propose a novel framework for incomplete multimodal learning in conversations, called "Graph Complete Network (GCNet)", filling the gap of existing works.
no code implementations • 28 Feb 2022 • Jingwei Zhuo, Bin Liu, Xiang Li, Han Zhu, Xiaoqiang Zhu
Motivated by the observation that model-free methods like behavioral retargeting (BR) and item-based collaborative filtering (ItemCF) hit different parts of the user-item relevance compared to neural sequential recommendation models, we propose a novel model-agnostic training approach called WSLRec, which adopts a three-stage framework: pre-training, top-$k$ mining, and fine-tuning.
no code implementations • 17 Feb 2022 • Jiangyan Yi, Ruibo Fu, JianHua Tao, Shuai Nie, Haoxin Ma, Chenglong Wang, Tao Wang, Zhengkun Tian, Ye Bai, Cunhang Fan, Shan Liang, Shiming Wang, Shuai Zhang, Xinrui Yan, Le Xu, Zhengqi Wen, Haizhou Li, Zheng Lian, Bin Liu
Audio deepfake detection is an emerging topic, which was included in the ASVspoof 2021.
no code implementations • 14 Feb 2022 • Rihan Chen, Bin Liu, Han Zhu, Yaoxuan Wang, Qi Li, Buting Ma, Qingbo Hua, Jun Jiang, Yunlong Xu, Hongbo Deng, Bo Zheng
In this paper, we propose a novel method to extend ANN search to arbitrary matching functions, e. g., a deep neural network.
1 code implementation • 14 Feb 2022 • Hao Guo, Jiyong Jin, Bin Liu
Ensemble methods are commonly used to enhance the generalization performance of machine learning models.
1 code implementation • 24 Jan 2022 • Bin Liu, Dimitrios Papadopoulos, Fragkiskos D. Malliaros, Grigorios Tsoumakas, Apostolos N. Papadopoulos
Moreover, the validation of highly ranked non-interacting pairs also demonstrates the potential of MDMF2A to discover novel DTIs.
no code implementations • 4 Jan 2022 • Qiankun Liu, Dongdong Chen, Qi Chu, Lu Yuan, Bin Liu, Lei Zhang, Nenghai Yu
In addition, such practice of re-identification still can not track those highly occluded objects when they are missed by the detector.
Ranked #7 on Multi-Object Tracking on MOT16 (using extra training data)
1 code implementation • 3 Jan 2022 • Hao Guo, Jiyong Jin, Bin Liu
PSWA outperforms its backbone SGD remarkably, providing experimental evidences for the existence of global geometric structures.
no code implementations • 20 Oct 2021 • Jindi Zhang, Yifan Zhang, Kejie Lu, JianPing Wang, Kui Wu, Xiaohua Jia, Bin Liu
In our study, we use real data sets and the state-of-the-art machine learning model to evaluate our attack detection scheme and the results confirm the effectiveness of our detection method.
no code implementations • 18 Oct 2021 • Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu
This problem is more challenging than the supervised counterpart, as the low data density in the small-scale target data is not friendly for unsupervised learning, leading to the damage of the pretrained representation and poor representation in the target domain.
no code implementations • 14 Oct 2021 • Zhuo Tan, Bin Liu, Guosheng Yin
We define an incoming embedding and an outgoing embedding for each node to model its sending and receiving features respectively.
1 code implementation • ICCV 2021 • Zhenchao Jin, Bin Liu, Qi Chu, Nenghai Yu
Third, we compute the similarities between each pixel representation and the image-level contextual information, the semantic-level contextual information, respectively.
no code implementations • 26 Aug 2021 • Bin Liu
Current model selection methods all require access to a batch of labeled data for computing a pre-specified performance metric, such as the cross-entropy loss, the classification error rate and the negative log-likelihood.
no code implementations • 19 Aug 2021 • Chuanbo Hu, Minglei Yin, Bin Liu, Xin Li, Yanfang Ye
Accordingly, accurate detection of illicit drug trafficking events (IDTEs) from social media has become even more challenging.
no code implementations • 18 Aug 2021 • Chuanbo Hu, Minglei Yin, Bin Liu, Xin Li, Yanfang Ye
Unlike existing methods that focus on posting-based detection, we propose to tackle the problem of illicit drug dealer identification by constructing a large-scale multimodal dataset named Identifying Drug Dealers on Instagram (IDDIG).
1 code implementation • 16 Aug 2021 • Shulun Wang, Bin Liu, Feng Liu
Softmax is widely used in neural networks for multiclass classification, gate structure and attention mechanisms.
no code implementations • 29 Jul 2021 • Luchuan Song, Bin Liu, Huihui Zhu, Qi Chu, Nenghai Yu
To this end, we propose a multivariate fusion method that analyzes each target through three branches: object, action and motion.
no code implementations • 29 Jul 2021 • Kun Zhao, Luchuan Song, Bin Liu, Qi Chu, Nenghai Yu
Crowd counting is a challenging task due to the issues such as scale variation and perspective variation in real crowd scenes.
no code implementations • ICCV 2021 • Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu
Unsupervised pretraining has achieved great success and many recent works have shown unsupervised pretraining can achieve comparable or even slightly better transfer performance than supervised pretraining on downstream target datasets.
1 code implementation • 13 May 2021 • Bin Liu
Then the problem of concern is formalized as a task of nonlinear non-Gaussian state filtering under model uncertainty, which is addressed by a dynamic model averaging (DMA) based particle filter (PF) algorithm.
1 code implementation • 1 May 2021 • Bin Liu, Grigorios Tsoumakas
In drug discovery, identifying drug-target interactions (DTIs) via experimental approaches is a tedious and expensive procedure.
no code implementations • 29 Apr 2021 • Bin Liu, Yaxu Wang, Guangzu Zhao, Bin Yang, Ruirui Wang, Dexiang Huang, Bin Xiang
Therefore, this paper proposes an intelligent decision method for the main control parameters of the TBM based on the multi-objective optimization of excavation efficiency and cost.
no code implementations • 29 Mar 2021 • Bin Liu
AI has surpassed humans across a variety of tasks such as image classification, playing games (e. g., go, "Starcraft" and poker), and protein structure prediction.
1 code implementation • CVPR 2021 • Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Bin Liu, Gang Hua, Nenghai Yu
In this paper, we propose a novel diverse semantic image synthesis framework from the perspective of semantic class distributions, which naturally supports diverse generation at semantic or even instance level.
Ranked #1 on Image-to-Image Translation on ADE20K Labels-to-Photos (LPIPS metric)
no code implementations • 20 Feb 2021 • Jianyu Xu, Bin Liu, Huadong Mo, Daoyi Dong
The cybersecurity of smart grids has become one of key problems in developing reliable modern power and energy systems.
no code implementations • 15 Jan 2021 • Tiantian Chen, Bin Liu, Wenjing Liu, Qizhi Fang, Jing Yuan, Weili Wu
Through "word of mouth" effects, information or product adoption could spread from some influential individuals to millions of users in social networks.
Social and Information Networks
no code implementations • 7 Jan 2021 • Hai Huang, Jiaming Mu, Neil Zhenqiang Gong, Qi Li, Bin Liu, Mingwei Xu
Specifically, we formulate our attack as an optimization problem, such that the injected ratings would maximize the number of normal users to whom the target items are recommended.
1 code implementation • 22 Dec 2020 • Bin Liu, Konstantinos Pliakos, Celine Vens, Grigorios Tsoumakas
In addition, WkNNIR exploits local imbalance to promote the influence of more reliable similarities on the interaction recovery and prediction processes.
no code implementations • COLING 2020 • Bin Liu, Liang Wang, Guosheng Yin
Similar to the Bi-LSTM, these n-gram detectors learn both forward and backward distributional semantic knowledge from the sentence tensor.
no code implementations • 11 Nov 2020 • Cunhang Fan, Bin Liu, JianHua Tao, Jiangyan Yi, Zhengqi Wen, Leichao Song
This paper proposes a deep time delay neural network (TDNN) for speech enhancement with full data learning.
no code implementations • 9 Nov 2020 • Cunhang Fan, Jiangyan Yi, JianHua Tao, Zhengkun Tian, Bin Liu, Zhengqi Wen
The joint training framework for speech enhancement and recognition methods have obtained quite good performances for robust end-to-end automatic speech recognition (ASR).
Automatic Speech Recognition Automatic Speech Recognition (ASR) +2
no code implementations • Interspeech 2020 • Zheng Lian, JianHua Tao, Bin Liu, Jian Huang, Zhanlei Yang, Rongjun Li
Emotion recognition remains a complex task due to speaker variations and low-resource training samples.
Ranked #1 on Speech Emotion Recognition on IEMOCAP (using extra training data)
no code implementations • 8 Oct 2020 • Christopher E. O'Connor, Bin Liu, Dong Lai
By requiring that perturbations from the companion stars be able to overcome short-range forces and excite the planet's eccentricity to $e \simeq 1$, we obtain an absolute limit of $a_{1} \gtrsim 8 \, {\rm AU} \, (a_{3} / 1500 \, {\rm AU})^{6/7}$ for the planet's semi-major axis just before migration (where $a_{3}$ is the semi-major axis of the 'outer' orbit).
Earth and Planetary Astrophysics Solar and Stellar Astrophysics
no code implementations • 15 Sep 2020 • Yiyin Zheng, Shantong Chen, Zhipeng Huang, Shixuan Dai, Bin Liu, Yongyao Li, Shurong Wang
We study the stability of zero-vorticity and vortex lattice quantum droplets (LQDs), which are described by a two-dimensional (2D) Gross-Pitaevskii (GP) equation with a periodic potential and Lee-Huang-Yang (LHY) term.
Pattern Formation and Solitons Quantum Physics
1 code implementation • NeurIPS 2020 • Yue Cao, Zhenda Xie, Bin Liu, Yutong Lin, Zheng Zhang, Han Hu
This paper presents parametric instance classification (PIC) for unsupervised visual feature learning.
1 code implementation • 8 Jun 2020 • Bin Liu, Rongmon Bordoloi
We apply iQNet and predict the continua of $\sim$3200 SDSS-DR16 quasar spectra at higher redshift ($2< z \leq 5$) and measure the redshift evolution of mean transmitted flux ($< F >$) in the Ly-$\alpha$ forest region.
Astrophysics of Galaxies
1 code implementation • 8 May 2020 • Abdelrahman Abdelhamed, Mahmoud Afifi, Radu Timofte, Michael S. Brown, Yue Cao, Zhilu Zhang, WangMeng Zuo, Xiaoling Zhang, Jiye Liu, Wendong Chen, Changyuan Wen, Meng Liu, Shuailin Lv, Yunchao Zhang, Zhihong Pan, Baopu Li, Teng Xi, Yanwen Fan, Xiyu Yu, Gang Zhang, Jingtuo Liu, Junyu Han, Errui Ding, Songhyun Yu, Bumjun Park, Jechang Jeong, Shuai Liu, Ziyao Zong, Nan Nan, Chenghua Li, Zengli Yang, Long Bao, Shuangquan Wang, Dongwoon Bai, Jungwon Lee, Youngjung Kim, Kyeongha Rho, Changyeop Shin, Sungho Kim, Pengliang Tang, Yiyun Zhao, Yuqian Zhou, Yuchen Fan, Thomas Huang, Zhihao LI, Nisarg A. Shah, Wei Liu, Qiong Yan, Yuzhi Zhao, Marcin Możejko, Tomasz Latkowski, Lukasz Treszczotko, Michał Szafraniuk, Krzysztof Trojanowski, Yanhong Wu, Pablo Navarrete Michelini, Fengshuo Hu, Yunhua Lu, Sujin Kim, Wonjin Kim, Jaayeon Lee, Jang-Hwan Choi, Magauiya Zhussip, Azamat Khassenov, Jong Hyun Kim, Hwechul Cho, Priya Kansal, Sabari Nathan, Zhangyu Ye, Xiwen Lu, Yaqi Wu, Jiangxin Yang, Yanlong Cao, Siliang Tang, Yanpeng Cao, Matteo Maggioni, Ioannis Marras, Thomas Tanay, Gregory Slabaugh, Youliang Yan, Myungjoo Kang, Han-Soo Choi, Kyungmin Song, Shusong Xu, Xiaomu Lu, Tingniao Wang, Chunxia Lei, Bin Liu, Rajat Gupta, Vineet Kumar
This challenge is based on a newly collected validation and testing image datasets, and hence, named SIDD+.
1 code implementation • 7 May 2020 • Bin Liu, Konstantinos Blekas, Grigorios Tsoumakas
Experimental results on 13 multi-label datasets demonstrate the effectiveness of the proposed measure and sampling approaches for a variety of evaluation metrics, particularly in the case of an ensemble of classifiers trained on repeated samples of the original data.
no code implementations • 6 Apr 2020 • Cunhang Fan, Jian-Hua Tao, Bin Liu, Jiangyan Yi, Zhengqi Wen
In this paper, we propose a joint training method for simultaneous speech denoising and dereverberation using deep embedding features, which is based on the deep clustering (DC).
no code implementations • CVPR 2020 • Suichan Li, Bin Liu, Dong-Dong Chen, Qi Chu, Lu Yuan, Nenghai Yu
Motivated by these limitations, this paper proposes to solve the SSL problem by building a novel density-aware graph, based on which the neighborhood information can be easily leveraged and the feature learning and label propagation can also be trained in an end-to-end way.
1 code implementation • ECCV 2020 • Bin Liu, Yue Cao, Yutong Lin, Qi Li, Zheng Zhang, Mingsheng Long, Han Hu
This paper introduces a negative margin loss to metric learning based few-shot learning methods.
4 code implementations • 25 Mar 2020 • Bin Liu, Chenxu Zhu, Guilin Li, Wei-Nan Zhang, Jincai Lai, Ruiming Tang, Xiuqiang He, Zhenguo Li, Yong Yu
By implementing a regularized optimizer over the architecture parameters, the model can automatically identify and remove the redundant feature interactions during the training process of the model.
Ranked #29 on Click-Through Rate Prediction on Criteo
no code implementations • 17 Mar 2020 • Cunhang Fan, Jian-Hua Tao, Bin Liu, Jiangyan Yi, Zhengqi Wen, Xuefei Liu
Secondly, to pay more attention to the outputs of the pre-separation stage, an attention module is applied to acquire deep attention fusion features, which are extracted by computing the similarity between the mixture and the pre-separated speech.
no code implementations • CVPR 2020 • Yan Lu, Yue Wu, Bin Liu, Tianzhu Zhang, Baopu Li, Qi Chu, Nenghai Yu
In this paper, we tackle the above limitation by proposing a novel cross-modality shared-specific feature transfer algorithm (termed cm-SSFT) to explore the potential of both the modality-shared information and the modality-specific characteristics to boost the re-identification performance.
Cross-Modality Person Re-identification Person Re-Identification
no code implementations • 27 Feb 2020 • Chen Liang, Ziqi Liu, Bin Liu, Jun Zhou, Xiaolong Li, Shuang Yang, Yuan Qi
In order to detect and prevent fraudulent insurance claims, we developed a novel data-driven procedure to identify groups of organized fraudsters, one of the major contributions to financial losses, by learning network information.
no code implementations • 5 Feb 2020 • Cunhang Fan, Bin Liu, Jian-Hua Tao, Jiangyan Yi, Zhengqi Wen
Specifically, we apply the deep clustering network to extract deep embedding features.
1 code implementation • 25 Dec 2019 • Bin Liu, Xiuping Liu, Zhi-Xin Yang, Charlie C. L. Wang
In this paper, we revisit the problem of 3D human modeling from two orthogonal silhouettes of individuals (i. e., front and side views).
no code implementations • 12 Dec 2019 • Bin Liu, Yuxiao Ren, Hanchi Liu, Hui Xu, Zhengfang Wang, Anthony G. Cohn, Peng Jiang
The results have demonstrated that the GPRInvNet is capable of effectively reconstructing complex tunnel lining defects with clear boundaries.
no code implementations • 11 Nov 2019 • Bin Liu, Guosheng Yin, Wenbin Du
The first two dimensions of the convolutional kernel size equal the size of the word image and the last dimension of the kernel size is $n$.
1 code implementation • NeurIPS 2019 • Yu Qi, Bin Liu, Yueming Wang, Gang Pan
Brain-computer interfaces (BCIs) have enabled prosthetic device control by decoding motor movements from neural activities.
no code implementations • 24 Oct 2019 • Zheng Lian, Jian-Hua Tao, Bin Liu, Jian Huang
Prior works on speech emotion recognition utilize various unsupervised learning approaches to deal with low-resource samples.
no code implementations • 24 Oct 2019 • Zheng Lian, Jian-Hua Tao, Bin Liu, Jian Huang
The secondary task is to learn a common representation where speaker identities can not be distinguished.
no code implementations • 24 Oct 2019 • Zheng Lian, Jian-Hua Tao, Bin Liu, Jian Huang
Different from the emotion recognition in individual utterances, we propose a multimodal learning framework using relation and dependencies among the utterances for conversational emotion analysis.
no code implementations • 18 Oct 2019 • Jun Zhou, Hua Huang, Bin Liu, Xiuping Liu
Then we use multi-task optimization to train the normal estimation and local plane classification tasks simultaneously. Also, to integrate the advantages of multi-scale results, a scale selection strategy is adopted, which is a data-driven approach for selecting the optimal scale around each point and encourages subnetwork specialization.
no code implementations • pproximateinference AABI Symposium 2019 • Chunlin Ji, Bin Liu, Yingkai Jiang, Ke Deng
We propose an evidence upper bound (EUBO) to act as the surrogate loss, and fit a DP mixture to the given data by minimizing the EUBO, which is equivalent to minimizing the KL-divergence between the target distribution and the DP mixture.
no code implementations • ICCV 2019 • Suichan Li, Dapeng Chen, Bin Liu, Nenghai Yu, Rui Zhao
Learning discriminative image feature embeddings is of great importance to visual recognition.
no code implementations • 23 Jul 2019 • Cunhang Fan, Bin Liu, Jian-Hua Tao, Jiangyan Yi, Zhengqi Wen
Firstly, a DC network is trained to extract deep embedding features, which contain each source's information and have an advantage in discriminating each target speakers.
no code implementations • 15 Jul 2019 • Bin Liu, Yu Qi, Ke-Jia Chen
We propose an INstant TEmporal structure Learning (INTEL) algorithm to address this problem.
2 code implementations • 2 May 2019 • Bin Liu, Grigorios Tsoumakas
Class-imbalance is an inherent characteristic of multi-label data which affects the prediction accuracy of most multi-label learning methods.
no code implementations • 26 Apr 2019 • Guojun Yin, Bin Liu, Huihui Zhu, Tao Gong, Nenghai Yu
Multiple-object tracking and behavior analysis have been the essential parts of surveillance video analysis for public security and urban management.
no code implementations • 10 Apr 2019 • Bin Liu, Qian Guo, Shucai Li, Benchao Liu, Yuxiao Ren, Yonghao Pang, Xu Guo, Lanbo Liu, Peng Jiang
According to the comprehensive qualitative analysis and quantitative comparison, ERSInvNet with tier feature map, smooth constraints, and depth weighting function together achieve the best performance.
6 code implementations • 9 Apr 2019 • Bin Liu, Ruiming Tang, Yingzhi Chen, Jinkai Yu, Huifeng Guo, Yuzhou Zhang
Easy-to-use, Modular and Extendible package of deep-learning based CTR models. DeepFM, DeepInterestNetwork(DIN), DeepInterestEvolutionNetwork(DIEN), DeepCrossNetwork(DCN), AttentionalFactorizationMachine(AFM), Neural Factorization Machine(NFM), AutoInt, Deep Session Interest Network(DSIN)
Ranked #1 on Click-Through Rate Prediction on Huawei App Store
no code implementations • CVPR 2019 • Guojun Yin, Lu Sheng, Bin Liu, Nenghai Yu, Xiaogang Wang, Jing Shao
Dense captioning aims at simultaneously localizing semantic regions and describing these regions-of-interest (ROIs) with short phrases or sentences in natural language.
Ranked #3 on Dense Captioning on Visual Genome
no code implementations • CVPR 2019 • Guojun Yin, Bin Liu, Lu Sheng, Nenghai Yu, Xiaogang Wang, Jing Shao
Synthesizing photo-realistic images from text descriptions is a challenging problem.
no code implementations • 11 Feb 2019 • Bin Liu
Bayesian optimization (BO) is a powerful paradigm for derivative-free global optimization of a black-box objective function (BOF) that is expensive to evaluate.
1 code implementation • 1 Feb 2019 • Bin Liu, Yue Cao, Mingsheng Long, Jian-Min Wang, Jingdong Wang
We propose Deep Triplet Quantization (DTQ), a novel approach to learning deep quantization models from the similarity triplets.
Ranked #1 on Image Retrieval on NUS-WIDE
no code implementations • 24 Jan 2019 • Haonan Tong, Bin Liu, Shihai Wang, Qiuying Li
(2) feature weighting (FW) strategy improves the average G-Measure by 11\%, and the average MCC by 29. 2\%.
no code implementations • 23 Jan 2019 • Shucai Li, Bin Liu, Yuxiao Ren, Yangkang Chen, Senlin Yang, Yunhai Wang, Peng Jiang
We propose a new method to tackle the mapping challenge from time-series data to spatial image in the field of seismic exploration, i. e., reconstructing the velocity model directly from seismic data by deep neural networks (DNNs).
1 code implementation • 20 Dec 2018 • Bin Liu, Zhirong Wu, Han Hu, Stephen Lin
In this paper, we propose a generic framework that utilizes unlabeled data to aid generalization for all three tasks.
no code implementations • 12 Dec 2018 • Huihui Zhu, Bin Liu, Guojun Yin, Yan Lu, Weihai Li, Nenghai Yu
Most existing methods are computation consuming, which cannot satisfy the real-time requirement.
no code implementations • 24 Nov 2018 • Song-Hai Zhang, Zhengping Zhou, Bin Liu, Xin Dong, Dun Liang, Peter Hall, Shi-Min Hu
In this work, we propose a novel topic consisting of two dual tasks: 1) given a scene, recommend objects to insert, 2) given an object category, retrieve suitable background scenes.
no code implementations • 9 Nov 2018 • Bin Liu
This contribution presents a very brief and critical discussion on automated machine learning (AutoML), which is categorized here into two classes, referred to as narrow AutoML and generalized AutoML, respectively.
no code implementations • ECCV 2018 • Yue Cao , Bin Liu, Mingsheng Long, Jian-Min Wang
Extensive experiments demonstrate that CMHH can generate highly concentrated hash codes and achieve state-of-the-art cross-modal retrieval performance for both hash lookups and linear scan scenarios on three benchmark datasets, NUS-WIDE, MIRFlickr-25K, and IAPR TC-12.
no code implementations • 28 Aug 2018 • Bin Liu, Yaochu Jin
To this end, we make an effort to extend the scope of application of the PFO paradigm to multi-objective optimization (MOO) cases.
no code implementations • 30 Jul 2018 • Bin Liu, Grigorios Tsoumakas
Class imbalance is an intrinsic characteristic of multi-label data.
no code implementations • 23 Jul 2018 • Bin Liu
There is a recent interest in developing statistical filtering methods for stochastic optimization (FSO) by leveraging a probabilistic perspective of incremental proximity methods (IPMs).
no code implementations • ECCV 2018 • Guojun Yin, Lu Sheng, Bin Liu, Nenghai Yu, Xiaogang Wang, Jing Shao, Chen Change Loy
We show that by encouraging deep message propagation and interactions between local object features and global predicate features, one can achieve compelling performance in recognizing complex relationships without using any linguistic priors.
no code implementations • CVPR 2018 • Yue Cao, Bin Liu, Mingsheng Long, Jian-Min Wang
The main idea is to augment the training data with nearly real images synthesized from a new Pair Conditional Wasserstein GAN (PC-WGAN) conditioned on the pairwise similarity information.
no code implementations • CVPR 2018 • Yue Cao, Mingsheng Long, Bin Liu, Jian-Min Wang
Due to its computation efficiency and retrieval quality, hashing has been widely applied to approximate nearest neighbor search for large-scale image retrieval, while deep hashing further improves the retrieval quality by end-to-end representation learning and hash coding.
no code implementations • 2 May 2018 • Bin Liu, Shuai Nie, Yaping Zhang, Dengfeng Ke, Shan Liang, Wenju Liu1
In realistic environments, speech is usually interfered by various noise and reverberation, which dramatically degrades the performance of automatic speech recognition (ASR) systems.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +2
no code implementations • 20 Feb 2018 • Jiangyan Yi, Jian-Hua Tao, Zhengqi Wen, Bin Liu
The close-talking model is called the teacher model.
no code implementations • 19 Feb 2018 • Bin Liu, Ying Li, Soumya Ghosh, Zhaonan Sun, Kenney Ng, Jianying Hu
The proposed method is favorable for healthcare applications because in additional to improved prediction performance, relationships among the different risks and risk factors are also identified.
no code implementations • 16 Nov 2017 • Dan Ma, Bin Liu, Zhao Kang, Jiayu Zhou, Jianke Zhu, Zenglin Xu
Generating high fidelity identity-preserving faces with different facial attributes has a wide range of applications.
no code implementations • ICCV 2017 • Qi Chu, Wanli Ouyang, Hongsheng Li, Xiaogang Wang, Bin Liu, Nenghai Yu
The visibility map of the target is learned and used for inferring the spatial attention map.
no code implementations • 18 Apr 2017 • Bin Liu, Ke-Jia Chen
A population based searching method, called estimation of distribution algorithm (EDA), is adopted to explore the model parameter space starting from a batch of random locations.
no code implementations • 3 Nov 2016 • Bin Liu, Zenglin Xu, Yingming Li
Another assumption of these methods is that a predefined rank should be known.
no code implementations • 12 Aug 2016 • Bin Liu, Shi Cheng, Yuhui Shi
Observing that the Student's t distribution has heavier and longer tails than the Gaussian, which may be beneficial for exploring the solution space, we propose a novel EDA algorithm termed ESTDA, in which the Student's t distribution, rather than Gaussian, is employed.
no code implementations • 14 Jul 2016 • Bin Liu, Hao Ji, Yi Dai
The proposed method consists of three elemental operators, that are dynamic texture model based motion segmentation, feature extraction and Gaussian process (GP) regression.
5 code implementations • 16 May 2016 • Fengfu Li, Bin Liu, Xiaoxing Wang, Bo Zhang, Junchi Yan
We present a memory and computation efficient ternary weight networks (TWNs) - with weights constrained to +1, 0 and -1.
no code implementations • 2 Apr 2016 • Yi Dai, Bin Liu
In this article, we are concerned with tracking an object of interest in video stream.
no code implementations • 28 Sep 2015 • Yi Dai, Bin Liu
In this solution, the bootstrap particle filter (PF) is initialized by an object detector, which models the time-evolving background of the video signal by an adaptive Gaussian mixture.