Search Results for author: Shan Yu

Found 18 papers, 4 papers with code

Nonparametric Automatic Differentiation Variational Inference with Spline Approximation

no code implementations10 Mar 2024 Yuda Shao, Shan Yu, Tianshu Feng

Compared with widely-used nonparametric variational inference methods, the proposed method is easy to implement and adaptive to various data structures.

Variational Inference

AnyOKP: One-Shot and Instance-Aware Object Keypoint Extraction with Pretrained ViT

no code implementations15 Sep 2023 Fangbo Qin, Taogang Hou, Shan Lin, Kaiyuan Wang, Michael C. Yip, Shan Yu

Towards flexible object-centric visual perception, we propose a one-shot instance-aware object keypoint (OKP) extraction approach, AnyOKP, which leverages the powerful representation ability of pretrained vision transformer (ViT), and can obtain keypoints on multiple object instances of arbitrary category after learning from a support image.

Object

Out-of-distribution forgetting: vulnerability of continual learning to intra-class distribution shift

no code implementations1 Jun 2023 Liangxuan Guo, Yang Chen, Shan Yu

In this work, we reported a special form of catastrophic forgetting raised by the OOD problem in continual learning settings, and we named it out-of-distribution forgetting (OODF).

Continual Learning Image Classification

Emergence of Symbols in Neural Networks for Semantic Understanding and Communication

no code implementations13 Apr 2023 Yang Chen, Liangxuan Guo, Shan Yu

The capacity to generate meaningful symbols and effectively employ them for advanced cognitive processes, such as communication, reasoning, and planning, constitutes a fundamental and distinctive aspect of human intelligence.

Adaptive Data Augmentation for Contrastive Learning

no code implementations5 Apr 2023 Yuhan Zhang, He Zhu, Shan Yu

In computer vision, contrastive learning is the most advanced unsupervised learning framework.

Contrastive Learning Data Augmentation

TQ-Net: Mixed Contrastive Representation Learning For Heterogeneous Test Questions

no code implementations9 Mar 2023 He Zhu, Xihua Li, Xuemin Zhao, Yunbo Cao, Shan Yu

Finally, supervised contrastive learning was conducted on relevance prediction-related downstream tasks, which helped the model to learn the representation of questions effectively.

Contrastive Learning Representation Learning

AI of Brain and Cognitive Sciences: From the Perspective of First Principles

no code implementations20 Jan 2023 Luyao Chen, Zhiqiang Chen, Longsheng Jiang, Xiang Liu, Linlu Xu, Bo Zhang, Xiaolong Zou, Jinying Gao, Yu Zhu, Xizi Gong, Shan Yu, Sen Song, Liangyi Chen, Fang Fang, Si Wu, Jia Liu

Nowadays, we have witnessed the great success of AI in various applications, including image classification, game playing, protein structure analysis, language translation, and content generation.

Few-Shot Learning Image Classification

Effective Decision Boundary Learning for Class Incremental Learning

no code implementations12 Jan 2023 Chaoyue Ding, Kunchi Li, Jun Wan, Shan Yu

Rehearsal approaches in class incremental learning (CIL) suffer from decision boundary overfitting to new classes, which is mainly caused by two factors: insufficiency of old classes data for knowledge distillation and imbalanced data learning between the learned and new classes because of the limited storage memory.

Class Incremental Learning Incremental Learning +1

BigDL 2.0: Seamless Scaling of AI Pipelines from Laptops to Distributed Cluster

1 code implementation CVPR 2022 Jason Dai, Ding Ding, Dongjie Shi, Shengsheng Huang, Jiao Wang, Xin Qiu, Kai Huang, Guoqiong Song, Yang Wang, Qiyuan Gong, Jiaming Song, Shan Yu, Le Zheng, Yina Chen, Junwei Deng, Ge Song

To address this challenge, we have open sourced BigDL 2. 0 at https://github. com/intel-analytics/BigDL/ under Apache 2. 0 license (combining the original BigDL and Analytics Zoo projects); using BigDL 2. 0, users can simply build conventional Python notebooks on their laptops (with possible AutoML support), which can then be transparently accelerated on a single node (with up-to 9. 6x speedup in our experiments), and seamlessly scaled out to a large cluster (across several hundreds servers in real-world use cases).

AutoML Distributed Computing +1

Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking

2 code implementations CVPR 2020 Jin Gao, Yan Lu, Xiaojuan Qi, Yutong Kou, Bing Li, Liang Li, Shan Yu, Weiming Hu

In this paper, we propose a simple yet effective recursive least-squares estimator-aided online learning approach for few-shot online adaptation without requiring offline training.

Continual Learning One-Shot Learning +1

Intra-Class Uncertainty Loss Function for Classification

no code implementations12 Apr 2021 He Zhu, Shan Yu

To address this issue, we propose a loss function with intra-class uncertainty following Gaussian distribution.

Classification General Classification

Progressive Relation Learning for Group Activity Recognition

no code implementations CVPR 2020 Guyue Hu, Bo Cui, Yuan He, Shan Yu

Another relation-gating (RG) agent in continuous action space adjusts the high-level semantic graph to pay more attention to group-relevant relations.

Group Activity Recognition Relation

Continual Learning of Context-dependent Processing in Neural Networks

1 code implementation29 Sep 2018 Guanxiong Zeng, Yang Chen, Bo Cui, Shan Yu

Deep neural networks (DNNs) are powerful tools in learning sophisticated but fixed mapping rules between inputs and outputs, thereby limiting their application in more complex and dynamic situations in which the mapping rules are not kept the same but changing according to different contexts.

Continual Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.