Search Results for author: Jiali Duan

Found 12 papers, 2 papers with code

Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment

no code implementations4 Aug 2022 Yilei Zeng, Jiali Duan, Yang Li, Emilio Ferrara, Lerrel Pinto, C. -C. Jay Kuo, Stefanos Nikolaidis

In this work, we guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process.

reinforcement-learning Reinforcement Learning (RL)

Augmenting Vision Language Pretraining by Learning Codebook with Visual Semantics

no code implementations31 Jul 2022 Xiaoyuan Guo, Jiali Duan, C. -C. Jay Kuo, Judy Wawira Gichoya, Imon Banerjee

Language modality within the vision language pretraining framework is innately discretized, endowing each word in the language vocabulary a semantic meaning.

Language Modelling Masked Language Modeling

Convergence and sample complexity of natural policy gradient primal-dual methods for constrained MDPs

no code implementations6 Jun 2022 Dongsheng Ding, Kaiqing Zhang, Jiali Duan, Tamer Başar, Mihailo R. Jovanović

We study sequential decision making problems aimed at maximizing the expected total reward while satisfying a constraint on the expected total utility.

Decision Making

Multi-modal Alignment using Representation Codebook

no code implementations CVPR 2022 Jiali Duan, Liqun Chen, Son Tran, Jinyu Yang, Yi Xu, Belinda Zeng, Trishul Chilimbi

Aligning signals from different modalities is an important step in vision-language representation learning as it affects the performance of later stages such as cross-modality fusion.

Representation Learning Retrieval

Bridging Gap between Image Pixels and Semantics via Supervision: A Survey

no code implementations29 Jul 2021 Jiali Duan, C. -C. Jay Kuo

The fact that there exists a gap between low-level features and semantic meanings of images, called the semantic gap, is known for decades.

Content-Based Image Retrieval Metric Learning +3

Interpretable Convolutional Neural Networks via Feedforward Design

2 code implementations5 Oct 2018 C. -C. Jay Kuo, Min Zhang, Siyang Li, Jiali Duan, Yueru Chen

To construct convolutional layers, we develop a new signal transform, called the Saab (Subspace Approximation with Adjusted Bias) transform.

PortraitGAN for Flexible Portrait Manipulation

no code implementations5 Jul 2018 Jiali Duan, Xiaoyuan Guo, Yuhang Song, Chao Yang, C. -C. Jay Kuo

Previous methods have dealt with discrete manipulation of facial attributes such as smile, sad, angry, surprise etc, out of canonical expressions and they are not scalable, operating in single modality.

Multi-Modality Fusion based on Consensus-Voting and 3D Convolution for Isolated Gesture Recognition

no code implementations21 Nov 2016 Jiali Duan, Shuai Zhou, Jun Wan, Xiaoyuan Guo, Stan Z. Li

Recently, the popularity of depth-sensors such as Kinect has made depth videos easily available while its advantages have not been fully exploited.

Gesture Recognition

Cannot find the paper you are looking for? You can Submit a new open access paper.