Search Results for author: Siyuan Zhang

Found 9 papers, 4 papers with code

Exploring the Transferability of Visual Prompting for Multimodal Large Language Models

1 code implementation17 Apr 2024 Yichi Zhang, Yinpeng Dong, Siyuan Zhang, Tianzan Min, Hang Su, Jun Zhu

To achieve this, we propose Transferable Visual Prompting (TVP), a simple and effective approach to generate visual prompts that can transfer to different models and improve their performance on downstream tasks after trained on only one model.

Hallucination Multimodal Reasoning +2

Decentralized Stochastic Subgradient Methods for Nonsmooth Nonconvex Optimization

no code implementations18 Mar 2024 Siyuan Zhang, Nachuan Xiao, Xin Liu

Furthermore, we establish that our proposed framework encompasses a wide range of existing efficient decentralized subgradient methods, including decentralized stochastic subgradient descent (DSGD), DSGD with gradient-tracking technique (DSGD-T), and DSGD with momentum (DSGDm).

Direct Motif Extraction from High Resolution Crystalline STEM Images

no code implementations13 Mar 2023 Amel Shamseldeen Ali Alhasan, Siyuan Zhang, Benjamin Berkels

The results are a representation of the motif in form of an image, atomic positions, primitive unit cell vectors, and a denoised and a modeled reconstruction of the input image.

Vocal Bursts Intensity Prediction

NEPHELE: A Neural Platform for Highly Realistic Cloud Radiance Rendering

no code implementations7 Mar 2023 Haimin Luo, Siyuan Zhang, Fuqiang Zhao, Haotian Jing, Penghao Wang, Zhenxiao Yu, Dongxue Yan, Junran Ding, Boyuan Zhang, Qiang Hu, Shu Yin, Lan Xu, Jingyi Yu

Using such a cloud platform compatible with neural rendering, we further showcase the capabilities of our cloud radiance rendering through a series of applications, ranging from cloud VR/AR rendering.

Neural Rendering

Probability-Dependent Gradient Decay in Large Margin Softmax

no code implementations31 Oct 2022 Siyuan Zhang, Linbo Xie, Ying Chen

Based on the analysis results, we can provide evidence that the large margin Softmax will affect the local Lipschitz constraint of the loss function by regulating the probability-dependent gradient decay rate.

Towards Hyperparameter-free Policy Selection for Offline Reinforcement Learning

1 code implementation NeurIPS 2021 Siyuan Zhang, Nan Jiang

How to select between policies and value functions produced by different training algorithms in offline reinforcement learning (RL) -- which is crucial for hyperpa-rameter tuning -- is an important open question.

Off-policy evaluation Open-Ended Question Answering +1

Microphone Array Generalization for Multichannel Narrowband Deep Speech Enhancement

1 code implementation27 Jul 2021 Siyuan Zhang, Xiaofei Li

This paper addresses the problem of microphone array generalization for deep-learning-based end-to-end multichannel speech enhancement.

Speech Enhancement

Cannot find the paper you are looking for? You can Submit a new open access paper.