Search Results for author: Tianyuan Zhang

Found 15 papers, 8 papers with code

PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation

no code implementations19 Apr 2024 Tianyuan Zhang, Hong-Xing Yu, Rundi Wu, Brandon Y. Feng, Changxi Zheng, Noah Snavely, Jiajun Wu, William T. Freeman

Unlike unconditional or text-conditioned dynamics generation, action-conditioned dynamics requires perceiving the physical material properties of objects and grounding the 3D motion prediction on these properties, such as object stiffness.

motion prediction Object +1

Exploring the Physical World Adversarial Robustness of Vehicle Detection

no code implementations7 Aug 2023 Wei Jiang, Tianyuan Zhang, Shuangcheng Liu, Weiyu Ji, Zichao Zhang, Gang Xiao

Through this pipeline, we establish the Discrete and Continuous Instant-level (DCI) dataset, enabling comprehensive experiments involving three detection models and three physical adversarial attacks.

Adversarial Attack Adversarial Robustness

RobustMQ: Benchmarking Robustness of Quantized Models

no code implementations4 Aug 2023 Yisong Xiao, Aishan Liu, Tianyuan Zhang, Haotong Qin, Jinyang Guo, Xianglong Liu

Quantization has emerged as an essential technique for deploying deep neural networks (DNNs) on devices with limited resources.

Adversarial Robustness Benchmarking +1

Benchmarking the Robustness of Quantized Models

no code implementations8 Apr 2023 Yisong Xiao, Tianyuan Zhang, Shunchang Liu, Haotong Qin

To address this gap, we thoroughly evaluated the robustness of quantized models against various noises (adversarial attacks, natural corruptions, and systematic noises) on ImageNet.

Benchmarking Quantization

Analyzing Physical Impacts Using Transient Surface Wave Imaging

no code implementations CVPR 2023 Tianyuan Zhang, Mark Sheinin, Dorian Chan, Mark Rau, Matthew O’Toole, Srinivasa G. Narasimhan

The subtle vibrations on an object's surface contain information about the object's physical properties and its interaction with the environment.

Object

ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queries

1 code implementation CVPR 2023 Junru Gu, Chenxu Hu, Tianyuan Zhang, Xuanyao Chen, Yilun Wang, Yue Wang, Hang Zhao

In this work, we propose ViP3D, a query-based visual trajectory prediction pipeline that exploits rich information from raw videos to directly predict future trajectories of agents in a scene.

Autonomous Driving Trajectory Prediction

MUTR3D: A Multi-camera Tracking Framework via 3D-to-2D Queries

1 code implementation2 May 2022 Tianyuan Zhang, Xuanyao Chen, Yue Wang, Yilun Wang, Hang Zhao

In contrast to prior works, MUTR3D does not explicitly rely on the spatial and appearance similarity of objects.

Autonomous Driving Depth Estimation

FUTR3D: A Unified Sensor Fusion Framework for 3D Detection

1 code implementation20 Mar 2022 Xuanyao Chen, Tianyuan Zhang, Yue Wang, Yilun Wang, Hang Zhao

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics.

Autonomous Driving Sensor Fusion

Embracing Single Stride 3D Object Detector with Sparse Transformer

2 code implementations CVPR 2022 Lue Fan, Ziqi Pang, Tianyuan Zhang, Yu-Xiong Wang, Hang Zhao, Feng Wang, Naiyan Wang, Zhaoxiang Zhang

In LiDAR-based 3D object detection for autonomous driving, the ratio of the object size to input scene size is significantly smaller compared to 2D detection cases.

3D Object Detection Autonomous Driving +3

DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries

1 code implementation13 Oct 2021 Yue Wang, Vitor Guizilini, Tianyuan Zhang, Yilun Wang, Hang Zhao, Justin Solomon

This top-down approach outperforms its bottom-up counterpart in which object bounding box prediction follows per-pixel depth estimation, since it does not suffer from the compounding error introduced by a depth prediction model.

3D Object Detection Autonomous Driving +5

Domain-Aware Dynamic Networks

no code implementations26 Nov 2019 Tianyuan Zhang, Bichen Wu, Xin Wang, Joseph Gonzalez, Kurt Keutzer

In this work, we propose a method to improve the model capacity without increasing inference-time complexity.

object-detection Object Detection

Interpreting Adversarially Trained Convolutional Neural Networks

1 code implementation23 May 2019 Tianyuan Zhang, Zhanxing Zhu

Our findings shed some light on why AT-CNNs are more robust than those normally trained ones and contribute to a better understanding of adversarial training over CNNs from an interpretation perspective.

Object Recognition

You Only Propagate Once: Accelerating Adversarial Training via Maximal Principle

2 code implementations NeurIPS 2019 Dinghuai Zhang, Tianyuan Zhang, Yiping Lu, Zhanxing Zhu, Bin Dong

Adversarial training, typically formulated as a robust optimization problem, is an effective way of improving the robustness of deep networks.

Adversarial Defense

Cannot find the paper you are looking for? You can Submit a new open access paper.