Search Results for author: Jianru Xue

Found 30 papers, 12 papers with code

Abductive Ego-View Accident Video Understanding for Safe Driving Perception

no code implementations1 Mar 2024 Jianwu Fang, Lei-Lei Li, Junfei Zhou, Junbin Xiao, Hongkai Yu, Chen Lv, Jianru Xue, Tat-Seng Chua

This model involves a contrastive interaction loss to learn the pair co-occurrence of normal, near-accident, accident frames with the corresponding text descriptions, such as accident reasons, prevention advice, and accident categories.

Object object-detection +3

Vehicle Behavior Prediction by Episodic-Memory Implanted NDT

1 code implementation13 Feb 2024 Peining Shen, Jianwu Fang, Hongkai Yu, Jianru Xue

In this work, we explore the interpretability of behavior prediction of target vehicles by an Episodic Memory implanted Neural Decision Tree (abbrev.

Autonomous Driving

Vision-Based Traffic Accident Detection and Anticipation: A Survey

no code implementations30 Aug 2023 Jianwu Fang, iahuan Qiao, Jianru Xue, Zhengguo Li

We present the first survey on Vision-TAD in the deep learning era and the first-ever survey for Vision-TAA.

Traffic Accident Detection

Gated Driver Attention Predictor

1 code implementation1 Aug 2023 Tianci Zhao, Xue Bai, Jianwu Fang, Jianru Xue

In this work, we explore the network connection gating mechanism for driver attention prediction (Gate-DAP).

Driver Attention Monitoring Scene Understanding

Enhancing Mapless Trajectory Prediction through Knowledge Distillation

no code implementations25 Jun 2023 Yuning Wang, Pu Zhang, Lei Bai, Jianru Xue

Scene information plays a crucial role in trajectory forecasting systems for autonomous driving by providing semantic clues and constraints on potential future paths of traffic agents.

Autonomous Driving Knowledge Distillation +1

Learning Residual Model of Model Predictive Control via Random Forests for Autonomous Driving

no code implementations10 Apr 2023 Kang Zhao, Jianru Xue, Xiangning Meng, Gengxin Li, Mengsen Wu

One major issue in learning-based model predictive control (MPC) for autonomous driving is the contradiction between the system model's prediction accuracy and computation efficiency.

Autonomous Driving Model Predictive Control +1

UAV Obstacle Avoidance by Human-in-the-Loop Reinforcement in Arbitrary 3D Environment

1 code implementation7 Apr 2023 Xuyang Li, Jianwu Fang, Kai Du, Kuizhi Mei, Jianru Xue

This paper focuses on the continuous control of the unmanned aerial vehicle (UAV) based on a deep reinforcement learning method for a large-scale 3D complex environment.

Continuous Control reinforcement-learning

Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark

1 code implementation19 Dec 2022 Jianwu Fang, Lei-Lei Li, Kuan Yang, Zhedong Zheng, Jianru Xue, Tat-Seng Chua

In particular, the text description provides a dense semantic description guidance for the primary context of the traffic scene, while the driver attention provides a traction to focus on the critical region closely correlating with safe driving.

Decision Making

Deep Virtual-to-Real Distillation for Pedestrian Crossing Prediction

no code implementations2 Nov 2022 Jie Bai, Xin Fang, Jianwu Fang, Jianru Xue, Changwei Yuan

To this end, we formulate a deep virtual to real distillation framework by introducing the synthetic data that can be generated conveniently, and borrow the abundant information of pedestrian movement in synthetic videos for the pedestrian crossing prediction in real data with a simple and lightweight implementation.

Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learning

1 code implementation2 Nov 2022 Jianwu Fang, Chen Zhu, Pu Zhang, Hongkai Yu, Jianru Xue

Heterogeneous trajectory forecasting is critical for intelligent transportation systems, but it is challenging because of the difficulty of modeling the complex interaction relations among the heterogeneous road agents as well as their agent-environment constraints.

Graph Learning Trajectory Forecasting

Behavioral Intention Prediction in Driving Scenes: A Survey

no code implementations1 Nov 2022 Jianwu Fang, Fan Wang, Jianru Xue, Tat-Seng Chua

Behavioral Intention Prediction (BIP) simulates such a human consideration process and fulfills the early prediction of specific behaviors.

Trajectory Prediction

Using Detection, Tracking and Prediction in Visual SLAM to Achieve Real-time Semantic Mapping of Dynamic Scenarios

no code implementations10 Oct 2022 Xingyu Chen, Jianru Xue, Jianwu Fang, Yuxin Pan, Nanning Zheng

In this paper, we propose a lightweight system, RDS-SLAM, based on ORB-SLAM2, which can accurately estimate poses and build semantic maps at object level for dynamic scenarios in real time using only one commonly used Intel Core i7 CPU.

Object object-detection +1

Sparse Semantic Map-Based Monocular Localization in Traffic Scenes Using Learned 2D-3D Point-Line Correspondences

no code implementations10 Oct 2022 Xingyu Chen, Jianru Xue, Shanmin Pang

The proposed sparse semantic map-based localization approach is robust against occlusion and long-term appearance changes in the environments.

Autonomous Vehicles

Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding

no code implementations3 Feb 2022 Pu Zhang, Lei Bai, Jianru Xue, Jianwu Fang, Nanning Zheng, Wanli Ouyang

Trajectories obtained from object detection and tracking are inevitably noisy, which could cause serious forecasting errors to predictors built on ground truth trajectories.

object-detection Object Detection +1

DCDLearn: Multi-order Deep Cross-distance Learning for Vehicle Re-Identification

no code implementations25 Mar 2020 Rixing Zhu, Jianwu Fang, Hongke Xu, Hongkai Yu, Jianru Xue

Vehicle re-identification (Re-ID) has become a popular research topic owing to its practicability in intelligent transportation systems.

Vehicle Re-Identification

DADA: Driver Attention Prediction in Driving Accident Scenarios

1 code implementation18 Dec 2019 Jianwu Fang, Dingxin Yan, Jiahuan Qiao, Jianru Xue, Hongkai Yu

1) With the semantic images, we introduce their semantic context features and verified the manifest promotion effect for helping the driver attention prediction, where the semantic context features are modeled by a graph convolution network (GCN) on semantic images; 2) We fuse the semantic context features of semantic images and the features of RGB frames in an attentive strategy, and the fused details are transferred over frames by a convolutional LSTM module to obtain the attention map of each video frame with the consideration of historical scene variation in driving situations; 3) The superiority of the proposed method is evaluated on our previously collected dataset (named as DADA-2000) and two other challenging datasets with state-of-the-art methods.

Driver Attention Monitoring Scene Understanding

EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networks

no code implementations3 Sep 2019 Pengfei Zhang, Jianru Xue, Cuiling Lan, Wen-Jun Zeng, Zhanning Gao, Nanning Zheng

For an RNN block, an EleAttG is used for adaptively modulating the input by assigning different levels of importance, i. e., attention, to each element/dimension of the input.

Action Recognition Gesture Recognition +1

DADA-2000: Can Driving Accident be Predicted by Driver Attention? Analyzed by A Benchmark

no code implementations23 Apr 2019 Jianwu Fang, Dingxin Yan, Jiahuan Qiao, Jianru Xue, He Wang, Sen Li

Driver attention prediction is currently becoming the focus in safe driving research community, such as the DR(eye)VE project and newly emerged Berkeley DeepDrive Attention (BDD-A) database in critical situations.

Driver Attention Monitoring

BLVD: Building A Large-scale 5D Semantics Benchmark for Autonomous Driving

1 code implementation15 Mar 2019 Jianru Xue, Jianwu Fang, Tao Li, Bohua Zhang, Pu Zhang, Zhen Ye, Jian Dou

Instead, BLVD aims to provide a platform for the tasks of dynamic 4D (3D+temporal) tracking, 5D (4D+interactive) interactive event recognition and intention prediction.

Autonomous Driving Instance Segmentation +5

SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Prediction

1 code implementation CVPR 2019 Pu Zhang, Wanli Ouyang, Pengfei Zhang, Jianru Xue, Nanning Zheng

In order to address this issue, we propose a data-driven state refinement module for LSTM network (SR-LSTM), which activates the utilization of the current intention of neighbors, and jointly and iteratively refines the current states of all participants in the crowd through a message passing mechanism.

Pedestrian Trajectory Prediction Trajectory Prediction

Adding Attentiveness to the Neurons in Recurrent Neural Networks

no code implementations ECCV 2018 Pengfei Zhang, Jianru Xue, Cuiling Lan, Wen-Jun Zeng, Zhanning Gao, Nanning Zheng

We propose adding a simple yet effective Element-wiseAttention Gate (EleAttG) to an RNN block (e. g., all RNN neurons in a network layer) that empowers the RNN neurons to have the attentiveness capability.

Action Recognition Skeleton Based Action Recognition +1

Deep Feature Aggregation and Image Re-ranking with Heat Diffusion for Image Retrieval

1 code implementation22 May 2018 Shanmin Pang, Jin Ma, Jianru Xue, Jihua Zhu, Vicente Ordonez

We show that by considering each deep feature as a heat source, our unsupervised aggregation method is able to avoid over-representation of \emph{bursty} features.

Image Retrieval Re-Ranking +1

View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognition

2 code implementations20 Apr 2018 Pengfei Zhang, Cuiling Lan, Junliang Xing, Wen-Jun Zeng, Jianru Xue, Nanning Zheng

In order to alleviate the effects of view variations, this paper introduces a novel view adaptation scheme, which automatically determines the virtual observation viewpoints in a learning based data driven manner.

Action Recognition Skeleton Based Action Recognition +1

View Adaptive Recurrent Neural Networks for High Performance Human Action Recognition from Skeleton Data

1 code implementation ICCV 2017 Pengfei Zhang, Cuiling Lan, Junliang Xing, Wen-Jun Zeng, Jianru Xue, Nanning Zheng

Rather than re-positioning the skeletons based on a human defined prior criterion, we design a view adaptive recurrent neural network (RNN) with LSTM architecture, which enables the network itself to adapt to the most suitable observation viewpoints from end to end.

Action Recognition Skeleton Based Action Recognition +1

Counting Grid Aggregation for Event Retrieval and Recognition

no code implementations5 Apr 2016 Zhanning Gao, Gang Hua, Dongqing Zhang, Jianru Xue, Nanning Zheng

Event retrieval and recognition in a large corpus of videos necessitates a holistic fixed-size visual representation at the video clip level that is comprehensive, compact, and yet discriminative.

Retrieval

Illumination Robust Color Naming via Label Propagation

no code implementations ICCV 2015 Yuanliu liu, Zejian yuan, Badong Chen, Jianru Xue, Nanning Zheng

In this paper we address the problem of inferring the color composition of the intrinsic reflectance of objects, where the shadows and highlights may change the observed color dramatically.

Image Retrieval Retrieval

Cannot find the paper you are looking for? You can Submit a new open access paper.