Search Results for author: Yu Zheng

Found 102 papers, 52 papers with code

NSP-BERT: A Prompt-based Few-Shot Learner through an Original Pre-training Task —— Next Sentence Prediction

1 code implementation COLING 2022 Yi Sun, Yu Zheng, Chao Hao, Hangping Qiu

Using prompts to utilize language models to perform various downstream tasks, also known as prompt-based learning or prompt-learning, has lately gained significant success in comparison to the pre-train and fine-tune paradigm.

Entity Linking Language Modelling +2

Rotation-robust Intersection over Union for 3D Object Detection

no code implementations ECCV 2020 Yu Zheng, Danyang Zhang, Sinan Xie, Jiwen Lu, Jie zhou

In this paper, we propose a Rotation-robust Intersection over Union ($ extit{RIoU}$) for 3D object detection, which aims to jointly learn the overlap of rotated bounding boxes.

3D Object Detection Object +1

skscope: Fast Sparsity-Constrained Optimization in Python

1 code implementation27 Mar 2024 Zezhi Wang, Jin Zhu, Peng Chen, Huiyang Peng, Xiaoke Zhang, Anran Wang, Yu Zheng, Junxian Zhu, Xueqin Wang

Applying iterative solvers on sparsity-constrained optimization (SCO) requires tedious mathematical deduction and careful programming/debugging that hinders these solvers' broad impact.

Semi-Supervised Learning for Anomaly Traffic Detection via Bidirectional Normalizing Flows

1 code implementation13 Mar 2024 Zhangxuan Dang, Yu Zheng, Xinglin Lin, Chunlei Peng, Qiuyu Chen, Xinbo Gao

We consider the problem of anomaly network traffic detection and propose a three-stage anomaly detection framework using only normal traffic.

Anomaly Detection Benchmarking

SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression

1 code implementation12 Mar 2024 Xin Wang, Yu Zheng, Zhongwei Wan, Mi Zhang

However, state-of-the-art SVD-based LLM compression methods have two key limitations: truncating smaller singular values may lead to higher compression loss, and the lack of update on the remaining model parameters after SVD truncation.

Language Modelling Large Language Model +1

Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategy

1 code implementation11 Mar 2024 Jiuming Liu, Ruiji Yu, Yian Wang, Yu Zheng, Tianchen Deng, Weicai Ye, Hesheng Wang

In this paper, we propose a novel SSM-based point cloud processing backbone, named Point Mamba, with a causality-aware ordering mechanism.

Semantic Segmentation

DynST: Dynamic Sparse Training for Resource-Constrained Spatio-Temporal Forecasting

no code implementations5 Mar 2024 Hao Wu, Haomin Wen, Guibin Zhang, Yutong Xia, Kai Wang, Yuxuan Liang, Yu Zheng, Kun Wang

In this paper, we introduce for the first time the concept of spatio-temporal data dynamic sparse training and are committed to adaptively, dynamically filtering important sensor distributions.

Spatio-Temporal Forecasting

Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook

1 code implementation29 Feb 2024 Xingchen Zou, Yibo Yan, Xixuan Hao, Yuehong Hu, Haomin Wen, Erdong Liu, Junbo Zhang, Yong Li, Tianrui Li, Yu Zheng, Yuxuan Liang

As cities continue to burgeon, Urban Computing emerges as a pivotal discipline for sustainable development by harnessing the power of cross-domain data fusion from diverse sources (e. g., geographical, traffic, social media, and environmental data) and modalities (e. g., spatio-temporal, visual, and textual modalities).

More Than Routing: Joint GPS and Route Modeling for Refine Trajectory Representation Learning

no code implementations25 Feb 2024 Zhipeng Ma, Zheyan Tu, Xinhai Chen, Yan Zhang, Deguo Xia, Guyue Zhou, Yilun Chen, Yu Zheng, Jiangtao Gong

The experimental results demonstrate that JGRM outperforms existing methods in both road segment representation and trajectory representation tasks.

Representation Learning

Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values

no code implementations11 Jan 2024 Yu Zheng, Huan Yee Koh, Ming Jin, Lianhua Chi, Haishuai Wang, Khoa T. Phan, Yi-Ping Phoebe Chen, Shirui Pan, Wei Xiang

However, real-world time series data is usually not well-structured, posting significant challenges to existing approaches: (1) The existence of missing values in multivariate time series data along variable and time dimensions hinders the effective modeling of interwoven spatial and temporal dependencies, resulting in important patterns being overlooked during model training; (2) Anomaly scoring with irregularly-sampled observations is less explored, making it difficult to use existing detectors for multivariate series without fully-observed values.

Anomaly Detection Time Series +1

FlexSSL : A Generic and Efficient Framework for Semi-Supervised Learning

no code implementations28 Dec 2023 Huiling Qin, Xianyuan Zhan, Yuanxun li, Yu Zheng

Jointly solving these two tasks allows full utilization of information from both labeled and unlabeled data, thus alleviating the problem of over-reliance on labeled data.

Efficient Large Language Models: A Survey

3 code implementations6 Dec 2023 Zhongwei Wan, Xin Wang, Che Liu, Samiul Alam, Yu Zheng, Jiachen Liu, Zhongnan Qu, Shen Yan, Yi Zhu, Quanlu Zhang, Mosharaf Chowdhury, Mi Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities in important tasks such as natural language understanding, language generation, and complex reasoning and have the potential to make a substantial impact on our society.

Natural Language Understanding Text Generation

Spherical Frustum Sparse Convolution Network for LiDAR Point Cloud Semantic Segmentation

no code implementations29 Nov 2023 Yu Zheng, Guangming Wang, Jiuming Liu, Marc Pollefeys, Hesheng Wang

Through the hash-based representation, we propose the Spherical Frustum sparse Convolution (SFC) and Frustum Fast Point Sampling (F2PS) to convolve and sample the points stored in spherical frustums respectively.

Position Segmentation +1

Inverse Learning with Extremely Sparse Feedback for Recommendation

1 code implementation14 Nov 2023 GuanYu Lin, Chen Gao, Yu Zheng, Yinfeng Li, Jianxin Chang, Yanan Niu, Yang song, Kun Gai, Zhiheng Li, Depeng Jin, Yong Li

In this paper, we propose a meta-learning method to annotate the unlabeled data from loss and gradient perspectives, which considers the noises in both positive and negative instances.

Meta-Learning

Mixed Attention Network for Cross-domain Sequential Recommendation

1 code implementation14 Nov 2023 GuanYu Lin, Chen Gao, Yu Zheng, Jianxin Chang, Yanan Niu, Yang song, Kun Gai, Zhiheng Li, Depeng Jin, Yong Li, Meng Wang

Recent proposed cross-domain sequential recommendation models such as PiNet and DASL have a common drawback relying heavily on overlapped users in different domains, which limits their usage in practical recommender systems.

Sequential Recommendation

Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook

5 code implementations16 Oct 2023 Ming Jin, Qingsong Wen, Yuxuan Liang, Chaoli Zhang, Siqiao Xue, Xue Wang, James Zhang, Yi Wang, Haifeng Chen, XiaoLi Li, Shirui Pan, Vincent S. Tseng, Yu Zheng, Lei Chen, Hui Xiong

In this survey, we offer a comprehensive and up-to-date review of large models tailored (or adapted) for time series and spatio-temporal data, spanning four key facets: data types, model categories, model scopes, and application areas/tasks.

Time Series Time Series Analysis

Spatio-Temporal Contrastive Self-Supervised Learning for POI-level Crowd Flow Inference

no code implementations6 Sep 2023 Songyu Ke, Ting Li, Li Song, Yanping Sun, Qintian Sun, Junbo Zhang, Yu Zheng

To address these challenges, we recast the crowd flow inference problem as a self-supervised attributed graph representation learning task and introduce a novel Contrastive Self-learning framework for Spatio-Temporal data (CSST).

Contrastive Learning Graph Representation Learning +2

UNISOUND System for VoxCeleb Speaker Recognition Challenge 2023

no code implementations24 Aug 2023 Yu Zheng, Yajun Zhang, Chuanying Niu, Yibin Zhan, Yanhua Long, Dongxing Xu

Our final system is a fusion of six models and achieves the first place in Track 1 and second place in Track 2 of VoxSRC 2023.

Speaker Recognition

Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection

1 code implementation17 Jul 2023 Yu Zheng, Huan Yee Koh, Ming Jin, Lianhua Chi, Khoa T. Phan, Shirui Pan, Yi-Ping Phoebe Chen, Wei Xiang

To overcome these limitations, we propose a novel method, correlation-aware spatial-temporal graph learning (termed CST-GL), for time series anomaly detection.

Anomaly Detection Graph Learning +2

End-to-end 2D-3D Registration between Image and LiDAR Point Cloud for Vehicle Localization

no code implementations20 Jun 2023 Guangming Wang, Yu Zheng, Yanfeng Guo, Zhe Liu, Yixiang Zhu, Wolfram Burgard, Hesheng Wang

A popular approach to robot localization is based on image-to-point cloud registration, which combines illumination-invariant LiDAR-based mapping with economical image-based localization.

Image-Based Localization Image to Point Cloud Registration

Graph Neural Processes for Spatio-Temporal Extrapolation

1 code implementation30 May 2023 Junfeng Hu, Yuxuan Liang, Zhencheng Fan, Hongyang Chen, Yu Zheng, Roger Zimmermann

We study the task of spatio-temporal extrapolation that generates data at target locations from surrounding contexts in a graph.

Gaussian Processes

Road Planning for Slums via Deep Reinforcement Learning

1 code implementation22 May 2023 Yu Zheng, Hongyuan Su, Jingtao Ding, Depeng Jin, Yong Li

Existing re-blocking or heuristic methods are either time-consuming which cannot generalize to different slums, or yield sub-optimal road plans in terms of accessibility and construction costs.

Blocking reinforcement-learning

Moving-horizon False Data Injection Attack Design against Cyber-Physical Systems

no code implementations23 Apr 2023 Yu Zheng, Sridhar Babu Mudhangulla, Olugbenga Moses Anubi

In fact, this paper shows that conventional FDIAs are generally ineffective against MHE.

Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Survey

no code implementations25 Mar 2023 Guangyin Jin, Yuxuan Liang, Yuchen Fang, Zezhi Shao, Jincai Huang, Junbo Zhang, Yu Zheng

STGNNs enable the extraction of complex spatio-temporal dependencies by integrating graph neural networks (GNNs) and various temporal learning methods.

Management

Curricular Contrastive Regularization for Physics-aware Single Image Dehazing

1 code implementation CVPR 2023 Yu Zheng, Jiahui Zhan, Shengfeng He, Junyu Dong, Yong Du

In this paper, we propose a novel curricular contrastive regularization targeted at a consensual contrastive space as opposed to a non-consensual one.

Image Dehazing Single Image Dehazing

Dual-interest Factorization-heads Attention for Sequential Recommendation

1 code implementation8 Feb 2023 GuanYu Lin, Chen Gao, Yu Zheng, Jianxin Chang, Yanan Niu, Yang song, Zhiheng Li, Depeng Jin, Yong Li

In this paper, we propose Dual-interest Factorization-heads Attention for Sequential Recommendation (short for DFAR) consisting of feedback-aware encoding layer, dual-interest disentangling layer and prediction layer.

Disentanglement Sequential Recommendation

Learning 6-DoF Fine-grained Grasp Detection Based on Part Affordance Grounding

no code implementations27 Jan 2023 Yaoxian Song, Penglei Sun, Yi Ren, Yu Zheng, Yue Zhang

To evaluate the effectiveness, we perform multi-level difficulty part language grounding grasping experiments and deploy our proposed model on a real robot.

Representation Learning Robotic Grasping

Spatio-Temporal Self-Supervised Learning for Traffic Flow Prediction

1 code implementation7 Dec 2022 Jiahao Ji, Jingyuan Wang, Chao Huang, Junjie Wu, Boren Xu, Zhenhe Wu, Junbo Zhang, Yu Zheng

ii) These models fail to capture the temporal heterogeneity induced by time-varying traffic patterns, as they typically model temporal correlations with a shared parameterized space for all time periods.

Attribute Robust Traffic Prediction +3

Cooperative Guidance Strategy for Active Defense Spacecraft with Imperfect Information via Deep Reinforcement Learning

no code implementations6 Dec 2022 Li Zhi, Haizhao Liang, Jinze Wu, Jianying Wang, Yu Zheng

In this paper, an adaptive cooperative guidance strategy for the active protection of a target spacecraft trying to evade an interceptor was developed.

AirFormer: Predicting Nationwide Air Quality in China with Transformers

1 code implementation29 Nov 2022 Yuxuan Liang, Yutong Xia, Songyu Ke, Yiwei Wang, Qingsong Wen, Junbo Zhang, Yu Zheng, Roger Zimmermann

Air pollution is a crucial issue affecting human health and livelihoods, as well as one of the barriers to economic and social growth.

Toward Global Sensing Quality Maximization: A Configuration Optimization Scheme for Camera Networks

1 code implementation28 Nov 2022 Xuechao Zhang, Xuda Ding, Yi Ren, Yu Zheng, Chongrong Fang, Jianping He

Then, we form a single quantity that measures the sensing quality of the targets by the camera network.

FedForgery: Generalized Face Forgery Detection with Residual Federated Learning

1 code implementation18 Oct 2022 Decheng Liu, Zhan Dang, Chunlei Peng, Yu Zheng, Shuang Li, Nannan Wang, Xinbo Gao

Experiments conducted on publicly available face forgery detection datasets prove the superior performance of the proposed FedForgery.

Federated Learning Image Generation

Deep Data Augmentation for Weed Recognition Enhancement: A Diffusion Probabilistic Model and Transfer Learning Based Approach

1 code implementation18 Oct 2022 Dong Chen, Xinda Qi, Yu Zheng, Yuzhen Lu, Zhaojian Li

In this paper, we present the first work of applying diffusion probabilistic models (also known as diffusion models) to generate high-quality synthetic weed images based on transfer learning.

Data Augmentation Management +1

Unifying Graph Contrastive Learning with Flexible Contextual Scopes

1 code implementation17 Oct 2022 Yizhen Zheng, Yu Zheng, Xiaofei Zhou, Chen Gong, Vincent CS Lee, Shirui Pan

To address aforementioned problems, we present a simple self-supervised learning method termed Unifying Graph Contrastive Learning with Flexible Contextual Scopes (UGCL for short).

Contrastive Learning Graph Representation Learning +1

THUEE system description for NIST 2020 SRE CTS challenge

no code implementations12 Oct 2022 Yu Zheng, Jinghan Peng, Miao Zhao, Yufeng Ma, Min Liu, Xinyue Ma, Tianyu Liang, Tianlong Kong, Liang He, Minqiang Xu

This paper presents the system description of the THUEE team for the NIST 2020 Speaker Recognition Evaluation (SRE) conversational telephone speech (CTS) challenge.

Speaker Recognition

The SpeakIn System Description for CNSRC2022

no code implementations22 Sep 2022 Yu Zheng, Yihao Chen, Jinghan Peng, Yajun Zhang, Min Liu, Minqiang Xu

In the SV task fixed track, our system was a fusion of five models, and two models were fused in the SV task open track.

Retrieval Speaker Recognition +1

Mutual Harmony: Sequential Recommendation with Dual Contrastive Network

1 code implementation18 Sep 2022 GuanYu Lin, Chen Gao, Yinfeng Li, Yu Zheng, Zhiheng Li, Depeng Jin, Dong Li, Jianye Hao, Yong Li

Such user-centric recommendation will make it impossible for the provider to expose their new items, failing to consider the accordant interactions between user and item dimensions.

Contrastive Learning Representation Learning +1

ADTR: Anomaly Detection Transformer with Feature Reconstruction

no code implementations5 Sep 2022 Zhiyuan You, Kai Yang, Wenhan Luo, Lei Cui, Yu Zheng, Xinyi Le

Second, CNN tends to reconstruct both normal samples and anomalies well, making them still hard to distinguish.

Anomaly Detection

Causal Inference in Recommender Systems: A Survey and Future Directions

1 code implementation26 Aug 2022 Chen Gao, Yu Zheng, Wenjie Wang, Fuli Feng, Xiangnan He, Yong Li

Existing recommender systems extract user preferences based on the correlation in data, such as behavioral correlation in collaborative filtering, feature-feature, or feature-behavior correlation in click-through rate prediction.

Causal Inference Click-Through Rate Prediction +2

DA$^2$ Dataset: Toward Dexterity-Aware Dual-Arm Grasping

no code implementations31 Jul 2022 Guangyao Zhai, Yu Zheng, Ziwei Xu, Xin Kong, Yong liu, Benjamin Busam, Yi Ren, Nassir Navab, Zhengyou Zhang

In this paper, we introduce DA$^2$, the first large-scale dual-arm dexterity-aware dataset for the generation of optimal bimanual grasping pairs for arbitrary large objects.

A Unified Model for Multi-class Anomaly Detection

1 code implementation8 Jun 2022 Zhiyuan You, Lei Cui, Yujun Shen, Kai Yang, Xin Lu, Yu Zheng, Xinyi Le

For example, when learning a unified model for 15 categories in MVTec-AD, we surpass the second competitor on the tasks of both anomaly detection (from 88. 1% to 96. 5%) and anomaly localization (from 89. 5% to 96. 8%).

Unsupervised Anomaly Detection

A Cross-City Federated Transfer Learning Framework: A Case Study on Urban Region Profiling

no code implementations31 May 2022 Gaode Chen, Yijun Su, Xinghua Zhang, Anmin Hu, Guochun Chen, Siyuan Feng, Ji Xiang, Junbo Zhang, Yu Zheng

To address the above challenging problems, we propose a novel Cross-city Federated Transfer Learning framework (CcFTL) to cope with the data insufficiency and privacy problems.

Transfer Learning

HyperDet3D: Learning a Scene-conditioned 3D Object Detector

no code implementations CVPR 2022 Yu Zheng, Yueqi Duan, Jiwen Lu, Jie zhou, Qi Tian

A bathtub in a library, a sink in an office, a bed in a laundry room -- the counter-intuition suggests that scene provides important prior knowledge for 3D object detection, which instructs to eliminate the ambiguous detection of similar objects.

3D Object Detection Object +1

Deep AutoAugment

1 code implementation11 Mar 2022 Yu Zheng, Zhi Zhang, Shen Yan, Mi Zhang

In this work, instead of fixing a set of hand-picked default augmentations alongside the searched data augmentations, we propose a fully automated approach for data augmentation search named Deep AutoAugment (DeepAA).

AutoML Data Augmentation +1

Back to Reality: Weakly-supervised 3D Object Detection with Shape-guided Label Enhancement

2 code implementations CVPR 2022 Xiuwei Xu, Yifan Wang, Yu Zheng, Yongming Rao, Jie zhou, Jiwen Lu

In this paper, we propose a weakly-supervised approach for 3D object detection, which makes it possible to train a strong 3D detector with position-level annotations (i. e. annotations of object centers).

3D Object Detection Domain Adaptation +3

Multivariate Time Series Forecasting with Dynamic Graph Neural ODEs

1 code implementation17 Feb 2022 Ming Jin, Yu Zheng, Yuan-Fang Li, Siheng Chen, Bin Yang, Shirui Pan

Multivariate time series forecasting has long received significant attention in real-world applications, such as energy consumption and traffic prediction.

Multivariate Time Series Forecasting Time Series +1

Towards Unsupervised Deep Graph Structure Learning

1 code implementation17 Jan 2022 Yixin Liu, Yu Zheng, Daokun Zhang, Hongxu Chen, Hao Peng, Shirui Pan

To solve the unsupervised GSL problem, we propose a novel StrUcture Bootstrapping contrastive LearnIng fraMEwork (SUBLIME for abbreviation) with the aid of self-supervised contrastive learning.

Contrastive Learning Graph structure learning

Crowd-sensing Enhanced Parking Patrol using Trajectories of Sharing Bikes

no code implementations29 Oct 2021 Tianfu He, Jie Bao, Yexin Li, Hui He, Yu Zheng

Illegal vehicle parking is a common urban problem faced by major cities in the world, as it incurs traffic jams, which lead to air pollution and traffic accidents.

Multi-agent Reinforcement Learning Scheduling

Poformer: A simple pooling transformer for speaker verification

no code implementations10 Oct 2021 Yufeng Ma, Yiwei Ding, Miao Zhao, Yu Zheng, Min Liu, Minqiang Xu

Most recent speaker verification systems are based on extracting speaker embeddings using a deep neural network.

Speaker Verification

Traffic Flow Forecasting with Spatial-Temporal Graph Diffusion Network

1 code implementation8 Oct 2021 Xiyue Zhang, Chao Huang, Yong Xu, Lianghao Xia, Peng Dai, Liefeng Bo, Junbo Zhang, Yu Zheng

Accurate forecasting of citywide traffic flow has been playing critical role in a variety of spatial-temporal mining applications, such as intelligent traffic control and public risk assessment.

Traffic Prediction

Enhancing semi-supervised learning via self-interested coalitional learning

no code implementations29 Sep 2021 Huiling Qin, Xianyuan Zhan, Yuanxun li, Haoran Xu, Yu Zheng

Jointly solving these two tasks allows full utilization of information from both labeled and unlabeled data, thus alleviating the problem of over-reliance on labeled data.

Spatiotemporal Representation Learning on Time Series with Dynamic Graph ODEs

no code implementations29 Sep 2021 Ming Jin, Yuan-Fang Li, Yu Zheng, Bin Yang, Shirui Pan

Spatiotemporal representation learning on multivariate time series has received tremendous attention in forecasting traffic and energy data.

Graph structure learning Representation Learning +2

NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction

1 code implementation8 Sep 2021 Yi Sun, Yu Zheng, Chao Hao, Hangping Qiu

Using prompts to utilize language models to perform various downstream tasks, also known as prompt-based learning or prompt-learning, has lately gained significant success in comparison to the pre-train and fine-tune paradigm.

Entity Linking Language Modelling +3

When Do Contrastive Learning Signals Help Spatio-Temporal Graph Forecasting?

1 code implementation26 Aug 2021 Xu Liu, Yuxuan Liang, Chao Huang, Yu Zheng, Bryan Hooi, Roger Zimmermann

In view of this, one may ask: can we leverage the additional signals from contrastive learning to alleviate data scarcity, so as to benefit STG forecasting?

Contrastive Learning Data Augmentation +2

Generative and Contrastive Self-Supervised Learning for Graph Anomaly Detection

1 code implementation23 Aug 2021 Yu Zheng, Ming Jin, Yixin Liu, Lianhua Chi, Khoa T. Phan, Yi-Ping Phoebe Chen

While the generative attribute regression module allows us to capture the anomalies in the attribute space, the multi-view contrastive learning module can exploit richer structure information from multiple subgraphs, thus abling to capture the anomalies in the structure space, mixing of structure, and attribute information.

Attribute Contrastive Learning +3

DGCN: Diversified Recommendation with Graph Convolutional Networks

2 code implementations16 Aug 2021 Yu Zheng, Chen Gao, Liang Chen, Depeng Jin, Yong Li

These years much effort has been devoted to improving the accuracy or relevance of the recommendation system.

Collaborative Filtering

Sequential Recommendation with Graph Neural Networks

1 code implementation27 Jun 2021 Jianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui, Yanan Niu, Yang song, Depeng Jin, Yong Li

This helps explicitly distinguish users' core interests, by forming dense clusters in the interest graph.

Metric Learning Sequential Recommendation

CSCAD: Correlation Structure-based Collective Anomaly Detection in Complex System

no code implementations30 May 2021 Huiling Qin, Xianyuan Zhan, Yu Zheng

We propose a correlation structure-based collective anomaly detection (CSCAD) model for high-dimensional anomaly detection problem in large systems, which is also generalizable to semi-supervised or supervised settings.

Anomaly Detection

DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning

no code implementations23 Feb 2021 Xianyuan Zhan, Haoran Xu, Yue Zhang, Xiangyu Zhu, Honglei Yin, Yu Zheng

Optimizing the combustion efficiency of a thermal power generating unit (TPGU) is a highly challenging and critical task in the energy industry.

Continuous Control Offline RL +2

Topological Transformations in Pentagonal 2D Materials Induced by Stone-Wales Defects

no code implementations22 Dec 2020 Yu Zheng, Duyu Chen, Lei Liu, Houlong Zhuang, Yang Jiao

We discover two distinct topological pathways through which the pentagonal Cairo tiling (P5), a structural model for single-layer $AB_2$ pyrite materials, respectively transforms into a crystalline rhombus-hexagon (C46) tiling and random rhombus-pentagon-hexagon (R456) tilings, by continuously introducing the Stone-Wales (SW) topological defects.

Soft Condensed Matter Disordered Systems and Neural Networks Materials Science

Disentangling User Interest and Conformity for Recommendation with Causal Embedding

3 code implementations19 Jun 2020 Yu Zheng, Chen Gao, Xiang Li, Xiangnan He, Depeng Jin, Yong Li

We further demonstrate that the learned embeddings successfully capture the desired causes, and show that DICE guarantees the robustness and interpretability of recommendation.

Causal Inference

Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?

1 code implementation NeurIPS 2020 Shen Yan, Yu Zheng, Wei Ao, Xiao Zeng, Mi Zhang

Existing Neural Architecture Search (NAS) methods either encode neural architectures using discrete encodings that do not scale well, or adopt supervised learning-based methods to jointly learn architecture representations and optimize architecture search on such representations which incurs search bias.

Neural Architecture Search

Urban Anomaly Analytics: Description, Detection, and Prediction

no code implementations25 Apr 2020 Mingyang Zhang, Tong Li, Yue Yu, Yong Li, Pan Hui, Yu Zheng

Urban anomalies may result in loss of life or property if not handled properly.

Adaptive Fractional Dilated Convolution Network for Image Aesthetics Assessment

no code implementations CVPR 2020 Qiuyu Chen, Wei zhang, Ning Zhou, Peng Lei, Yi Xu, Yu Zheng, Jianping Fan

Specifically, the fractional dilated kernel is adaptively constructed according to the image aspect ratios, where the interpolation of nearest two integers dilated kernels is used to cope with the misalignment of fractional sampling.

Price-aware Recommendation with Graph Convolutional Networks

1 code implementation9 Mar 2020 Yu Zheng, Chen Gao, Xiangnan He, Yong Li, Depeng Jin

Price, an important factor in marketing --- which determines whether a user will make the final purchase decision on an item --- surprisingly, has received relatively little scrutiny.

Collaborative Filtering Marketing +1

Revisiting Convolutional Neural Networks for Citywide Crowd Flow Analytics

1 code implementation28 Feb 2020 Yuxuan Liang, Kun Ouyang, Yiwei Wang, Ye Liu, Junbo Zhang, Yu Zheng, David S. Rosenblum

This framework consists of three parts: 1) a local feature extraction module to learn representations for each region; 2) a global context module to extract global contextual priors and upsample them to generate the global features; and 3) a region-specific predictor based on tensor decomposition to provide customized predictions for each region, which is very parameter-efficient compared to previous methods.

Tensor Decomposition

Federated Extra-Trees with Privacy Preserving

no code implementations18 Feb 2020 Yang Liu, Mingxin Chen, Wenxi Zhang, Junbo Zhang, Yu Zheng

It is commonly observed that the data are scattered everywhere and difficult to be centralized.

BIG-bench Machine Learning Privacy Preserving

Fine-Grained Urban Flow Inference

1 code implementation5 Feb 2020 Kun Ouyang, Yuxuan Liang, Ye Liu, Zekun Tong, Sijie Ruan, Yu Zheng, David S. Rosenblum

To tackle these issues, we develop a model entitled UrbanFM which consists of two major parts: 1) an inference network to generate fine-grained flow distributions from coarse-grained inputs that uses a feature extraction module and a novel distributional upsampling module; 2) a general fusion subnet to further boost the performance by considering the influence of different external factors.

Fine-Grained Urban Flow Inference

Index Tracking with Cardinality Constraints: A Stochastic Neural Networks Approach

no code implementations12 Nov 2019 Yu Zheng, Bowei Chen, Timothy M. Hospedales, Yongxin Yang

Compared with the benchmarked models, our model has the lowest tracking error, across a range of portfolio sizes.

Evolutionary Algorithms

HM-NAS: Efficient Neural Architecture Search via Hierarchical Masking

no code implementations31 Aug 2019 Shen Yan, Biyi Fang, Faen Zhang, Yu Zheng, Xiao Zeng, Hui Xu, Mi Zhang

Without the constraint imposed by the hand-designed heuristics, our searched networks contain more flexible and meaningful architectures that existing weight sharing based NAS approaches are not able to discover.

Neural Architecture Search

Urban Traffic Prediction from Spatio-Temporal Data Using Deep Meta Learning

1 code implementation KDD '19 2019 Zheyi Pan, Yuxuan Liang, Weifeng Wang, Yong Yu, Yu Zheng, Junbo Zhang

Predicting urban traffic is of great importance to intelligent transportation systems and public safety, yet is very challenging because of two aspects: 1) complex spatio-temporal correlations of urban traffic, including spatial correlations between locations along with temporal correlations among timestamps; 2) diversity of such spatiotemporal correlations, which vary from location to location and depend on the surrounding geographical information, e. g., points of interests and road networks.

Graph Attention Meta-Learning +3

Reward Advancement: Transforming Policy under Maximum Causal Entropy Principle

no code implementations11 Jul 2019 Guojun Wu, Yanhua Li, Zhenming Liu, Jie Bao, Yu Zheng, Jieping Ye, Jun Luo

In this paper, we define and investigate a general reward trans-formation problem (namely, reward advancement): Recovering the range of additional reward functions that transform the agent's policy from original policy to a predefined target policy under MCE principle.

Decision Making

Federated Forest

no code implementations24 May 2019 Yang Liu, Yingting Liu, Zhijie Liu, Junbo Zhang, Chuishi Meng, Yu Zheng

In this paper, we tackle these challenges and propose a privacy-preserving machine learning model, called Federated Forest, which is a lossless learning model of the traditional random forest method, i. e., achieving the same level of accuracy as the non-privacy-preserving approach.

Attribute BIG-bench Machine Learning +1

Modeling cell migration regulated by cell-ECM micromechanical coupling

no code implementations16 May 2019 Yu Zheng, Hanqing Nan, Qihui Fan, Xiaochen Wang, LiYu Liu, Ruchuan Liu, Fangfu Ye, Bo Sun, Yang Jiao

During migration, individual cells can generate active pulling forces via actin filament contraction, which are transmitted to the ECM fibers through focal adhesion complexes, remodel the ECM, and eventually propagate to and can be sensed by other cells in the system.

Incorporating prior financial domain knowledge into neural networks for implied volatility surface prediction

no code implementations29 Apr 2019 Yu Zheng, Yongxin Yang, Bo-Wei Chen

This is one of the very first studies which discuss a methodological framework that incorporates prior financial domain knowledge into neural network architecture design and model training.

Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networks

no code implementations19 Mar 2019 Junkai Sun, Junbo Zhang, Qiaofei Li, Xiuwen Yi, Yuxuan Liang, Yu Zheng

In this paper, we formulate crowd flow forecasting in irregular regions as a spatio-temporal graph (STG) prediction problem in which each node represents a region with time-varying flows.

COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysis

no code implementations CVPR 2019 Yansong Tang, Dajun Ding, Yongming Rao, Yu Zheng, Danyang Zhang, Lili Zhao, Jiwen Lu, Jie zhou

There are substantial instructional videos on the Internet, which enables us to acquire knowledge for completing various tasks.

Action Detection

UrbanFM: Inferring Fine-Grained Urban Flows

1 code implementation6 Feb 2019 Yuxuan Liang, Kun Ouyang, Lin Jing, Sijie Ruan, Ye Liu, Junbo Zhang, David S. Rosenblum, Yu Zheng

In this paper, we aim to infer the real-time and fine-grained crowd flows throughout a city based on coarse-grained observations.

Fine-Grained Urban Flow Inference

Deep Uncertainty Quantification: A Machine Learning Approach for Weather Forecasting

3 code implementations22 Dec 2018 Bin Wang, Jie Lu, Zheng Yan, Huaishao Luo, Tianrui Li, Yu Zheng, Guangquan Zhang

We cast the weather forecasting problem as an end-to-end deep learning problem and solve it by proposing a novel negative log-likelihood error (NLE) loss function.

BIG-bench Machine Learning Uncertainty Quantification +1

HyperST-Net: Hypernetworks for Spatio-Temporal Forecasting

no code implementations28 Sep 2018 Zheyi Pan, Yuxuan Liang, Junbo Zhang, Xiuwen Yi, Yong Yu, Yu Zheng

In this paper, we propose a general framework (HyperST-Net) based on hypernetworks for deep ST models.

Spatio-Temporal Forecasting Time Series +1

Diversity and Sparsity: A New Perspective on Index Tracking

no code implementations6 Sep 2018 Yu Zheng, Timothy M. Hospedales, Yongxin Yang

We introduce the first index tracking method that explicitly optimises both diversity and sparsity in a single joint framework.

Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networks

no code implementations10 Jan 2017 Junbo Zhang, Yu Zheng, Dekang Qi, Ruiyuan Li, Xiuwen Yi, Tianrui Li

We propose a deep-learning-based approach, called ST-ResNet, to collectively forecast two types of crowd flows (i. e. inflow and outflow) in each and every region of a city.

Management

pg-Causality: Identifying Spatiotemporal Causal Pathways for Air Pollutants with Urban Big Data

no code implementations22 Oct 2016 Julie Yixuan Zhu, Chao Zhang, Huichu Zhang, Shi Zhi, Victor O. K. Li, Jiawei Han, Yu Zheng

Therefore, we present \emph{p-Causality}, a novel pattern-aided causality analysis approach that combines the strengths of \emph{pattern mining} and \emph{Bayesian learning} to efficiently and faithfully identify the \emph{ST causal pathways}.

Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction

4 code implementations1 Oct 2016 Junbo Zhang, Yu Zheng, Dekang Qi

The aggregation is further combined with external factors, such as weather and day of the week, to predict the final traffic of crowds in each and every region.

Crowd Flows Prediction Management

Gated Neural Networks for Option Pricing: Rationality by Design

1 code implementation14 Sep 2016 Yongxin Yang, Yu Zheng, Timothy M. Hospedales

We propose a neural network approach to price EU call options that significantly outperforms some existing pricing models and comes with guarantees that its predictions are economically reasonable.

Inductive Bias valid

ST-MVL: Filling Missing Values in Geo-Sensory Time Series Data

no code implementations IJCAI 2016 2016 Xiuwen Yi, Yu Zheng, Junbo Zhang, Tianrui Li

In this paper, we propose a spatio-temporal multi-view-based learning (ST-MVL) method to collectively fill missing readings in a collection of geosensory time series data, considering 1) the temporal correlation between readings at different timestamps in the same series and 2) the spatial correlation between different time series.

Collaborative Filtering Multivariate Time Series Imputation +3

T-Drive: Driving Directions Based on Taxi Trajectories

no code implementations ACM SIGSPATIAL GIS 2010 2010 Jing Yuan, Yu Zheng, Chengyang Zhang, Wenlei Xie, Xing Xie, Guangzhong Sun, Yan Huang

GPS-equipped taxis can be regarded as mobile sensors probing traffic flows on road surfaces, and taxi drivers are usually experienced in finding the fastest (quickest) route to a destination based on their knowledge.

Clustering

Cannot find the paper you are looking for? You can Submit a new open access paper.