Search Results for author:
Found 242 papers, 117 papers with code
An Attention-driven Two-stage Clustering Method for Unsupervised Person Re-Identification
By iteratively learning with the two strategies, the attentive regions are gradually shifted from the background to the foreground and the features become more discriminative.
SeqDialN: Sequential Visual Dialog Network in Joint Visual-Linguistic Representation Space
In this work, we formulate a visual dialog as an information flow in which each piece of information is encoded with the joint visual-linguistic representation of a single dialog round.
Dual-Channel Evidence Fusion for Fact Verification over Texts and Tables
Different from previous fact extraction and verification tasks that only consider evidence of a single format, FEVEROUS brings further challenges by extending the evidence format to both plain text and tables.
Geo-BERT Pre-training Model for Query Rewriting in POI Search
Finally, we train a BERT-like pre-training model with text and POIs’ graph embeddings to get an integrated representation of both geographic and semantic information, and apply it in the QR of POI search.
P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks
Prompt tuning, which only tunes continuous prompts with a frozen language model, substantially reduces per-task storage and memory usage at training.
Rho-1: Not All Tokens Are What You Need
After fine-tuning, Rho-1-1B and 7B achieved state-of-the-art results of 40. 6% and 51. 8% on MATH dataset, respectively - matching DeepSeekMath with only 3% of the pretraining tokens.
AutoWebGLM: Bootstrap And Reinforce A Large Language Model-based Web Navigating Agent
Large language models (LLMs) have fueled many intelligent agent tasks, such as web navigation -- but most existing agents perform far from satisfying in real-world webpages due to three factors: (1) the versatility of actions on webpages, (2) HTML text exceeding model processing capacity, and (3) the complexity of decision-making due to the open-domain nature of web.
ChatGLM-Math: Improving Math Problem-Solving in Large Language Models with a Self-Critique Pipeline
Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving.
ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback
The work presents our practices of aligning LLMs with human preferences, offering insights into the challenges and solutions in RLHF implementations.
Extensive Self-Contrast Enables Feedback-Free Language Model Alignment
In this work, we introduce Self-Contrast, a feedback-free large language model alignment method via exploiting extensive self-generated negatives.
GPTA: Generative Prompt Tuning Assistant for Synergistic Downstream Neural Network Enhancement with LLMs
This study introduces GPTA, a Large Language Model assistance training framework, that enhances the training of downstream task models via prefix prompt.
Can multiple-choice questions really be useful in detecting the abilities of LLMs?
Additionally, we propose two methods to quantify the consistency and confidence of LLMs' output, which can be generalized to other QA evaluation benchmarks.
Autonomous vehicle decision and control through reinforcement learning with traffic flow randomization
Most of the current studies on autonomous vehicle decision-making and control tasks based on reinforcement learning are conducted in simulated environments.
Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning
Large language models (LLMs) have shown great potential in complex reasoning tasks, yet their performance is often hampered by the scarcity of high-quality, reasoning-focused training datasets.
Ranked #49 on
Math Word Problem Solving
on MATH
(using extra training data)
Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change
We introduce safe hybrid-action reinforcement learning into discretionary lane change for the first time and propose Parameterized Soft Actor-Critic with PID Lagrangian (PASAC-PIDLag) algorithm.
Crimson: Empowering Strategic Reasoning in Cybersecurity through Large Language Models
We introduces Crimson, a system that enhances the strategic reasoning capabilities of Large Language Models (LLMs) within the realm of cybersecurity.
Teaching Large Language Models an Unseen Language on the Fly
Existing large language models struggle to support numerous low-resource languages, particularly the extremely low-resource ones where there is minimal training data available for effective parameter updating.
Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data
To address this gap, we introduce the Quantitative Reasoning with Data (QRData) benchmark, aiming to evaluate Large Language Models' capability in statistical and causal reasoning with real-world data.
Searching a Lightweight Network Architecture for Thermal Infrared Pedestrian Tracking
To expedite the search process, a random channel selection strategy is employed prior to assessing operation candidates.
Decentralized Federated Unlearning on Blockchain
To address this, we propose Blockchained Federated Unlearning (BlockFUL), a generic framework that redesigns the blockchain structure using Chameleon Hash (CH) technology to mitigate the complexity of model updating, thereby reducing the computational and consensus costs of unlearning tasks. Furthermore, BlockFUL supports various federated unlearning methods, ensuring the integrity and traceability of model updates, whether conducted in parallel or serial.
Prejudice and Caprice: A Statistical Framework for Measuring Social Discrimination in Large Language Models
The growing integration of large language models (LLMs) into social operations amplifies their impact on decisions in crucial areas such as economics, law, education, and healthcare, raising public concerns about these models' discrimination-related safety and reliability.
OpenSUN3D: 1st Workshop Challenge on Open-Vocabulary 3D Scene Understanding
This report provides an overview of the challenge hosted at the OpenSUN3D Workshop on Open-Vocabulary 3D Scene Understanding held in conjunction with ICCV 2023.
Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments
The applications of large language models (LLMs) have expanded well beyond the confines of text processing, signaling a new era where LLMs are envisioned as generalist language agents capable of operating within complex real-world environments.
Using Left and Right Brains Together: Towards Vision and Language Planning
Large Language Models (LLMs) and Large Multi-modality Models (LMMs) have demonstrated remarkable decision masking capabilities on a variety of tasks.
A Systematic Review of Available Datasets in Additive Manufacturing
In-situ monitoring incorporating data from visual and other sensor technologies, allows the collection of extensive datasets during the Additive Manufacturing (AM) process.
CaRiNG: Learning Temporal Causal Representation under Non-Invertible Generation Process
Identifying the underlying time-delayed latent causal processes in sequential data is vital for grasping temporal dynamics and making downstream reasoning.
BET: Explaining Deep Reinforcement Learning through The Error-Prone Decisions
To address this issue, we propose a novel self-interpretable structure, named Backbone Extract Tree (BET), to better explain the agent's behavior by identify the error-prone states.
CASA: Causality-driven Argument Sufficiency Assessment
Motivated by the definition of probability of sufficiency (PS) in the causal literature, we proposeCASA, a zero-shot causality-driven argument sufficiency assessment framework.
Robust Image Watermarking using Stable Diffusion
Watermarking images is critical for tracking image provenance and claiming ownership.
Competition-Level Problems are Effective LLM Evaluators
Large language models (LLMs) have demonstrated impressive reasoning capabilities, yet there is ongoing debate about these abilities and the potential data contamination problem recently.
AlignBench: Benchmarking Chinese Alignment of Large Language Models
We will provide public APIs for evaluating AlignBench with CritiqueLLM to facilitate the evaluation of LLMs' Chinese alignment.
CritiqueLLM: Scaling LLM-as-Critic for Effective and Explainable Evaluation of Large Language Model Generation
Since the natural language processing (NLP) community started to make large language models (LLMs), such as GPT-4, act as a critic to evaluate the quality of generated texts, most of them only train a critique generation model of a specific scale on specific datasets.
Beyond Text: Unveiling Multimodal Proficiency of Large Language Models with MultiAPI Benchmark
The proliferation of Large Language Models like ChatGPT has significantly advanced language understanding and generation, impacting a broad spectrum of applications.
YouTube Video Analytics for Patient Health Literacy: Evidence from Colonoscopy Preparation Videos
This study utilizes data analysis methods to retrieve medical information from YouTube videos concerning colonoscopy to manage health conditions.
Black-Box Prompt Optimization: Aligning Large Language Models without Model Training
However, these models are often not well aligned with human intents, which calls for additional treatments on them, that is, the alignment problem.
Group Distributionally Robust Knowledge Distillation
Knowledge distillation enables fast and effective transfer of features learned from a bigger model to a smaller one.
AgentTuning: Enabling Generalized Agent Abilities for LLMs
Though many prompting methods have been proposed to complete particular agent tasks, there is lack of research focusing on improving the agent capabilities of LLMs themselves without compromising their general abilities.
DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation
To ensure meaningful and aligned textures to the scene, we develop a novel coarse-to-fine panoramic texture generation approach with dual texture alignment, which both considers the geometry and texture cues of the captured scenes.
Compositional Representation Learning for Brain Tumour Segmentation
For brain tumour segmentation, deep learning models can achieve human expert-level performance given a large amount of data and pixel-level annotations.
Adaptive Visual Scene Understanding: Incremental Scene Graph Generation
To address the lack of continual learning methodologies in SGG, we introduce the comprehensive Continual ScenE Graph Generation (CSEGG) dataset along with 3 learning scenarios and 8 evaluation metrics.
SafetyBench: Evaluating the Safety of Large Language Models with Multiple Choice Questions
Notably, SafetyBench also incorporates both Chinese and English data, facilitating the evaluation in both languages.
Fidelity-Induced Interpretable Policy Extraction for Reinforcement Learning
We then design a fidelity-induced mechanism by integrate a fidelity measurement into the reinforcement learning feedback.
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
In this paper, we introduce LongBench, the first bilingual, multi-task benchmark for long context understanding, enabling a more rigorous evaluation of long context understanding.
Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer
To bridge these gaps, in this paper, we propose Tem-Adapter, which enables the learning of temporal dynamics and complex semantics by a visual Temporal Aligner and a textual Semantic Aligner.
Ranked #1 on
Video Question Answering
on SUTD-TrafficQA
Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branches
Although unsupervised approaches based on generative adversarial networks offer a promising solution for denoising without paired datasets, they are difficult in surpassing the performance limitations of conventional GAN-based unsupervised frameworks without significantly modifying existing structures or increasing the computational complexity of denoisers.
AgentBench: Evaluating LLMs as Agents
We present AgentBench, a multi-dimensional evolving benchmark that currently consists of 8 distinct environments to assess LLM-as-Agent's reasoning and decision-making abilities in a multi-turn open-ended generation setting.
Random Sub-Samples Generation for Self-Supervised Real Image Denoising
With sufficient paired training samples, the supervised deep learning methods have attracted much attention in image denoising because of their superior performance.
Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fields
Despite the tremendous progress in neural radiance fields (NeRF), we still face a dilemma of the trade-off between quality and efficiency, e. g., MipNeRF presents fine-detailed and anti-aliased renderings but takes days for training, while Instant-ngp can accomplish the reconstruction in a few minutes but suffers from blurring or aliasing when rendering at various distances or resolutions due to ignoring the sampling area.
Defect Classification in Additive Manufacturing Using CNN-Based Vision Processing
The development of computer vision and in-situ monitoring using visual sensors allows the collection of large datasets from the additive manufacturing (AM) process.
Language-free Compositional Action Generation via Decoupling Refinement
Composing simple elements into complex concepts is crucial yet challenging, especially for 3D action generation.
LPN: Language-guided Prototypical Network for few-shot classification
Few-shot classification aims to adapt to new tasks with limited labeled examples.
Random Walk on Multiple Networks
To take advantage of rich information in multiple networks and make better inferences on entities, in this study, we propose random walk on multiple networks, RWM.
FLGo: A Fully Customizable Federated Learning Platform
Federated learning (FL) has found numerous applications in healthcare, finance, and IoT scenarios.
Compositionally Equivariant Representation Learning
By modelling the compositional representations with learnable von-Mises-Fisher (vMF) kernels, we explore how different design and learning biases can be used to enforce the representations to be more compositionally equivariant under un-, weakly-, and semi-supervised settings.
WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferences
We present WebGLM, a web-enhanced question-answering system based on the General Language Model (GLM).
How Many Answers Should I Give? An Empirical Study of Multi-Answer Reading Comprehension
We further analyze how well different paradigms of current multi-answer MRC models deal with different types of multi-answer instances.
Contrastive Hierarchical Discourse Graph for Scientific Document Summarization
The extended structural context has made scientific paper summarization a challenging task.
The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code
Causal reasoning, the ability to identify cause-and-effect relationship, is crucial in human thinking.
Allies: Prompting Large Language Model with Beam Search
With the advance of large language models (LLMs), the research field of LLM applications becomes more and more popular and the idea of constructing pipelines to accomplish complex tasks by stacking LLM API calls come true.
SummIt: Iterative Text Summarization via ChatGPT
Text summarization systems have made significant progress in recent years, but typically generate summaries in one single step.
Revisiting Parallel Context Windows: A Frustratingly Simple Alternative and Chain-of-Thought Deterioration
We identify two crucial limitations in the evaluation of recent parallel-integrated method Parallel Context Windows (PCW), which extends the maximum context lengths of language models, e. g., 2048 for LLaMA, by harnessing window-wise attention and positional embedding techniques.
Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation
Instruction tuning has emerged to enhance the capabilities of large language models (LLMs) to comprehend instructions and generate appropriate responses.
Hierarchical Adaptive Voxel-guided Sampling for Real-time Applications in Large-scale Point Clouds
While point-based neural architectures have demonstrated their efficacy, the time-consuming sampler currently prevents them from performing real-time reasoning on scene-level point clouds.
Multi-Task Models Adversarial Attacks
We then introduce a novel attack framework, the Gradient Balancing Multi-Task Attack (GB-MTA), which treats attacking a multi-task model as an optimization problem.
Boosting Event Extraction with Denoised Structure-to-Text Augmentation
Event extraction aims to recognize pre-defined event triggers and arguments from texts, which suffer from the lack of high-quality annotations.
AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
Diffusion models have gained significant attention in the realm of image generation due to their exceptional performance.
Unsupervised Dense Retrieval Training with Web Anchors
Based on their commonalities, we train an unsupervised dense retriever, Anchor-DR, with a contrastive learning task that matches the anchor text and the linked document.
Weighted Point Cloud Normal Estimation
Existing normal estimation methods for point clouds are often less robust to severe noise and complex geometric structures.
DiffuSum: Generation Enhanced Extractive Summarization with Diffusion
This paper proposes DiffuSum, a novel paradigm for extractive summarization, by directly generating the desired summary sentence representations with diffusion models and extracting sentences based on sentence representation matching.
Hierarchical Dialogue Understanding with Special Tokens and Turn-level Attention
We evaluate our model on various dialogue understanding tasks including dialogue relation extraction, dialogue emotion recognition, and dialogue act classification.
Ranked #1 on
Dialog Relation Extraction
on DialogRE
ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation
We present a comprehensive solution to learn and improve text-to-image models from human preference feedback.
GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learner
Graph self-supervised learning (SSL), including contrastive and generative approaches, offers great potential to address the fundamental challenge of label scarcity in real-world graph data.
Extractive Summarization via ChatGPT for Faithful Summary Generation
In addition, we explore the effectiveness of in-context learning and chain-of-thought reasoning for enhancing its performance.
Inverse Models for Estimating the Initial Condition of Spatio-Temporal Advection-Diffusion Processes
The irregular sampling scheme is the general scenario, while computationally efficient solutions are available in the spectral domain for non-uniform and shifted uniform sampling.
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Pre-trained Transformers (\eg BERT) have been commonly used in existing dense retrieval methods for parameter initialization, and recent studies are exploring more effective pre-training tasks for further improving the quality of dense vectors.
An adaptive human-in-the-loop approach to emission detection of Additive Manufacturing processes and active learning with computer vision
More specifically, this paper will look at two scenarios: firstly, using convolutional neural networks (CNNs) to automatically inspect and classify emission data collected by in-situ monitoring and secondly, applying Active Learning techniques to the developed classification model to construct a human-in-the-loop mechanism in order to accelerate the labeling process of the emission data.
LEAD: Liberal Feature-based Distillation for Dense Retrieval
Knowledge distillation is often used to transfer knowledge from a strong teacher model to a relatively weak student model.
ClueWeb22: 10 Billion Web Documents with Visual and Semantic Information
ClueWeb22, the newest iteration of the ClueWeb line of datasets, provides 10 billion web pages affiliated with rich information.
Imperceptible Adversarial Attack via Invertible Neural Networks
Adding perturbations via utilizing auxiliary gradient information or discarding existing details of the benign images are two common approaches for generating adversarial examples.
Reason from Context with Self-supervised Learning
To better accommodate the object-centric nature of current downstream tasks such as object recognition and detection, various methods have been proposed to suppress contextual biases or disentangle objects from contexts.
Does Debiasing Inevitably Degrade the Model Performance
We use our theoretical framework to explain why the current debiasing methods cause performance degradation.
IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models
Instead of focusing on pre-defined relations, we create an OIE benchmark aiming to fully examine the open relational information present in the pre-trained LMs.
SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval
Thus, we propose a simple ambiguous negatives sampling method, SimANS, which incorporates a new sampling probability distribution to sample more ambiguous negatives.
Counterfactual Recipe Generation: Exploring Compositional Generalization in a Realistic Scenario
Although pretrained language models can generate fluent recipe texts, they fail to truly learn and use the culinary knowledge in a compositional way.
Diffusion Models for Causal Discovery via Topological Ordering
We introduce theory for updating the learned Hessian without re-training the neural network, and we show that computing with a subset of samples gives an accurate approximation of the ordering, which allows scaling to datasets with more samples and variables.
Learning Explicit Credit Assignment for Cooperative Multi-Agent Reinforcement Learning via Polarization Policy Gradient
Empirically, we evaluate MAPPG on the well-known matrix game and differential game, and verify that MAPPG can converge to the global optimum for both discrete and continuous action spaces.
Multi-agent Reinforcement Learning
reinforcement-learning
+3
HEGEL: Hypergraph Transformer for Long Document Summarization
Extractive summarization for long documents is challenging due to the extended structured input context.
Uplifting Message Passing Neural Network with Graph Original Information
Message passing neural networks (MPNNs) learn the representation of graph-structured data based on graph original information, including node features and graph structures, and have shown astonishing improvement in node classification tasks.
Ranked #4 on
Node Classification
on arXiv-year
GLM-130B: An Open Bilingual Pre-trained Model
We introduce GLM-130B, a bilingual (English and Chinese) pre-trained language model with 130 billion parameters.
Ranked #1 on
Language Modelling
on CLUE (OCNLI_50K)
PROD: Progressive Distillation for Dense Retrieval
It is common that a better teacher model results in a bad student via distillation due to the nonnegligible gap between teacher and student.
Diverse Title Generation for Stack Overflow Posts with Multiple Sampling Enhanced Transformer
Stack Overflow is one of the most popular programming communities where developers can seek help for their encountered problems.
Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical Queries
In this work, we present the Knowledge Graph Transformer (kgTransformer) with masked pre-training and fine-tuning strategies.
HSIC-InfoGAN: Learning Unsupervised Disentangled Representations by Maximising Approximated Mutual Information
Maximisation of mutual information is achieved by introducing an auxiliary network and training with a latent regression loss.
What is Healthy? Generative Counterfactual Diffusion for Lesion Localization
This requires training with healthy and unhealthy data in DPMs.
When Counting Meets HMER: Counting-Aware Network for Handwritten Mathematical Expression Recognition
Recently, most handwritten mathematical expression recognition (HMER) methods adopt the encoder-decoder networks, which directly predict the markup sequences from formula images with the attention mechanism.
BCRLSP: An Offline Reinforcement Learning Framework for Sequential Targeted Promotion
During deployment, we combine the offline RL model with the LP model to generate a robust policy under the budget constraints.
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers
By updating only 0. 1% of the model parameters, the prompt tuning strategy can help retrieval models achieve better generalization performance than traditional methods in which all parameters are updated.
On Curating Responsible and Representative Healthcare Video Recommendations for Patient Education and Health Literacy: An Augmented Intelligence Approach
Studies suggest that one in three US adults use the Internet to diagnose or learn about a health concern.
vMFNet: Compositionality Meets Domain-generalised Segmentation
Moreover, with a reconstruction module, unlabeled data can also be used to learn the vMF kernels and likelihoods by recombining them to reconstruct the input image.
Why patient data cannot be easily forgotten?
With the advent of AI learned on data, one can imagine that such rights can extent to requests for forgetting knowledge of patient's data within AI models.
Physics-Informed Statistical Modeling for Wildfire Aerosols Process Using Multi-Source Geostationary Satellite Remote-Sensing Data Streams
Increasingly frequent wildfires significantly affect solar energy production as the atmospheric aerosols generated by wildfires diminish the incoming solar radiation to the earth.
Regression Trees on Grassmann Manifold for Adapting Reduced-Order Models
When a ROM, constructed using the POD basis obtained from training data, is applied to new parameter settings, the model often lacks robustness against the change of parameters in design, control, and other real-time operation problems.
Improving Subgraph Representation Learning via Multi-View Augmentation
Subgraph representation learning based on Graph Neural Network (GNN) has exhibited broad applications in scientific advancements, such as predictions of molecular structure-property relationships and collective cellular function.
GraphMAE: Self-Supervised Masked Graph Autoencoders
Despite this, contrastive learning-which heavily relies on structural data augmentation and complicated training strategies-has been the dominant approach in graph SSL, while the progress of generative SSL on graphs, especially graph autoencoders (GAEs), has thus far not reached the potential as promised in other fields.
Ranked #1 on
Node Classification
on Cora: fixed 20 node per class
DeepStruct: Pretraining of Language Models for Structure Prediction
We introduce a method for improving the structural understanding abilities of language models.
Ranked #1 on
Open Information Extraction
on Penn Treebank
Dynamic Prefix-Tuning for Generative Template-based Event Extraction
We consider event extraction in a generative manner with template-based conditional generation.
Retrieval-based Spatially Adaptive Normalization for Semantic Image Synthesis
Semantic image synthesis is a challenging task with many practical applications.
MGRR-Net: Multi-level Graph Relational Reasoning Network for Facial Action Units Detection
While the region-level feature learning from local face patches features via graph neural network can encode the correlation across different AUs, the pixel-wise and channel-wise feature learning via graph attention network can enhance the discrimination ability of AU features from global face features.
Privacy-Preserving Personalized Fitness Recommender System (P3FitRec): A Multi-level Deep Learning Approach
Recommender systems have been successfully used in many domains with the help of machine learning algorithms.
Things not Written in Text: Exploring Spatial Commonsense from Visual Signals
We probe PLMs and models with visual signals, including vision-language pretrained models and image synthesis models, on this benchmark, and find that image synthesis models are more capable of learning accurate and consistent spatial knowledge than other models.
A Tree-Structured Multi-Task Model Recommender
Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL).
Syntax-Aware Network for Handwritten Mathematical Expression Recognition
In this paper, we propose a simple and efficient method for HMER, which is the first to incorporate syntax information into an encoder-decoder network.
Automatic Facial Paralysis Estimation with Facial Action Units
In this paper, we propose a novel Adaptive Local-Global Relational Network (ALGRNet) for facial AU detection and use it to classify facial paralysis severity.
SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs
We present SelfKG with efficient strategies to optimize this objective for aligning entities without label supervision.
Keeping Minimal Experience to Achieve Efficient Interpretable Policy Distillation
Although deep reinforcement learning has become a universal solution for complex control tasks, its real-world applicability is still limited because lacking security guarantees for policies.
NeuraHealth: An Automated Screening Pipeline to Detect Undiagnosed Cognitive Impairment in Electronic Health Records with Deep Learning and Natural Language Processing
Dementia related cognitive impairment (CI) is a neurodegenerative disorder, affecting over 55 million people worldwide and growing rapidly at the rate of one new case every 3 seconds.
3D Intracranial Aneurysm Classification and Segmentation via Unsupervised Dual-branch Learning
While most existing deep learning research focused on medical images in a supervised way, we introduce an unsupervised method for the detection of intracranial aneurysms based on 3D point cloud data.
All-in-One Image Restoration for Unknown Corruption
In this paper, we study a challenging problem in image restoration, namely, how to develop an all-in-one method that could recover images from a variety of unknown corruption types and levels.
MegBA: A GPU-Based Distributed Library for Large-Scale Bundle Adjustment
Large-scale Bundle Adjustment (BA) requires massive memory and computation resources which are difficult to be fulfilled by existing BA libraries.
Learning with Noisy Correspondence for Cross-modal Matching
Based on this observation, we reveal and study a latent and challenging direction in cross-modal matching, named noisy correspondence, which could be regarded as a new paradigm of noisy labels.
TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers
We analogize MVS back to its nature of a feature matching task and therefore propose a powerful Feature Matching Transformer (FMT) to leverage intra- (self-) and inter- (cross-) attention to aggregate long-range context information within and across images.
Ranked #8 on
3D Reconstruction
on DTU
MegLoc: A Robust and Accurate Visual Localization Pipeline
In this paper, we present a visual localization pipeline, namely MegLoc, for robust and accurate 6-DoF pose estimation under varying scenarios, including indoor and outdoor scenes, different time across a day, different seasons across a year, and even across years.
Toward Compact Parameter Representations for Architecture-Agnostic Neural Network Compression
This paper investigates deep neural network (DNN) compression from the perspective of compactly representing and storing trained parameters.
Using Deep Learning to Identify Patients with Cognitive Impairment in Electronic Health Records
Automated mining of these notes presents an opportunity to label patients with cognitive impairment in EHR data.
Meta-learning for RIS-assisted NOMA Networks
Extensive simulation results demonstrate that the proposed QoS-based NOMA network achieves significantly higher transmission throughput compared to the conventional orthogonal multiple access (OMA) network.
AutoMTL: A Programming Framework for Automating Efficient Multi-Task Learning
The first challenge is to determine what parameters to share across tasks to optimize for both memory efficiency and task accuracy.
Deep Point Cloud Normal Estimation via Triplet Learning
It consists of two phases: (a) feature encoding which learns representations of local patches, and (b) normal estimation that takes the learned representation as input and regresses the normal vector.
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks
Prompt tuning, which only tunes continuous prompts with a frozen language model, substantially reduces per-task storage and memory usage at training.
Learning the Representation of Behavior Styles with Imitation Learning
Imitation learning is one of the methods for reproducing expert demonstrations adaptively by learning a mapping between observations and actions.
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation
We cast a suite of information extraction tasks into a text-to-triple translation framework.
Ranked #1 on
Open Information Extraction
on OIE2016
(using extra training data)
LOF: Structure-Aware Line Tracking based on Optical Flow
Lines provide the significantly richer geometric structural information about the environment than points, so lines are widely used in recent Visual Odometry (VO) works.
Learning Disentangled Representations in the Imaging Domain
Disentangled representation learning has been proposed as an approach to learning general representations even in the absence of, or with limited, supervision.
Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generation
It simply encourages the variation of output caused by perturbations on different latent dimensions to be orthogonal, and the Jacobian with respect to the input is calculated to represent this variation.
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation
Code representation learning, which aims to encode the semantics of source code into distributed vectors, plays an important role in recent deep-learning-based models for code intelligence.
Method Towards CVPR 2021 Image Matching Challenge
This report describes Megvii-3D team's approach towards CVPR 2021 Image Matching Workshop.
Method Towards CVPR 2021 SimLocMatch Challenge
This report describes Megvii-3D team's approach towards SimLocMatch Challenge @ CVPR 2021 Image Matching Workshop.
UniCon: Unified Context Network for Robust Active Speaker Detection
Our solution is a novel, unified framework that focuses on jointly modeling multiple types of contextual information: spatial context to indicate the position and scale of each candidate's face, relational context to capture the visual relationships among the candidates and contrast audio-visual affinities with each other, and temporal context to aggregate long-term information and smooth out local uncertainties.
Structured Multi-modal Feature Embedding and Alignment for Image-Sentence Retrieval
In this work, we propose to address the above issue from two aspects: (i) constructing intrinsic structure (along with relations) among the fragments of respective modalities, e. g., "dog $\to$ play $\to$ ball" in semantic structure for an image, and (ii) seeking explicit inter-modal structural and semantic correspondence between the visual and textual modalities.
Rethinking Hard-Parameter Sharing in Multi-Domain Learning
One common sharing practice is to share the bottom layers of a deep neural network among domains while using separate top layers for each domain.
Locality-aware Channel-wise Dropout for Occluded Face Recognition
Furthermore, by randomly dropping out several feature channels, our method can well simulate the occlusion of larger area.
Unsupervised Neural Rendering for Image Hazing
To generate plausible haze, we study two less-touched but challenging problems in hazy image rendering, namely, i) how to estimate the transmission map from a single image without auxiliary information, and ii) how to adaptively learn the airlight from exemplars, i. e., unpaired real hazy images.
Gaze Estimation with an Ensemble of Four Architectures
This paper presents a method for gaze estimation according to face images.
Controllable cardiac synthesis via disentangled anatomy arithmetic
Motivated by the ability to disentangle images into spatial anatomy (tensor) factors and accompanying imaging (vector) representations, we propose a framework termed "disentangled anatomy arithmetic", in which a generative model learns to combine anatomical factors of different input images such that when they are re-entangled with the desired imaging modality (e. g. MRI), plausible new cardiac images are created with the target characteristics.
Boost-R: Gradient Boosted Trees for Recurrence Data
Boost-R constructs an ensemble of gradient boosted additive trees to estimate the cumulative intensity function of the recurrent event process, where a new tree is added to the ensemble by minimizing the regularized L2 distance between the observed and predicted cumulative intensity.
1st Place Solutions for UG2+ Challenge 2021 -- (Semi-)supervised Face detection in the low light condition
In this technical report, we briefly introduce the solution of our team "TAL-ai" for (Semi-) supervised Face detection in the low light condition in UG2+ Challenge in CVPR 2021.
Semi-supervised Meta-learning with Disentanglement for Domain-generalised Medical Image Segmentation
We explicitly model the representations related to domain shifts.
Multi-Granularity Network with Modal Attention for Dense Affective Understanding
Video affective understanding, which aims to predict the evoked expressions by the video content, is desired for video creation and recommendation.
A Self-supervised Method for Entity Alignment
We present SelfKG by leveraging this discovery to design a contrastive learning strategy across two KGs.
Pre-Trained Models: Past, Present and Future
Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved great success and become a milestone in the field of artificial intelligence (AI).
3rd Place Solution for Short-video Face Parsing Challenge
Benefiting from the edge information and edge attention loss, the proposed EANet achieves 86. 16\% accuracy in the Short-video Face Parsing track of the 3rd Person in Context (PIC) Workshop and Challenge, ranked the third place.
ICTCAS-UCAS-TAL Submission to the AVA-ActiveSpeaker Task at ActivityNet Challenge 2021
This report presents a brief description of our method for the AVA Active Speaker Detection (ASD) task at ActivityNet Challenge 2021.
ELSD: Efficient Line Segment Detector and Descriptor
The line description ability of ELSD also outperforms the previous works on the line matching task.
Ranked #1 on
Line Segment Detection
on wireframe dataset
Image Inpainting by End-to-End Cascaded Refinement with Mask Awareness
Inpainting arbitrary missing regions is challenging because learning valid features for various masked regions is nontrivial.
Ranked #4 on
Image Inpainting
on CelebA-HQ
Everything Has a Cause: Leveraging Causal Inference in Legal Text Analysis
Causal inference is the process of capturing cause-effect relationship among variables.
Pseudo-ISP: Learning Pseudo In-camera Signal Processing Pipeline from A Color Image Denoiser
To begin with, the pre-trained denoiser is used to generate the pseudo clean images for the test images.
GPT Understands, Too
Prompting a pretrained language model with natural language patterns has been proved effective for natural language understanding (NLU).
GLM: General Language Model Pretraining with Autoregressive Blank Infilling
On a wide range of tasks across NLU, conditional and unconditional generation, GLM outperforms BERT, T5, and GPT given the same model sizes and data, and achieves the best performance from a single pretrained model with 1. 25x parameters of BERT Large , demonstrating its generalizability to different downstream tasks.
Ranked #4 on
Language Modelling
on WikiText-103
(using extra training data)
Understanding WeChat User Preferences and "Wow" Diffusion
"Top Stories" is a novel friend-enhanced recommendation engine in WeChat, in which users can read articles based on preferences of both their own and their friends.
Graph Representation Learning
Social and Information Networks
OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services
Academic knowledge services have substantially facilitated the development of the science enterprise by providing a plenitude of efficient research tools.
A Novel Graph-based Computation Offloading Strategy for Workflow Applications in Mobile Edge Computing
To achieve better Quality of Service (QoS), for instance, faster response time and lower energy consumption, computation offloading is widely used in the MEC environment.
Edge-computing
Distributed, Parallel, and Cluster Computing
C.2.4
Artificial Intelligence Enhanced Rapid and Efficient Diagnosis of Mycoplasma Pneumoniae Pneumonia in Children Patients
Artificial intelligence methods have been increasingly turning into a potentially powerful tool in the diagnosis and management of diseases.
GraphGallery: A Platform for Fast Benchmarking and Easy Development of Graph Neural Networks Based Intelligent Software
Graph Neural Networks (GNNs) have recently shown to be powerful tools for representing and analyzing graph data.
Artificial Intelligence Driven UAV-NOMA-MEC in Next Generation Wireless Networks
To this end, the fundamentals of this framework are first introduced.
Improved Signed Distance Function for 2D Real-time SLAM and Accurate Localization
In this paper, we propose an improved Signed Distance Function (SDF) for both 2D SLAM and pure localization to improve the accuracy of mapping and localization.
Integrated 3C in NOMA-enabled Remote-E-Health Systems
A novel framework is proposed to integrate communication, control and computing (3C) into the fifth-generation and beyond (5GB) wireless networks for satisfying the ultra-reliable low-latency connectivity requirements of remote-e-Health systems.
News-Driven Stock Prediction Using Noisy Equity State Representation
News-driven stock prediction investigates the correlation between news events and stock price movements.
Unbox the Blackbox: Predict and Interpret YouTube Viewership Using Deep Learning
Although deep learning champions viewership prediction, it lacks interpretability, which is fundamental to increasing the adoption of predictive models and prescribing measurements to improve viewership.
SID-NISM: A Self-supervised Low-light Image Enhancement Framework
When capturing images in low-light conditions, the images often suffer from low visibility, which not only degrades the visual aesthetics of images, but also significantly degenerates the performance of many computer vision algorithms.
Robotic Communications for 5G and Beyond: Challenges and Research Opportunities
Furthermore, dynamic trajectory design and resource allocation for both indoor and outdoor robots are provided to verify the performance of robotic communications in the context of typical robotic application scenarios.
Robotics Systems and Control Signal Processing Systems and Control
Intelligent Reflecting Surface Aided Multi-Cell NOMA Networks
This paper proposes a novel framework of resource allocation in intelligent reflecting surface (IRS) aided multi-cell non-orthogonal multiple access (NOMA) networks, where a sum-rate maximization problem is formulated.
Path Design and Resource Management for NOMA enhanced Indoor Intelligent Robots
Our simulation results demonstrate that 1) With the aid of NOMA techniques, the communication reliability of IRs is effectively improved; 2) The radio map is qualified to be a virtual training environment, and its statistical channel state information improves training efficiency by about 30%; 3) The proposed DT-DPG algorithm is superior to the conventional deep deterministic policy gradient (DDPG) algorithm in terms of optimization performance, training time, and anti-local optimum ability.
Language Models are Open Knowledge Graphs
This paper shows how to construct knowledge graphs (KGs) from pre-trained language models (e. g., BERT, GPT-2/3), without human supervision.
Diversity in immunogenomics: the value and the challenge
With the advent of high-throughput sequencing technologies, the fields of immunogenomics and adaptive immune receptor repertoire research are facing both opportunities and challenges.
Multi-Agent Reinforcement Learning in NOMA-aided UAV Networks for Cellular Offloading
Afterward, a mutual deep Q-network (MDQN) algorithm is proposed to jointly determine the optimal 3D trajectory and power allocation of UAVs.
NOMA in UAV-aided cellular offloading: A machine learning approach
A novel framework is proposed for cellular offloading with the aid of multiple unmanned aerial vehicles (UAVs), while non-orthogonal multiple access (NOMA) technique is employed at each UAV to further improve the spectrum efficiency of the wireless network.
Difference-in-Differences: Bridging Normalization and Disentanglement in PG-GAN
We discover that pixel normalization causes object entanglement by in-painting the area occupied by ablated objects.
Machine Learning Empowered Trajectory and Passive Beamforming Design in UAV-RIS Wireless Networks
The energy consumption minimizing problem is formulated by jointly designing the movement of the UAV, phase shifts of the RIS, power allocation policy from the UAV to MUs, as well as determining the dynamic decoding order.
TP-LSD: Tri-Points Based Line Segment Detector
To realize one-step detection with a faster and more compact model, we introduce the tri-points representation, converting the line segment detection to the end-to-end prediction of a root-point and two endpoints for each line segment.
Ranked #2 on
Line Segment Detection
on York Urban Dataset
Measuring the Biases and Effectiveness of Content-Style Disentanglement
In this paper, we conduct an empirical study to investigate the role of different biases in content-style disentanglement settings and unveil the relationship between the degree of disentanglement and task performance.
Disentangled Representations for Domain-generalized Cardiac Segmentation
Robust cardiac image segmentation is still an open challenge due to the inability of the existing methods to achieve satisfactory performance on unseen data of different domains.
Dialogue State Induction Using Neural Latent Variable Models
Dialogue state modules are a useful component in a task-oriented dialogue system.
Reconfigurable Intelligent Surfaces: Principles and Opportunities
In this context, we provide a comprehensive overview of the state-of-the-art on RISs, with focus on their operating principles, performance evaluation, beamforming design and resource management, applications of machine learning to RIS-enhanced wireless networks, as well as the integration of RISs with other emerging technologies.
Resource Allocation for Multi-Cell IRS-Aided NOMA Networks
This paper proposes a novel framework of resource allocation in multi-cell intelligent reflecting surface (IRS) aided non-orthogonal multiple access (NOMA) networks, where an IRS is deployed to enhance the wireless service.
Self-supervised Learning: Generative or Contrastive
As an alternative, self-supervised learning attracts many researchers for its soaring performance on representation learning in the last several years.
Online non-convex learning for river pollution source identification
In this paper, novel gradient-based online learning algorithms are developed to investigate an important environmental application: real-time river pollution source identification, which aims at estimating the released mass, location, and time of a river pollution source based on downstream sensor data monitoring the pollution concentration.
Studying Product Competition Using Representation Learning
We show that, compared with state-of-the-art models, our approach is faster, and can produce more accurate demand forecasts and price elasticities.
Neighborhood Matching Network for Entity Alignment
This paper presents Neighborhood Matching Network (NMN), a novel entity alignment framework for tackling the structural heterogeneity challenge.
Using Noisy Self-Reports to Predict Twitter User Demographics
We present a method to identify self-reports of race and ethnicity from Twitter profile descriptions.
M^3VSNet: Unsupervised Multi-metric Multi-view Stereo Network
To improve the robustness and completeness of point cloud reconstruction, we propose a novel multi-metric loss function that combines pixel-wise and feature-wise loss function to learn the inherent constraints from different perspectives of matching correspondences.
TAL EmotioNet Challenge 2020 Rethinking the Model Chosen Problem in Multi-Task Learning
This paper introduces our approach to the EmotioNet Challenge 2020.
M^3VSNet: Unsupervised Multi-metric Multi-view Stereo Network
To improve the robustness and completeness of point cloud reconstruction, we propose a novel multi-metric loss function that combines pixel-wise and feature-wise loss function to learn the inherent constraints from different perspectives of matching correspondences.
Have you forgotten? A method to assess if machine learning models have forgotten data
In the era of deep learning, aggregation of data from several sources is a common approach to ensuring data diversity.
An end-to-end CNN framework for polarimetric vision tasks based on polarization-parameter-constructing network
Pixel-wise operations between polarimetric images are important for processing polarization information.
Leveraging Planar Regularities for Point Line Visual-Inertial Odometry
To improve the accuracy of 3D mesh generation and localization, we propose a tightly-coupled monocular VIO system, PLP-VIO, which exploits point features and line features as well as plane regularities.
News-Driven Stock Prediction With Attention-Based Noisy Recurrent State Transition
Thanks to the use of attention over news events, our model is also more explainable.
Predictions of 2019-nCoV Transmission Ending via Comprehensive Methods
Since the SARS outbreak in 2003, a lot of predictive epidemiological models have been proposed.
Artificial Intelligence Aided Next-Generation Networks Relying on UAVs
Artificial intelligence (AI) assisted unmanned aerial vehicle (UAV) aided next-generation networking is proposed for dynamic environments.
RIS Enhanced Massive Non-orthogonal Multiple Access Networks: Deployment and Passive Beamforming Design
A novel framework is proposed for the deployment and passive beamforming design of a reconfigurable intelligent surface (RIS) with the aid of non-orthogonal multiple access (NOMA) technology.
Push-pull Feedback Implements Hierarchical Information Retrieval Efficiently
Experimental data has revealed that in addition to feedforward connections, there exist abundant feedback connections in a neural pathway.
Dynamic Instance Normalization for Arbitrary Style Transfer
Prior normalization methods rely on affine transformations to produce arbitrary image style transfers, of which the parameters are computed in a pre-defined way.
