Search Results for author:
Found 94 papers, 52 papers with code
MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets
Driven by powerful image diffusion models, recent research has achieved the automatic creation of 3D objects from textual or visual guidance.
Robust Depth Enhancement via Polarization Prompt Fusion Tuning
Existing depth sensors are imperfect and may provide inaccurate depth values in challenging scenarios, such as in the presence of transparent or reflective objects.
CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians
The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS).
Enhancing Visual Continual Learning with Language-Guided Supervision
Existing methods commonly utilize the one-hot labels and randomly initialize the classifier head.
SceneX:Procedural Controllable Large-scale Scene Generation via Large-language Models
Due to its great application potential, large-scale scene generation has drawn extensive attention in academia and industry.
Generative Active Learning for Image Synthesis Personalization
The primary challenge in conducting active learning on generative models lies in the open-ended nature of querying, which differs from the closed form of querying in discriminative models that typically target a single concept.
Continual Forgetting for Pre-trained Vision Models
(i) For unwanted knowledge, efficient and effective deleting is crucial.
Open-world Machine Learning: A Review and New Outlooks
This paper aims to provide a comprehensive introduction to the emerging open-world machine learning paradigm, to help researchers build more powerful AI systems in their respective fields, and to promote the development of artificial general intelligence.
MemoNav: Working Memory Model for Visual Navigation
Subsequently, a graph attention module encodes the retained STM and the LTM to generate working memory (WM) which contains the scene features essential for efficient navigation.
DiffSpeaker: Speech-Driven 3D Facial Animation with Diffusion Transformer
We suspect this is due to a shortage of paired audio-4D data, which is crucial for the Transformer to effectively perform as a denoiser within the Diffusion framework.
Segment Anything in 3D Gaussians
In this paper, we propose a novel approach to achieve object segmentation in 3D Gaussian via an interactive procedure without any training process and learned parameters.
MixSup: Mixed-grained Supervision for Label-efficient LiDAR-based 3D Object Detection
Thus, MixSup leverages massive coarse cluster-level labels to learn semantics and a few expensive box-level labels to learn accurate poses and shapes.
Seek for Incantations: Towards Accurate Text-to-Image Diffusion Synthesis through Prompt Engineering
The text-to-image synthesis by diffusion models has recently shown remarkable performance in generating high-quality images.
FurniScene: A Large-scale 3D Room Dataset with Intricate Furnishing Scenes
Indoor scene generation has attracted significant attention recently as it is crucial for applications of gaming, virtual reality, and interior design.
Pareto-based Multi-Objective Recommender System with Forgetting Curve
Considering recency effect in memories, we propose a forgetting model based on Ebbinghaus Forgetting Curve to cope with negative feedback.
Bootstrap Masked Visual Modeling via Hard Patches Mining
To empower the model as a teacher, we propose Hard Patches Mining (HPM), predicting patch-wise losses and subsequently determining where to mask.
Compositional Inversion for Stable Diffusion Models
It stems from the fact that during inversion, the irrelevant semantics in the user images are also encoded, forcing the inverted concepts to occupy locations far from the core distribution in the embedding space.
GPT4SGG: Synthesizing Scene Graphs from Holistic and Region-specific Narratives
Learning scene graphs from natural language descriptions has proven to be a cheap and promising scheme for Scene Graph Generation (SGG).
Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving
In autonomous driving, predicting future events in advance and evaluating the foreseeable risks empowers autonomous vehicles to better plan their actions, enhancing safety and efficiency on the road.
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention
For the more challenging settings of relation-involved open vocabulary SGG, the proposed approach integrates relation-aware pre-training utilizing image-caption data and retains visual-concept alignment through knowledge distillation.
Visual Commonsense based Heterogeneous Graph Contrastive Learning
Specifically, our model contains two key components: the Commonsense-based Contrastive Learning and the Graph Relation Network.
RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models
The advent of Large Language Models (LLMs) has paved the way for complex tasks such as role-playing, which enhances user interactions by enabling models to imitate various characters.
Informative Data Mining for One-Shot Cross-Domain Semantic Segmentation
One-shot domain adaptation methods attempt to overcome these challenges by transferring the pre-trained source model to the target domain using only one target data.
DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
As it is empirically observed that Vision Transformers (ViTs) are quite insensitive to the order of input tokens, the need for an appropriate self-supervised pretext task that enhances the location awareness of ViTs is becoming evident.
Bootstrap Fine-Grained Vision-Language Alignment for Unified Zero-Shot Anomaly Localization
On top of the proposed AnoCLIP, we further introduce a test-time adaptation (TTA) mechanism to refine visual anomaly localization results, where we optimize a lightweight adapter in the visual encoder using AnoCLIP's pseudo-labels and noise-corrupted tokens.
FSD V2: Improving Fully Sparse 3D Object Detection with Virtual Voxels
Consequently, we develop a suite of components to complement the virtual voxel concept, including a virtual voxel encoder, a virtual voxel mixer, and a virtual voxel assignment strategy.
DiffusePast: Diffusion-based Generative Replay for Class Incremental Semantic Segmentation
The Class Incremental Semantic Segmentation (CISS) extends the traditional segmentation task by incrementally learning newly added classes.
Echoes Beyond Points: Unleashing the Power of Raw Radar Data in Multi-modality Fusion
Radar is ubiquitous in autonomous driving systems due to its low cost and good adaptability to bad weather.
DDG-Net: Discriminability-Driven Graph Network for Weakly-supervised Temporal Action Localization
Considering this phenomenon, we propose Discriminability-Driven Graph Network (DDG-Net), which explicitly models ambiguous snippets and discriminative snippets with well-designed connections, preventing the transmission of ambiguous information and enhancing the discriminability of snippet-level representations.
Weakly-supervised Temporal Action Localization
Weakly Supervised Temporal Action Localization
BMAD: Benchmarks for Medical Anomaly Detection
However, there is a lack of a universal and fair benchmark for evaluating AD methods on medical images, which hinders the development of more generalized and robust AD methods in this specific domain.
Visually-Guided Sound Source Separation with Audio-Visual Predictive Coding
The framework of visually-guided sound source separation generally consists of three parts: visual feature extraction, multimodal feature fusion, and sound signal processing.
PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentation
In this work, we address this limitation by studying camera-based 3D panoptic segmentation, aiming to achieve a unified occupancy representation for camera-only 3D scene understanding.
Tracking Objects with 3D Representation from Videos
In this paper, we rethink the data association in 2D MOT and utilize the 3D object representation to separate each object in the feature space.
Weakly Supervised 3D Object Detection with Multi-Stage Generalization
We devise the DoubleClustering algorithm to obtain object clusters from reconstructed scene-level points, and further enhance the model's detection capabilities by developing three stages of generalization: progressing from complete to partial, static to dynamic, and close to distant.
Using Unreliable Pseudo-Labels for Label-Efficient Semantic Segmentation
A common practice is to select the highly confident predictions as the pseudo-ground-truths for each pixel, but it leads to a problem that most pixels may be left unused due to their unreliability.
Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory
These agents, equipped with the logic and common sense capabilities of LLMs, can skillfully navigate complex, sparse-reward environments with text-based interactions.
Pulling Target to Source: A New Perspective on Domain Adaptive Semantic Segmentation
To this end, we propose T2S-DA, which we interpret as a form of pulling Target to Source for Domain Adaptation, encouraging the model in learning similar cross-domain features.
Real-Aug: Realistic Scene Synthesis for LiDAR Augmentation in 3D Object Detection
Data and model are the undoubtable two supporting pillars for LiDAR object detection.
Fully Sparse Fusion for 3D Object Detection
In this paper, we study how to effectively leverage image modality in the emerging fully sparse architecture.
Once Detected, Never Lost: Surpassing Human Performance in Offline LiDAR based 3D Object Detection
Drawing inspiration from this, we propose a high-performance offline detector in a track-centric perspective instead of the conventional object-centric perspective.
Hard Patches Mining for Masked Image Modeling
We observe that the reconstruction loss can naturally be the metric of the difficulty of the pre-training task.
3D Video Object Detection with Learnable Object-Centric Global Optimization
We explore long-term temporal visual correspondence-based optimization for 3D video object detection in this work.
Learnable Graph Matching: A Practical Paradigm for Data Association
Data association is at the core of many computer vision tasks, e. g., multiple object tracking, image matching, and point cloud registration.
Graphics Capsule: Learning Hierarchical 3D Face Representations from 2D Images
The function of constructing the hierarchy of objects is important to the visual process of the human brain.
Sharpness-Aware Gradient Matching for Domain Generalization
In this paper, we present two conditions to ensure that the model could converge to a flat minimum with a small loss, and present an algorithm, named Sharpness-Aware Gradient Matching (SAGM), to meet the two conditions for improving model generalization capability.
A Survey of Deep Visual Cross-Domain Few-Shot Learning
Research into Cross-Domain Few-Shot (CDFS) has emerged to address this issue, forming a more challenging and realistic setting.
Blind Video Deflickering by Neural Filtering with a Flawed Atlas
Prior work usually requires specific guidance such as the flickering frequency, manual annotations, or extra consistent videos to remove the flicker.
LMR: A Large-Scale Multi-Reference Dataset for Reference-based Super-Resolution
To this end, we construct a large-scale, multi-reference super-resolution dataset, named LMR.
Intrinsic Physical Concepts Discovery with Object-Centric Predictive Models
The ability to discover abstract physical concepts and understand how they work in the world through observing lies at the core of human intelligence.
Fairly Adaptive Negative Sampling for Recommendations
Pairwise learning strategies are prevalent for optimizing recommendation models on implicit feedback data, which usually learns user preference by discriminating between positive (i. e., clicked by a user) and negative items (i. e., obtained by negative sampling).
FrustumFormer: Adaptive Instance-aware Resampling for Multi-view 3D Detection
The transformation of features from 2D perspective space to 3D space is essential to multi-view 3D object detection.
Super Sparse 3D Object Detection
To enable efficient long-range detection, we first propose a fully sparse object detector termed FSD.
FPR: False Positive Rectification for Weakly Supervised Semantic Segmentation
Without introducing any external supervision and human priors, the proposed FPR effectively suppresses wrong activations from the background objects.
Weakly supervised Semantic Segmentation
Weakly-Supervised Semantic Segmentation
BAEFormer: Bi-Directional and Early Interaction Transformers for Bird's Eye View Semantic Segmentation
Moreover, we find that the image feature maps' resolution in the cross-attention module has a limited effect on the final performance.
Ranked #6 on
Bird's-Eye View Semantic Segmentation
on nuScenes
SSF: Accelerating Training of Spiking Neural Networks with Stabilized Spiking Flow
Surrogate gradient (SG) is one of the most effective approaches for training spiking neural networks (SNNs).
Extracting Semantic Knowledge from GANs with Unsupervised Learning
Second, we train image-to-image translation networks on the synthesized datasets, enabling semantic-conditional image synthesis without human annotations.
BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervision
The proposed method is verified with a wide spectrum of traditional and modern image backbones and achieves new SoTA results on the large-scale nuScenes dataset.
Ranked #5 on
3D Object Detection
on Rope3D
RRSR:Reciprocal Reference-based Image Super-Resolution with Progressive Feature Alignment and Selection
While previous state-of-the-art RefSR methods mainly focus on improving the efficacy and robustness of reference feature transfer, it is generally overlooked that a well reconstructed SR image should enable better SR reconstruction for its similar LR images when it is referred to as.
Pointly-Supervised Panoptic Segmentation
In this paper, we propose a new approach to applying point-level annotations for weakly-supervised panoptic segmentation.
4D Unsupervised Object Discovery
In this paper, we propose 4D unsupervised object discovery, jointly discovering objects from 4D data -- 3D point clouds and 2D RGB images with temporal information.
MemoNav: Selecting Informative Memories for Visual Navigation
To address this limitation, we present the MemoNav, a novel memory mechanism for image-goal navigation, which retains the agent's informative short-term memory and long-term memory to improve the navigation performance on a multi-goal task.
Pro-tuning: Unified Prompt Tuning for Vision Tasks
To this end, we propose parameter-efficient Prompt tuning (Pro-tuning) to adapt frozen vision models to various downstream vision tasks.
Fully Sparse 3D Object Detection
To enable efficient long-range LiDAR-based object detection, we build a fully sparse 3D object detector (FSD).
Densely Constrained Depth Estimator for Monocular 3D Object Detection
So these methods only use a small number of projection constraints and produce insufficient depth candidates, leading to inaccurate depth estimation.
Implicit Sample Extension for Unsupervised Person Re-Identification
Specifically, we generate support samples from actual samples and their neighbouring clusters in the embedding space through a progressive linear interpolation (PLI) strategy.
Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes
Sound source localization in visual scenes aims to localize objects emitting the sound in a given image.
Sparse Instance Activation for Real-Time Instance Segmentation
In this paper, we propose a conceptually novel, efficient, and fully convolutional framework for real-time instance segmentation.
Ranked #8 on
Real-time Instance Segmentation
on MSCOCO
HP-Capsule: Unsupervised Face Part Discovery by Hierarchical Parsing Capsule Network
Capsule networks are designed to present the objects by a set of parts and their relationships, which provide an insight into the procedure of visual perception.
DATA: Domain-Aware and Task-Aware Self-supervised Learning
However, due to the high training costs and the unconsciousness of downstream usages, most self-supervised learning methods lack the capability to correspond to the diversities of downstream scenarios, as there are various data domains, different vision tasks and latency constraints on models.
The Devil Is in the Details: Window-based Attention for Image Compression
Inspired by recent progresses of Vision Transformer (ViT) and Swin Transformer, we found that combining the local-aware attention mechanism with the global-related feature learning could meet the expectation in image compression.
Ranked #1 on
Image Compression
on kodak
Emergence of Machine Language: Towards Symbolic Intelligence with Neural Networks
Moreover, through experiments we show that discrete language representation has several advantages compared with continuous feature representation, from the aspects of interpretability, generalization, and robustness.
Remember the Difference: Cross-Domain Few-Shot Semantic Segmentation via Meta-Memory Transfer
To remedy this problem, we propose an interesting and challenging cross-domain few-shot semantic segmentation task, where the training and test tasks perform on different domains.
Continual Stereo Matching of Continuous Driving Scenes With Growing Architecture
The deep stereo models have achieved state-of-the-art performance on driving scenes, but they suffer from severe performance degradation when tested on unseen scenes.
Towards Noiseless Object Contours for Weakly Supervised Semantic Segmentation
Existing methods usually generate pseudo labels from class activation map (CAM) and then train a segmentation model.
Embracing Single Stride 3D Object Detector with Sparse Transformer
In LiDAR-based 3D object detection for autonomous driving, the ratio of the object size to input scene size is significantly smaller compared to 2D detection cases.
Ranked #3 on
3D Object Detection
on waymo cyclist
Immortal Tracker: Tracklet Never Dies
We employ a simple Kalman filter for trajectory prediction and preserve the tracklet by prediction when the target is not visible.
OBJECT DYNAMICS DISTILLATION FOR SCENE DECOMPOSITION AND REPRESENTATION
In this paper, we work on object dynamics and propose Object Dynamics Distillation Network (ODDN), a framework that distillates explicit object dynamics (e. g., velocity) from sequential static representations.
Source Data-Free Cross-Domain Semantic Segmentation: Align, Teach and Propagate
It is the first work to use negative pseudo labels during self-training for domain adaptation.
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs
Transfer learning with pre-training on large-scale datasets has played an increasingly significant role in computer vision and natural language processing recently.
Image Inpainting by End-to-End Cascaded Refinement with Mask Awareness
Inpainting arbitrary missing regions is challenging because learning valid features for various masked regions is nontrivial.
Ranked #4 on
Image Inpainting
on CelebA-HQ
Distractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophy
A practical long-term tracker typically contains three key properties, i. e. an efficient model design, an effective global re-detection strategy and a robust distractor awareness mechanism.
RefineMask: Towards High-Quality Instance Segmentation with Fine-Grained Features
In this work, we propose a new method called RefineMask for high-quality instance segmentation of objects and scenes, which incorporates fine-grained features during the instance-wise segmenting process in a multi-stage manner.
Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentation
Tremendous efforts have been made on instance segmentation but the mask quality is still not satisfactory.
Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression
Our motivation is that regressing keypoint positions accurately needs to learn representations that focus on the keypoint regions.
Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Tracking
Then the association problem turns into a general graph matching between tracklet graph and detection graph.
RangeDet:In Defense of Range View for LiDAR-based 3D Object Detection
The most notable difference with previous works is that our method is purely based on the range view representation.
Clothing Status Awareness for Long-Term Person Re-Identification
This work argues that these approaches in fact are not aware of clothing status (i. e., change or no-change) of a pedestrian.
RangeDet: In Defense of Range View for LiDAR-Based 3D Object Detection
We first analyze the existing range-view-based methods and find two issues overlooked by previous works: 1) the scale variation between nearby and far away objects; 2) the inconsistency between the 2D range image coordinates used in feature extraction and the 3D Cartesian coordinates used in output.
Uncertainty-Aware Pseudo Label Refinery for Domain Adaptive Semantic Segmentation
Unsupervised domain adaptation for semantic segmentation aims to assign the pixel-level labels for unlabeled target domain by transferring knowledge from the labeled source domain.
Group-Wise Semantic Mining for Weakly Supervised Semantic Segmentation
We formulate WSSS as a novel group-wise learning task that explicitly models semantic dependencies in a group of images to estimate more reliable pseudo ground-truths, which can be used for training more accurate segmentation models.
Ranked #37 on
Weakly-Supervised Semantic Segmentation
on COCO 2014 val
(using extra training data)
Unsupervised Object Detection with LiDAR Clues
We further identify another major issue, seldom noticed by the community, that the long-tailed and open-ended (sub-)category distribution should be accommodated.
Manual-Label Free 3D Detection via An Open-Source Simulator
In this paper, we propose a manual-label free 3D detection algorithm that leverages the CARLA simulator to generate a large amount of self-labeled training samples and introduces a novel Domain Adaptive VoxelNet (DA-VoxelNet) that can cross the distribution gap from the synthetic data to the real scenario.
Multi-task Layout Analysis for Historical Handwritten Documents Using Fully Convolutional Networks
Layout analysis is a fundamental process in document image analysis and understanding.
GIFT: A Real-time and Scalable 3D Shape Search Engine
We name the proposed 3D shape search engine, which combines GPU acceleration and Inverted File Twice, as GIFT.
