Search Results for author:
Found 20 papers, 7 papers with code
FROSTER: Frozen CLIP Is A Strong Teacher for Open-Vocabulary Action Recognition
To address these issues, FROSTER employs a residual feature distillation approach to ensure that CLIP retains its generalization capability while effectively adapting to the action recognition task.
HAP: Structure-Aware Masked Image Modeling for Human-Centric Perception
To further capture human characteristics, we propose a structure-invariant alignment loss that enforces different masked views, guided by the human part prior, to be closely aligned for the same image.
GridFormer: Towards Accurate Table Structure Recognition via Grid Prediction
In this representation, the vertexes and edges of the grid store the localization and adjacency information of the table.
Group Pose: A Simple Baseline for End-to-End Multi-person Pose Estimation
State-of-the-art solutions adopt the DETR-like framework, and mainly develop the complex decoder, e. g., regarding pose estimation as keypoint box detection and combining with human detection in ED-Pose, hierarchically predicting with pose decoder and joint (keypoint) decoder in PETR.
Towards Robust Real-Time Scene Text Detection: From Semantic to Instance Representation Learning
Different from existing methods which integrate multiple-granularity features or multiple outputs, we resort to the perspective of representation learning in which auxiliary tasks are utilized to enable the encoder to jointly learn robust features with the main task of per-pixel classification during optimization.
MataDoc: Margin and Text Aware Document Dewarping for Arbitrary Boundary
To produce a comprehensive evaluation of MataDoc, we propose a novel benchmark ArbDoc, mainly consisting of document images with arbitrary boundaries in four typical scenarios.
Learning Structure-Guided Diffusion Model for 2D Human Pose Estimation
One of the mainstream schemes for 2D human pose estimation (HPE) is learning keypoints heatmaps by a neural network.
ICDAR 2023 Competition on Structured Text Extraction from Visually-Rich Document Images
It is hoped that this competition will attract many researchers in the field of CV and NLP, and bring some new thoughts to the field of Document AI.
Fast-StrucTexT: An Efficient Hourglass Transformer with Modality-guided Dynamic Token Merge for Document Understanding
Transformers achieve promising performance in document understanding because of their high effectiveness and still suffer from quadratic computational complexity dependency on the sequence length.
StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-training
Compared to the masked multi-modal modeling methods for document image understanding that rely on both the image and text modalities, StrucTexTv2 models image-only input and potentially deals with more application scenarios free from OCR pre-processing.
Ranked #1 on
Table Recognition
on WTW
CAE v2: Context Autoencoder with CLIP Target
That is to say, the smaller the model, the lower the mask ratio needs to be.
Group DETR v2: Strong Object Detector with Encoder-Decoder Pretraining
The training process consists of self-supervised pretraining and finetuning a ViT-Huge encoder on ImageNet-1K, pretraining the detector on Object365, and finally finetuning it on COCO.
Ranked #8 on
Object Detection
on COCO test-dev
TRUST: An Accurate and End-to-End Table structure Recognizer Using Splitting-based Transformers
The Vertex-based Merging Module is capable of aggregating local contextual information between adjacent basic grids, providing the ability to merge basic girds that belong to the same spanning cell accurately.
Ranked #5 on
Table Recognition
on PubTabNet
Group DETR: Fast DETR Training with Group-Wise One-to-Many Assignment
Detection transformer (DETR) relies on one-to-one assignment, assigning one ground-truth object to one prediction, for end-to-end detection without NMS post-processing.
MaskOCR: Text Recognition with Masked Encoder-Decoder Pretraining
Specifically, we transform text data into synthesized text images to unify the data modalities of vision and language, and enhance the language modeling capability of the sequence decoder using a proposed masked image-language modeling scheme.
ViSTA: Vision and Scene Text Aggregation for Cross-Modal Retrieval
Visual appearance is considered to be the most important cue to understand images for cross-modal retrieval, while sometimes the scene text appearing in images can provide valuable information to understand the visual semantics.
Ranked #10 on
Cross-Modal Retrieval
on Flickr30k
(using extra training data)
StrucTexT: Structured Text Understanding with Multi-Modal Transformers
Due to the complexity of content and layout in VRDs, structured text understanding has been a challenging task.
Compressing physical properties of atomic species for improving predictive chemistry
The answers to many unsolved problems lie in the intractable chemical space of molecules and materials.
Metadynamics for Training Neural Network Model Chemistries: a Competitive Assessment
At short range, however, these models are data driven and data limited.
The Many-Body Expansion Combined with Neural Networks
Although they are fast, NNs suffer from their own curse of dimensionality; they must be trained on a representative sample of chemical space.
