Search Results for author: Nikita Dvornik

Found 14 papers, 8 papers with code

LabelFormer: Object Trajectory Refinement for Offboard Perception from LiDAR Point Clouds

no code implementations2 Nov 2023 Anqi Joyce Yang, Sergio Casas, Nikita Dvornik, Sean Segal, Yuwen Xiong, Jordan Sir Kwang Hu, Carter Fang, Raquel Urtasun

Auto-labels are most commonly generated via a two-stage approach -- first objects are detected and tracked over time, and then each object trajectory is passed to a learned refinement model to improve accuracy.

GePSAn: Generative Procedure Step Anticipation in Cooking Videos

no code implementations ICCV 2023 Mohamed Ashraf Abdelsalam, Samrudhdhi B. Rangrej, Isma Hadji, Nikita Dvornik, Konstantinos G. Derpanis, Afsaneh Fazly

While most previous work focus on the problem of data scarcity in procedural video datasets, another core challenge of future anticipation is how to account for multiple plausible future realizations in natural settings.

Self-Supervised Learning of Action Affordances as Interaction Modes

no code implementations27 May 2023 Liquan Wang, Nikita Dvornik, Rafael Dubeau, Mayank Mittal, Animesh Garg

We show in the experiments that such affordance learning predicts interaction which covers most modes of interaction for the querying articulated object and can be fine-tuned to a goal-conditional model.

Object Self-Supervised Learning

SAGE: Saliency-Guided Mixup with Optimal Rearrangements

1 code implementation31 Oct 2022 Avery Ma, Nikita Dvornik, Ran Zhang, Leila Pishdad, Konstantinos G. Derpanis, Afsaneh Fazly

For image classification, the most popular data augmentation techniques range from simple photometric and geometrical transformations, to more complex methods that use visual saliency to craft new training examples.

Data Augmentation Domain Generalization +2

SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Models

1 code implementation12 Oct 2022 Ziyi Wu, Nikita Dvornik, Klaus Greff, Thomas Kipf, Animesh Garg

While recent object-centric models can successfully decompose a scene into objects, modeling their dynamics effectively still remains a challenge.

Object Question Answering +2

P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervision

1 code implementation CVPR 2022 He Zhao, Isma Hadji, Nikita Dvornik, Konstantinos G. Derpanis, Richard P. Wildes, Allan D. Jepson

Our model is based on a transformer equipped with a memory module, which maps the start and goal observations to a sequence of plausible actions.

Drop-DTW: Aligning Common Signal Between Sequences While Dropping Outliers

no code implementations NeurIPS 2021 Nikita Dvornik, Isma Hadji, Konstantinos G. Derpanis, Animesh Garg, Allan D. Jepson

In our experiments, we show that Drop-DTW is a robust similarity measure for sequence retrieval and demonstrate its effectiveness as a training loss on diverse applications.

Dynamic Time Warping Representation Learning +1

Selecting Relevant Features from a Multi-domain Representation for Few-shot Classification

1 code implementation ECCV 2020 Nikita Dvornik, Cordelia Schmid, Julien Mairal

Popular approaches for few-shot classification consist of first learning a generic data representation based on a large annotated dataset, before adapting the representation to new classes given only a few labeled samples.

feature selection Few-Shot Image Classification +2

On the Importance of Visual Context for Data Augmentation in Scene Understanding

no code implementations6 Sep 2018 Nikita Dvornik, Julien Mairal, Cordelia Schmid

In this work, we consider object detection, semantic and instance segmentation and augment the training images by blending objects in existing scenes, using instance segmentation annotations.

Data Augmentation Instance Segmentation +7

Modeling Visual Context is Key to Augmenting Object Detection Datasets

2 code implementations ECCV 2018 Nikita Dvornik, Julien Mairal, Cordelia Schmid

For this approach to be successful, we show that modeling appropriately the visual context surrounding objects is crucial to place them in the right environment.

Data Augmentation object-detection +1

Cannot find the paper you are looking for? You can Submit a new open access paper.