Search Results for author: Rakshith Shetty

Found 12 papers, 5 papers with code

Towards Automated Testing and Robustification by Semantic Adversarial Data Generation

no code implementations ECCV 2020 Rakshith Shetty, Mario Fritz, Bernt Schiele

Constrained adversarial optimization of object appearance through this synthesizer produces rare/difficult versions of an object which fool the target object detector.

Data Augmentation Object

Diverse and Relevant Visual Storytelling with Scene Graph Embeddings

no code implementations CONLL 2020 Xudong Hong, Rakshith Shetty, Asad Sayeed, Khushboo Mehra, Vera Demberg, Bernt Schiele

A problem in automatically generated stories for image sequences is that they use overly generic vocabulary and phrase structure and fail to match the distributional characteristics of human-generated text.

Visual Storytelling

Towards Causal VQA: Revealing and Reducing Spurious Correlations by Invariant and Covariant Semantic Editing

no code implementations CVPR 2020 Vedika Agarwal, Rakshith Shetty, Mario Fritz

Despite significant success in Visual Question Answering (VQA), VQA models have been shown to be notoriously brittle to linguistic variations in the questions.

Question Answering Visual Question Answering

Not Using the Car to See the Sidewalk: Quantifying and Controlling the Effects of Context in Classification and Segmentation

no code implementations17 Dec 2018 Rakshith Shetty, Bernt Schiele, Mario Fritz

We propose a method to quantify the sensitivity of black-box vision models to visual context by editing images to remove selected objects and measuring the response of the target models.

Classification Data Augmentation +5

Adversarial Scene Editing: Automatic Object Removal from Weak Supervision

no code implementations NeurIPS 2018 Rakshith Shetty, Mario Fritz, Bernt Schiele

While great progress has been made recently in automatic image manipulation, it has been limited to object centric images like faces or structured scene datasets.

Generative Adversarial Network Image Manipulation +1

$A^{4}NT$: Author Attribute Anonymity by Adversarial Training of Neural Machine Translation

no code implementations6 Nov 2017 Rakshith Shetty, Bernt Schiele, Mario Fritz

In this paper, we propose an automatic method, called Adversarial Author Attribute Anonymity Neural Translation ($A^4NT$), to combat such text-based adversaries.

Attribute Machine Translation +1

Paying Attention to Descriptions Generated by Image Captioning Models

2 code implementations ICCV 2017 Hamed R. -Tavakoli, Rakshith Shetty, Ali Borji, Jorma Laaksonen

To bridge the gap between humans and machines in image understanding and describing, we need further insight into how people describe a perceived scene.

Image Captioning

Frame- and Segment-Level Features and Candidate Pool Evaluation for Video Caption Generation

1 code implementation17 Aug 2016 Rakshith Shetty, Jorma Laaksonen

We present our submission to the Microsoft Video to Language Challenge of generating short captions describing videos in the challenge dataset.

Caption Generation Video Captioning

Video captioning with recurrent networks based on frame- and video-level features and visual content classification

2 code implementations9 Dec 2015 Rakshith Shetty, Jorma Laaksonen

In this paper, we describe the system for generating textual descriptions of short video clips using recurrent neural networks (RNN), which we used while participating in the Large Scale Movie Description Challenge 2015 in ICCV 2015.

Caption Generation General Classification +2

Cannot find the paper you are looking for? You can Submit a new open access paper.