Are Vision Language Models Texture or Shape Biased and Can We Steer Them?

1 code implementation • 14 Mar 2024 • Paul Gavrikov, Jovita Lukasik, Steffen Jung, Robert Geirhos, Bianca Lamm, Muhammad Jehanzeb Mirza, Margret Keuper, Janis Keuper

If text does indeed influence visual biases, this suggests that we may be able to steer visual biases not just through visual input but also through language: a hypothesis that we confirm through extensive experiments.

Image Captioning Image Classification +3

Retail-786k: a Large-Scale Dataset for Visual Entity Matching

1 code implementation • 29 Sep 2023 • Bianca Lamm, Janis Keuper

In this paper, we introduce the first publicly available large-scale dataset for "visual entity matching", based on a production level use case in the retail domain.

Fine-Grained Product Classification on Leaflet Advertisements

1 code implementation • 5 May 2023 • Daniel Ladwig, Bianca Lamm, Janis Keuper

We show, that the combination of image and text as input improves the classification of visual difficult to distinguish products.

Classification