Search Results for author: Kristof Meding

Found 7 papers, 2 papers with code

Fairness Hacking: The Malicious Practice of Shrouding Unfairness in Algorithms

no code implementations12 Nov 2023 Kristof Meding, Thilo Hagendorff

Our paper intends to serve as a guidance for discussions within the fair ML community to prevent or reduce the misuse of fairness metrics, and thus reduce overall harm from ML applications.

Fairness

Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)

1 code implementation12 Oct 2021 Kristof Meding, Luca M. Schulze Buschoff, Robert Geirhos, Felix A. Wichmann

We find that the ImageNet validation set, among others, suffers from dichotomous data difficulty (DDD): For the range of investigated models and their accuracies, it is dominated by 46. 0% "trivial" and 11. 5% "impossible" images (beyond label errors).

Inductive Bias

Trivial or Impossible --- dichotomous data difficulty masks model differences (on ImageNet and beyond)

no code implementations ICLR 2022 Kristof Meding, Luca M. Schulze Buschoff, Robert Geirhos, Felix A. Wichmann

We find that the ImageNet validation set, among others, suffers from dichotomous data difficulty (DDD): For the range of investigated models and their accuracies, it is dominated by 46. 0% ``trivial'' and 11. 5% ``impossible'' images (beyond label errors).

Inductive Bias

ImageNet suffers from dichotomous data difficulty

no code implementations NeurIPS Workshop ImageNet_PPF 2021 Kristof Meding, Luca M. Schulze Buschoff, Robert Geirhos, Felix A. Wichmann

We find that the ImageNet validation set suffers from dichotomous data difficulty (DDD): For the range of investigated models and their accuracies, it is dominated by 46. 3% "trivial" and 11. 3% "impossible" images.

Inductive Bias

Beyond accuracy: quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency

1 code implementation NeurIPS 2020 Robert Geirhos, Kristof Meding, Felix A. Wichmann

Here we introduce trial-by-trial error consistency, a quantitative analysis for measuring whether two decision making systems systematically make errors on the same inputs.

Decision Making Object Recognition

Ethical Considerations and Statistical Analysis of Industry Involvement in Machine Learning Research

no code implementations8 Jun 2020 Thilo Hagendorff, Kristof Meding

For this purpose, we have not only carried out an informed ethical analysis of the field, but have inspected all papers of the main ML conferences NeurIPS, CVPR, and ICML of the last 5 years - almost 11, 000 papers in total.

BIG-bench Machine Learning

Perceiving the arrow of time in autoregressive motion

no code implementations NeurIPS 2019 Kristof Meding, Dominik Janzing, Bernhard Schölkopf, Felix A. Wichmann

We employ a so-called frozen noise paradigm enabling us to compare human performance with four different algorithms on a trial-by-trial basis: A causal inference algorithm exploiting the dependence structure of additive noise terms, a neurally inspired network, a Bayesian ideal observer model as well as a simple heuristic.

Causal Inference Time Series Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.