Search Results for author: Francesca Toni

Found 74 papers, 19 papers with code

HILDIF: Interactive Debugging of NLI Models Using Influence Functions

no code implementations ACL (InterNLP) 2021 Hugo Zylberajch, Piyawat Lertvittayakumjorn, Francesca Toni

Biases and artifacts in training data can cause unwelcome behavior in text classifiers (such as shallow pattern matching), leading to lack of generalizability.

Natural Language Inference

A Graph-Based Method for Unsupervised Knowledge Discovery from Financial Texts

no code implementations LREC 2022 Joel Oksanen, Abhilash Majumder, Kumar Saunack, Francesca Toni, Arun Dhondiyal

Our method creatively integrates existing resources to construct automatically a knowledge graph of companies and related entities as well as to carry out unsupervised analysis of the resulting graph to provide quantifiable and explainable insights from the produced knowledge.

graph construction Relation Extraction

Explaining Arguments' Strength: Unveiling the Role of Attacks and Supports (Technical Report)

no code implementations22 Apr 2024 Xiang Yin, Potyka Nico, Francesca Toni

In this paper, we propose a novel theory of Relation Attribution Explanations (RAEs), adapting Shapley values from game theory to offer fine-grained insights into the role of attacks and supports in quantitative bipolar argumentation towards obtaining the arguments' strength.

Fraud Detection

Interval Abstractions for Robust Counterfactual Explanations

1 code implementation21 Apr 2024 Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni

Counterfactual Explanations (CEs) have emerged as a major paradigm in explainable AI research, providing recourse recommendations for users affected by the decisions of machine learning models.

counterfactual Multi-class Classification

Instantiations and Computational Aspects of Non-Flat Assumption-based Argumentation

no code implementations17 Apr 2024 Tuomo Lehtonen, Anna Rapberger, Francesca Toni, Markus Ulbricht, Johannes P. Wallner

We make use of a semantics-preserving translation between ABA and bipolar argumentation frameworks (BAFs).

Towards a Framework for Evaluating Explanations in Automated Fact Verification

1 code implementation29 Mar 2024 Neema Kotonya, Francesca Toni

As deep neural models in NLP become more complex, and as a consequence opaque, the necessity to interpret them becomes greater.

Fact Verification Position

Can Large Language Models perform Relation-based Argument Mining?

no code implementations17 Feb 2024 Deniz Gorur, Antonio Rago, Francesca Toni

Argument mining (AM) is the process of automatically extracting arguments, their components and/or relations amongst arguments and components from text.

Argument Mining Llama +1

The Reasons that Agents Act: Intention and Instrumental Goals

no code implementations11 Feb 2024 Francis Rhys Ward, Matt MacDermott, Francesco Belardinelli, Francesca Toni, Tom Everitt

In addition, we show how our definition relates to past concepts, including actual causality, and the notion of instrumental goals, which is a core idea in the literature on safe AI agents.

Philosophy

Robust Counterfactual Explanations in Machine Learning: A Survey

no code implementations2 Feb 2024 Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni

Counterfactual explanations (CEs) are advocated as being ideally suited to providing algorithmic recourse for subjects affected by the predictions of machine learning models.

counterfactual

Contribution Functions for Quantitative Bipolar Argumentation Graphs: A Principle-based Analysis

no code implementations16 Jan 2024 Timotheus Kampik, Nico Potyka, Xiang Yin, Kristijonas Čyras, Francesca Toni

We present a principle-based analysis of contribution functions for quantitative bipolar argumentation graphs that quantify the contribution of one argument to another.

Recourse under Model Multiplicity via Argumentative Ensembling (Technical Report)

1 code implementation22 Dec 2023 Junqi Jiang, Antonio Rago, Francesco Leofante, Francesca Toni

Model Multiplicity (MM) arises when multiple, equally performing machine learning models can be trained to solve the same prediction task.

counterfactual

Shapley-PC: Constraint-based Causal Structure Learning with Shapley Values

1 code implementation18 Dec 2023 Fabrizio Russo, Francesca Toni

Causal Structure Learning (CSL), amounting to extracting causal relations among the variables in a dataset, is widely perceived as an important step towards robust and transparent models.

Causal Discovery

Honesty Is the Best Policy: Defining and Mitigating AI Deception

no code implementations NeurIPS 2023 Francis Rhys Ward, Francesco Belardinelli, Francesca Toni, Tom Everitt

There are a number of existing definitions of deception in the literature on game theory and symbolic AI, but there is no overarching theory of deception for learning agents in games.

Philosophy

ProtoArgNet: Interpretable Image Classification with Super-Prototypes and Argumentation [Technical Report]

no code implementations26 Nov 2023 Hamed Ayoobi, Nico Potyka, Francesca Toni

We propose ProtoArgNet, a novel interpretable deep neural architecture for image classification in the spirit of prototypical-part-learning as found, e. g. in ProtoPNet.

Image Classification

CAFE: Conflict-Aware Feature-wise Explanations

no code implementations31 Oct 2023 Adam Dejl, Hamed Ayoobi, Matthew Williams, Francesca Toni

Feature attribution methods are widely used to explain neural models by determining the influence of individual input features on the models' outputs.

Technical Report on the Learning of Case Relevance in Case-Based Reasoning with Abstract Argumentation

no code implementations30 Oct 2023 Guilherme Paulino-Passos, Francesca Toni

Specifically, we show that, for two legal datasets, AA-CBR and decision-tree-based learning of case relevance perform competitively in comparison with decision trees.

Abstract Argumentation Specificity

Targeted Activation Penalties Help CNNs Ignore Spurious Signals

1 code implementation22 Sep 2023 Dekai Zhang, Matthew Williams, Francesca Toni

Recent methods tackle this problem by training NNs with additional ground-truth annotations of such signals.

Provably Robust and Plausible Counterfactual Explanations for Neural Networks via Robust Optimisation

1 code implementation22 Sep 2023 Junqi Jiang, Jianglin Lan, Francesco Leofante, Antonio Rago, Francesca Toni

In this work, we propose Provably RObust and PLAusible Counterfactual Explanations (PROPLACE), a method leveraging on robust optimisation techniques to address the aforementioned limitations in the literature.

counterfactual

Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Task

no code implementations11 Sep 2023 Ha-Thanh Nguyen, Randy Goebel, Francesca Toni, Kostas Stathis, Ken Satoh

The evolution of Generative Pre-trained Transformer (GPT) models has led to significant advancements in various natural language processing applications, particularly in legal textual entailment.

GPT-3.5 GPT-4 +1

ABA Learning via ASP

no code implementations30 Aug 2023 Emanuele De Angelis, Maurizio Proietti, Francesca Toni

Recently, ABA Learning has been proposed as a form of symbolic machine learning for drawing Assumption-Based Argumentation frameworks from background knowledge and positive and negative examples.

Understanding ProbLog as Probabilistic Argumentation

no code implementations30 Aug 2023 Francesca Toni, Nico Potyka, Markus Ulbricht, Pietro Totis

ProbLog is a popular probabilistic logic programming language/tool, widely used for applications requiring to deal with inherent uncertainties in structured domains.

Abstract Argumentation

Proceedings 39th International Conference on Logic Programming

no code implementations28 Aug 2023 Enrico Pontelli, Stefania Costantini, Carmine Dodaro, Sarah Gaggl, Roberta Calegari, Artur d'Avila Garcez, Francesco Fabiano, Alessandra Mileo, Alessandra Russo, Francesca Toni

This volume contains the Technical Communications presented at the 39th International Conference on Logic Programming (ICLP 2023), held at Imperial College London, UK from July 9 to July 15, 2023.

Ethics

Argument Attribution Explanations in Quantitative Bipolar Argumentation Frameworks (Technical Report)

no code implementations25 Jul 2023 Xiang Yin, Nico Potyka, Francesca Toni

Argumentative explainable AI has been advocated by several in recent years, with an increasing interest on explaining the reasoning outcomes of Argumentation Frameworks (AFs).

Fake News Detection Recommendation Systems

Grounded Object Centric Learning

no code implementations18 Jul 2023 Avinash Kori, Francesco Locatello, Fabio De Sousa Ribeiro, Francesca Toni, Ben Glocker

The extraction of modular object-centric representations for downstream tasks is an emerging area of research.

Object Object Discovery +3

A negation detection assessment of GPTs: analysis with the xNot360 dataset

no code implementations29 Jun 2023 Ha Thanh Nguyen, Randy Goebel, Francesca Toni, Kostas Stathis, Ken Satoh

Negation is a fundamental aspect of natural language, playing a critical role in communication and comprehension.

GPT-3.5 GPT-4 +4

DR-HAI: Argumentation-based Dialectical Reconciliation in Human-AI Interactions

no code implementations26 Jun 2023 Stylianos Loukas Vasileiou, Ashwin Kumar, William Yeoh, Tran Cao Son, Francesca Toni

We present DR-HAI -- a novel argumentation-based framework designed to extend model reconciliation approaches, commonly used in human-aware planning, for enhanced human-AI interaction.

Learning Assumption-based Argumentation Frameworks

no code implementations25 May 2023 Maurizio Proietti, Francesca Toni

We present a general strategy that applies the transformation rules in a suitable order to learn stratified frameworks, and we also propose a variant that handles the non-stratified case.

Negation

Non-flat ABA is an Instance of Bipolar Argumentation

no code implementations21 May 2023 Markus Ulbricht, Nico Potyka, Anna Rapberger, Francesca Toni

Assumption-based Argumentation (ABA) is a well-known structured argumentation formalism, whereby arguments and attacks between them are drawn from rules, defeasible assumptions and their contraries.

Abstract Argumentation

Interactive Explanations by Conflict Resolution via Argumentative Exchanges

no code implementations27 Mar 2023 Antonio Rago, Hengzhi Li, Francesca Toni

As the field of explainable AI (XAI) is maturing, calls for interactive explanations for (the outputs of) AI models are growing, but the state-of-the-art predominantly focuses on static explanations.

counterfactual Explainable Artificial Intelligence (XAI)

SpArX: Sparse Argumentative Explanations for Neural Networks [Technical Report]

1 code implementation23 Jan 2023 Hamed Ayoobi, Nico Potyka, Francesca Toni

Neural networks (NNs) have various applications in AI, but explaining their decisions remains challenging.

Explaining Random Forests using Bipolar Argumentation and Markov Networks (Technical Report)

no code implementations21 Nov 2022 Nico Potyka, Xiang Yin, Francesca Toni

Random forests are decision tree ensembles that can be used to solve a variety of machine learning problems.

Decision Making

Explaining Image Classification with Visual Debates

1 code implementation17 Oct 2022 Avinash Kori, Ben Glocker, Francesca Toni

An effective way to obtain different perspectives on any given topic is by conducting a debate, where participants argue for and against the topic.

Classification Image Classification

Argumentative Reward Learning: Reasoning About Human Preferences

no code implementations28 Sep 2022 Francis Rhys Ward, Francesco Belardinelli, Francesca Toni

We define a novel neuro-symbolic framework, argumentative reward learning, which combines preference-based argumentation with existing approaches to reinforcement learning from human feedback.

reinforcement-learning Reinforcement Learning (RL)

Formalising the Robustness of Counterfactual Explanations for Neural Networks

1 code implementation31 Aug 2022 Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni

Existing attempts towards solving this problem are heuristic, and the robustness to model changes of the resulting CFXs is evaluated with only a small number of retrained models, failing to provide exhaustive guarantees.

counterfactual

On Interactive Explanations as Non-Monotonic Reasoning

no code implementations30 Jul 2022 Guilherme Paulino-Passos, Francesca Toni

To better analyse this issue, in this work we treat explanations as objects that can be subject to reasoning and present a formal model of the interactive scenario between user and system, via sequences of inputs, outputs, and explanations.

Specificity

A Federated Cox Model with Non-Proportional Hazards

1 code implementation11 Jul 2022 Dekai Zhang, Francesca Toni, Matthew Williams

Recent research has shown the potential for neural networks to improve upon classical survival models such as the Cox model, which is widely used in clinical practice.

GLANCE: Global to Local Architecture-Neutral Concept-based Explanations

no code implementations5 Jul 2022 Avinash Kori, Ben Glocker, Francesca Toni

Specifically, we provide a generator to visualize the `effect' of interactions among features in latent space and draw feature importance therefrom as local explanations.

Disentanglement Feature Importance +1

Hierarchical Symbolic Reasoning in Hyperbolic Space for Deep Discriminative Models

1 code implementation5 Jul 2022 Ainkaran Santhirasekaram, Avinash Kori, Andrea Rockall, Mathias Winkler, Francesca Toni, Ben Glocker

We achieve this by using the natural properties of \emph{hyperbolic geometry} to more efficiently model a hierarchy of symbolic features and generate \emph{hierarchical symbolic rules} as part of our explanations.

Feature Importance

Explaining Causal Models with Argumentation: the Case of Bi-variate Reinforcement

no code implementations23 May 2022 Antonio Rago, Pietro Baroni, Francesca Toni

Causal models are playing an increasingly important role in machine learning, particularly in the realm of explainable AI.

Forecasting Argumentation Frameworks

no code implementations23 May 2022 Benjamin Irwin, Antonio Rago, Francesca Toni

We introduce Forecasting Argumentation Frameworks (FAFs), a novel argumentation-based methodology for forecasting informed by recent judgmental forecasting research.

Argumentative Explanations for Pattern-Based Text Classifiers

no code implementations22 May 2022 Piyawat Lertvittayakumjorn, Francesca Toni

Hence, we propose AXPLR, a novel explanation method using (forms of) computational argumentation to generate explanations (for outputs computed by PLR) which unearth model agreements and disagreements among the features.

Binary text classification regression +3

Towards a Theory of Faithfulness: Faithful Explanations of Differentiable Classifiers over Continuous Data

no code implementations19 May 2022 Nico Potyka, Xiang Yin, Francesca Toni

There is broad agreement in the literature that explanation methods should be faithful to the model that they explain, but faithfulness remains a rather vague term.

Causal Discovery and Knowledge Injection for Contestable Neural Networks (with Appendices)

1 code implementation19 May 2022 Fabrizio Russo, Francesca Toni

Neural networks have proven to be effective at solving machine learning tasks but it is unclear whether they learn any relevant causal relationships, while their black-box nature makes it difficult for modellers to understand and debug them.

Causal Discovery

Logically Consistent Adversarial Attacks for Soft Theorem Provers

1 code implementation29 Apr 2022 Alexander Gaskell, Yishu Miao, Lucia Specia, Francesca Toni

We propose a novel, generative adversarial framework for probing and improving these models' reasoning capabilities.

Automated Theorem Proving

Explainable Patterns for Distinction and Prediction of Moral Judgement on Reddit

1 code implementation26 Jan 2022 Ion Stagkos Efstathiadis, Guilherme Paulino-Passos, Francesca Toni

The forum r/AmITheAsshole in Reddit hosts discussion on moral issues based on concrete narratives presented by users.

Explainable Decision Making with Lean and Argumentative Explanations

no code implementations18 Jan 2022 Xiuyi Fan, Francesca Toni

It is widely acknowledged that transparency of automated decision making is crucial for deployability of intelligent systems, and explaining the reasons why some decisions are "good" and some are not is a way to achieving this transparency.

Decision Making

Graph Reasoning with Context-Aware Linearization for Interpretable Fact Extraction and Verification

no code implementations EMNLP (FEVER) 2021 Neema Kotonya, Thomas Spooner, Daniele Magazzeni, Francesca Toni

This paper presents an end-to-end system for fact extraction and verification using textual and tabular evidence, the performance of which we demonstrate on the FEVEROUS dataset.

Graph Attention Multi-Task Learning

An Explanatory Query-Based Framework for Exploring Academic Expertise

no code implementations28 May 2021 Oana Cocarascu, Andrew McLean, Paul French, Francesca Toni

The success of research institutions heavily relies upon identifying the right researchers "for the job": researchers may need to identify appropriate collaborators, often from across disciplines; students may need to identify suitable supervisors for projects of their interest; administrators may need to match funding opportunities with relevant researchers, and so on.

Word Embeddings

Argumentative XAI: A Survey

no code implementations24 May 2021 Kristijonas Čyras, Antonio Rago, Emanuele Albini, Pietro Baroni, Francesca Toni

Explainable AI (XAI) has been investigated for decades and, together with AI itself, has witnessed unprecedented growth in recent years.

Explainable Artificial Intelligence (XAI)

Automatic Product Ontology Extraction from Textual Reviews

no code implementations23 May 2021 Joel Oksanen, Oana Cocarascu, Francesca Toni

Ontologies have proven beneficial in different settings that make use of textual reviews.

Explanation-Based Human Debugging of NLP Models: A Survey

no code implementations30 Apr 2021 Piyawat Lertvittayakumjorn, Francesca Toni

Debugging a machine learning model is hard since the bug usually involves the training data and the learning process.

Aggregating Bipolar Opinions (With Appendix)

no code implementations4 Feb 2021 Stefan Lauren, Francesco Belardinelli, Francesca Toni

We introduce a novel method to aggregate Bipolar Argumentation (BA) Frameworks expressing opinions by different parties in debates.

Deep Argumentative Explanations

no code implementations10 Dec 2020 Emanuele Albini, Piyawat Lertvittayakumjorn, Antonio Rago, Francesca Toni

Despite the recent, widespread focus on eXplainable AI (XAI), explanations computed by XAI methods tend to provide little insight into the functioning of Neural Networks (NNs).

Explainable Artificial Intelligence (XAI) Text Classification

Influence-Driven Explanations for Bayesian Network Classifiers

no code implementations10 Dec 2020 Antonio Rago, Emanuele Albini, Pietro Baroni, Francesca Toni

One of the most pressing issues in AI in recent years has been the need to address the lack of explainability of many of its models.

counterfactual Relation

Explainable Automated Fact-Checking: A Survey

1 code implementation COLING 2020 Neema Kotonya, Francesca Toni

A number of exciting advances have been made in automated fact-checking thanks to increasingly larger datasets and more powerful systems, leading to improvements in the complexity of claims which can be accurately fact-checked.

Fact Checking

FIND: Human-in-the-Loop Debugging Deep Text Classifiers

1 code implementation EMNLP 2020 Piyawat Lertvittayakumjorn, Lucia Specia, Francesca Toni

Since obtaining a perfect training dataset (i. e., a dataset which is considerably large, unbiased, and well-representative of unseen cases) is hardly possible, many real-world text classifiers are trained on the available, yet imperfect, datasets.

Cautious Monotonicity in Case-Based Reasoning with Abstract Argumentation

no code implementations10 Jul 2020 Guilherme Paulino-Passos, Francesca Toni

Recently, abstract argumentation-based models of case-based reasoning ($AA{\text -}CBR$ in short) have been proposed, originally inspired by the legal domain, but also applicable as classifiers in different scenarios, including image classification, sentiment analysis of text, and in predicting the passage of bills in the UK Parliament.

Abstract Argumentation Image Classification +1

A Dataset Independent Set of Baselines for Relation Prediction in Argument Mining

no code implementations14 Feb 2020 Oana Cocarascu, Elena Cabrio, Serena Villata, Francesca Toni

Argument Mining is the research area which aims at extracting argument components and predicting argumentative relations (i. e., support and attack) from text.

Argument Mining Relation

Formal Verification of Debates in Argumentation Theory

no code implementations12 Dec 2019 Ria Jha, Francesco Belardinelli, Francesca Toni

Such transition systems can model debates and represent their evolution over time using a finite set of states.

Abstract Argumentation Translation

Human-grounded Evaluations of Explanation Methods for Text Classification

1 code implementation IJCNLP 2019 Piyawat Lertvittayakumjorn, Francesca Toni

Due to the black-box nature of deep learning models, methods for explaining the models' results are crucial to gain trust from humans and support collaboration between AIs and humans.

General Classification text-classification +1

Gradual Argumentation Evaluation for Stance Aggregation in Automated Fake News Detection

no code implementations WS 2019 Neema Kotonya, Francesca Toni

One very important stage in employing stance detection for fake news detection is the aggregation of multiple stance labels from different text sources in order to compute a prediction for the veracity of a claim.

Fake News Detection Stance Detection

Complexity Results and Algorithms for Bipolar Argumentation

no code implementations5 Mar 2019 Amin Karamlou, Kristijonas Čyras, Francesca Toni

Bipolar Argumentation Frameworks (BAFs) admit several interpretations of the support relation and diverging definitions of semantics.

Combining Deep Learning and Argumentative Reasoning for the Analysis of Social Media Textual Content Using Small Data Sets

no code implementations CL 2018 Oana Cocarascu, Francesca Toni

In this article, we focus on analyzing whether news headlines support tweets and whether reviews are deceptive by analyzing the interaction or the influence that these texts have on the others, thus exploiting contextual information.

Argument Mining Deception Detection +2

Argumentation for Explainable Scheduling (Full Paper with Proofs)

no code implementations13 Nov 2018 Kristijonas Čyras, Dimitrios Letsios, Ruth Misener, Francesca Toni

Specifically, we define argumentative and natural language explanations for why a schedule is (not) feasible, (not) efficient or (not) satisfying fixed user decisions, based on models of the fundamental makespan scheduling problem in terms of abstract argumentation frameworks (AFs).

Abstract Argumentation Scheduling

Identifying attack and support argumentative relations using deep learning

no code implementations EMNLP 2017 Oana Cocarascu, Francesca Toni

We propose a deep learning architecture to capture argumentative relations of attack and support from one piece of text to another, of the kind that naturally occur in a debate.

Argument Mining Word Embeddings

ABA+: Assumption-Based Argumentation with Preferences

no code implementations10 Oct 2016 Kristijonas Čyras, Francesca Toni

We present ABA+, a new approach to handling preferences in a well known structured argumentation formalism, Assumption-Based Argumentation (ABA).

Properties of ABA+ for Non-Monotonic Reasoning

no code implementations29 Mar 2016 Kristijonas Cyras, Francesca Toni

We investigate properties of ABA+, a formalism that extends the well studied structured argumentation formalism Assumption-Based Argumentation (ABA) with a preference handling mechanism.

Justifying Answer Sets using Argumentation

no code implementations20 Nov 2014 Claudia Schulz, Francesca Toni

An answer set is a plain set of literals which has no further structure that would explain why certain literals are part of it and why others are not.

Computational Logic Foundations of KGP Agents

no code implementations15 Jan 2014 Antonis Kakas, Paolo Mancarella, Fariba Sadri, Kostas Stathis, Francesca Toni

This paper presents the computational logic foundations of a model of agency called the KGP (Knowledge, Goals and Plan model.

Cannot find the paper you are looking for? You can Submit a new open access paper.