Insights Into the Inner Workings of Transformer Models for Protein Function Prediction

1 code implementation • 7 Sep 2023 • Markus Wenzel, Erik Grüner, Nils Strodthoff

Motivation: We explored how explainable artificial intelligence (XAI) can help to shed light into the inner workings of neural networks for protein function prediction, by extending the widely used XAI method of integrated gradients such that latent representations inside of transformer models, which were finetuned to Gene Ontology term and Enzyme Commission number prediction, can be inspected too.

Explainable artificial intelligence Explainable Artificial Intelligence (XAI) +1