Structured Self-AttentionWeights Encode Semantics in Sentiment Analysis

1 code implementation • EMNLP (BlackboxNLP) 2020 • Zhengxuan Wu, Thanh-Son Nguyen, Desmond Ong

Very recent work suggests that the self-attention in the Transformer encodes syntactic information; Here, we show that self-attention scores encode semantics by considering sentiment analysis tasks.

Sentiment Analysis Time Series +1