Attention Boosted Sequential Inference Model

5 Dec 2018Guanyu LiPengfei ZhangCaiyan Jia

Attention mechanism has been proven effective on natural language processing. This paper proposes an attention boosted natural language inference model named aESIM by adding word attention and adaptive direction-oriented attention mechanisms to the traditional Bi-LSTM layer of natural language inference models, e.g. ESIM... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Natural Language Inference MultiNLI aESIM Matched 73.9 # 17
Mismatched 73.9 # 14
Natural Language Inference Quora Question Pairs aESIM Accuracy 88.01 # 1
Natural Language Inference SNLI aESIM % Test Accuracy 88.1 # 17

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet