Fine-grained Sentiment Classification using BERT

4 Oct 2019  ·  Manish Munikar, Sushil Shakya, Aakash Shrestha ·

Sentiment classification is an important process in understanding people's perception towards a product, service, or topic. Many natural language processing models have been proposed to solve the sentiment classification problem. However, most of them have focused on binary sentiment classification. In this paper, we use a promising deep learning model called BERT to solve the fine-grained sentiment classification task. Experiments show that our model outperforms other popular models for this task without sophisticated architecture. We also demonstrate the effectiveness of transfer learning in natural language processing in the process.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Sentiment Analysis SST-2 Binary classification BERT Large Accuracy 93.1 # 42
Sentiment Analysis SST-2 Binary classification BERT Base Accuracy 91.2 # 56
Sentiment Analysis SST-5 Fine-grained classification BERT Large Accuracy 55.5 # 5
Sentiment Analysis SST-5 Fine-grained classification BERT Base Accuracy 53.2 # 12

Methods