Command Palette
Search for a command to run...
FABSA: An aspect-based sentiment analysis dataset of user reviews
{Aji Ghose Hassan Tahir Patrycja Sliwiak Thomas Metcalfe Georgia Harrison Jordan Clive Georgios Kontonatsios}
Abstract
Aspect-based sentiment analysis (ABSA) aims at automatically extracting aspects of entities and classifying the polarity of each extracted aspect. The majority of available ABSA systems heavily rely on manually annotated datasets to train supervised machine learning models. However, the development of such manually curated datasets is a labour-intensive process and therefore existing ABSA datasets cover only a few domains and they are limited in size. In response, we present FABSA (Feedback ABSA), a new large-scale and multi-domain ABSA dataset of feedback reviews. FABSA consists of approximately 10,500 reviews which span across 10 domains. We conduct a number of experiments to evaluate the performance of state-of-the-art deep learning models when applied to the FABSA dataset. Our results demonstrate that ABSA models can generalise across different domains when trained on our FABSA dataset while the performance of the models is enhanced when using a larger training dataset. Our FABSA dataset is publicly available.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| aspect-based-sentiment-analysis-absa-on-fabsa | DeBERTa-pair-large | F1 (%): 80.9 |
| aspect-based-sentiment-analysis-absa-on-fabsa | RoBERTa-pair-large | F1 (%): 80.0 |
| aspect-based-sentiment-analysis-absa-on-fabsa | BERT-single-large | F1 (%): 78.8 |
| aspect-based-sentiment-analysis-absa-on-fabsa | BERT-PT | F1 (%): 78.8 |
| aspect-category-sentiment-analysis-on-fabsa | DeBERTa-pair-large | F1 (%): 80.9 |
| aspect-category-sentiment-analysis-on-fabsa | BERT-PT | F1 (%): 78.8 |
| aspect-category-sentiment-analysis-on-fabsa | BERT-single-large | F1 (%): 78.8 |
| aspect-category-sentiment-analysis-on-fabsa | RoBERTa-pair-large | F1 (%): 80.0 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.