HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Improving Aspect Sentiment Quad Prediction via Template-Order Data Augmentation

Mengting Hu Yike Wu Hang Gao Yinhao Bai Shiwan Zhao

Improving Aspect Sentiment Quad Prediction via Template-Order Data Augmentation

Abstract

Recently, aspect sentiment quad prediction (ASQP) has become a popular task in the field of aspect-level sentiment analysis. Previous work utilizes a predefined template to paraphrase the original sentence into a structure target sequence, which can be easily decoded as quadruplets of the form (aspect category, aspect term, opinion term, sentiment polarity). The template involves the four elements in a fixed order. However, we observe that this solution contradicts with the order-free property of the ASQP task, since there is no need to fix the template order as long as the quadruplet is extracted correctly. Inspired by the observation, we study the effects of template orders and find that some orders help the generative model achieve better performance. It is hypothesized that different orders provide various views of the quadruplet. Therefore, we propose a simple but effective method to identify the most proper orders, and further combine multiple proper templates as data augmentation to improve the ASQP task. Specifically, we use the pre-trained language model to select the orders with minimal entropy. By fine-tuning the pre-trained language model with these template orders, our approach improves the performance of quad prediction, and outperforms state-of-the-art methods significantly in low-resource settings.

Code Repositories

hmt2014/aspectquad
Official
pytorch

Benchmarks

BenchmarkMethodologyMetrics
aspect-based-sentiment-analysis-absa-on-acosDLO
F1 (Laptop): 43.64
F1 (Restaurant): 59.99
aspect-based-sentiment-analysis-absa-on-asqpDLO
F1 (R15): 48.18
F1 (R16): 59.79
aspect-based-sentiment-analysis-absa-on-asteDLO
F1 (L14): 61.46
F1 (R15): 64.26
F1 (R16): 73.03
F1(R14): 72.39
aspect-based-sentiment-analysis-absa-on-tasdDLO
F1 (R15): 62.95
F1 (R16): 71.79

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp