Command Palette
Search for a command to run...
UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment Analysis
Dou Hu; Lingwei Wei; Yaxin Liu; Wei Zhou; Songlin Hu

Abstract
This paper describes our system designed for SemEval-2023 Task 12: Sentiment analysis for African languages. The challenge faced by this task is the scarcity of labeled data and linguistic resources in low-resource settings. To alleviate these, we propose a generalized multilingual system SACL-XLMR for sentiment analysis on low-resource languages. Specifically, we design a lexicon-based multilingual BERT to facilitate language adaptation and sentiment-aware representation learning. Besides, we apply a supervised adversarial contrastive learning technique to learn sentiment-spread structured representations and enhance model generalization. Our system achieved competitive results, largely outperforming baselines on both multilingual and zero-shot sentiment classification subtasks. Notably, the system obtained the 1st rank on the zero-shot classification subtask in the official ranking. Extensive experiments demonstrate the effectiveness of our system.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| zero-shot-sentiment-classification-on | Random | weighted-F1 score: 0.34 |
| zero-shot-sentiment-classification-on | XLM-R | weighted-F1 score: 0.399 |
| zero-shot-sentiment-classification-on | AfriBERTa | weighted-F1 score: 0.439 |
| zero-shot-sentiment-classification-on | SACL-XLMR | weighted-F1 score: 0.589 |
| zero-shot-sentiment-classification-on | AfroXLMR | weighted-F1 score: 0.561 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.