HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

DDRel: A New Dataset for Interpersonal Relation Classification in Dyadic Dialogues

Qi Jia; Hongru Huang; Kenny Q. Zhu

DDRel: A New Dataset for Interpersonal Relation Classification in Dyadic Dialogues

Abstract

Interpersonal language style shifting in dialogues is an interesting and almost instinctive ability of human. Understanding interpersonal relationship from language content is also a crucial step toward further understanding dialogues. Previous work mainly focuses on relation extraction between named entities in texts. In this paper, we propose the task of relation classification of interlocutors based on their dialogues. We crawled movie scripts from IMSDb, and annotated the relation labels for each session according to 13 pre-defined relationships. The annotated dataset DDRel consists of 6300 dyadic dialogue sessions between 694 pair of speakers with 53,126 utterances in total. We also construct session-level and pair-level relation classification tasks with widely-accepted baselines. The experimental results show that this task is challenging for existing models and the dataset will be useful for future research.

Code Repositories

Benchmarks

BenchmarkMethodologyMetrics
dialog-relation-extraction-on-ddrelBERT
Pair-level 13-class Acc: 39.73
Pair-level 4-class Acc: 58.13
Pair-level 6-class Acc: 42.33
Session-level 13-class Acc: 39.4
Session-level 4-class Acc: 47.1
Session-level 6-class Acc: 41.87

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp