HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues

Deepanway Ghosal Siqi Shen Navonil Majumder Rada Mihalcea Soujanya Poria

CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues

Abstract

This paper addresses the problem of dialogue reasoning with contextualized commonsense inference. We curate CICERO, a dataset of dyadic conversations with five types of utterance-level reasoning-based inferences: cause, subsequent event, prerequisite, motivation, and emotional reaction. The dataset contains 53,105 of such inferences from 5,672 dialogues. We use this dataset to solve relevant generative and discriminative tasks: generation of cause and subsequent event; generation of prerequisite, motivation, and listener's emotional reaction; and selection of plausible alternatives. Our results ascertain the value of such dialogue-centric commonsense knowledge datasets. It is our hope that CICERO will open new research avenues into commonsense-based dialogue reasoning.

Code Repositories

declare-lab/CICERO
Official
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
answer-generation-on-ciceroT5-large
ROUGE: 0.2947
answer-generation-on-ciceroT5-large pre-trained on GLUCOSE
ROUGE: 0.2980
answer-selection-on-ciceroT5-large
Exact Match: 77.68
answer-selection-on-ciceroUnified QA
Exact Match: 77.51
generative-question-answering-on-ciceroT5-large pre-trained on GLUCOSE
ROUGE: 0.2980
generative-question-answering-on-ciceroT5-large
ROUGE: 0.2946
generative-question-answering-on-ciceroT5-large pre-trained on COMET
ROUGE: 0.2878
generative-question-answering-on-ciceroBART
ROUGE: 0.2837

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp