Command Palette
Search for a command to run...
CICERO: A Dataset for Contextualized Commonsense Inference in Dialogues
Deepanway Ghosal Siqi Shen Navonil Majumder Rada Mihalcea Soujanya Poria

Abstract
This paper addresses the problem of dialogue reasoning with contextualized commonsense inference. We curate CICERO, a dataset of dyadic conversations with five types of utterance-level reasoning-based inferences: cause, subsequent event, prerequisite, motivation, and emotional reaction. The dataset contains 53,105 of such inferences from 5,672 dialogues. We use this dataset to solve relevant generative and discriminative tasks: generation of cause and subsequent event; generation of prerequisite, motivation, and listener's emotional reaction; and selection of plausible alternatives. Our results ascertain the value of such dialogue-centric commonsense knowledge datasets. It is our hope that CICERO will open new research avenues into commonsense-based dialogue reasoning.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| answer-generation-on-cicero | T5-large | ROUGE: 0.2947 |
| answer-generation-on-cicero | T5-large pre-trained on GLUCOSE | ROUGE: 0.2980 |
| answer-selection-on-cicero | T5-large | Exact Match: 77.68 |
| answer-selection-on-cicero | Unified QA | Exact Match: 77.51 |
| generative-question-answering-on-cicero | T5-large pre-trained on GLUCOSE | ROUGE: 0.2980 |
| generative-question-answering-on-cicero | T5-large | ROUGE: 0.2946 |
| generative-question-answering-on-cicero | T5-large pre-trained on COMET | ROUGE: 0.2878 |
| generative-question-answering-on-cicero | BART | ROUGE: 0.2837 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.