HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots

Yu Wu; Wei Wu; Chen Xing; Ming Zhou; Zhoujun Li

Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots

Abstract

We study response selection for multi-turn conversation in retrieval-based chatbots. Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which may lose relationships among utterances or important contextual information. We propose a sequential matching network (SMN) to address both problems. SMN first matches a response with each utterance in the context on multiple levels of granularity, and distills important matching information from each pair as a vector with convolution and pooling operations. The vectors are then accumulated in a chronological order through a recurrent neural network (RNN) which models relationships among utterances. The final matching score is calculated with the hidden states of the RNN. An empirical study on two public data sets shows that SMN can significantly outperform state-of-the-art methods for response selection in multi-turn conversation.

Benchmarks

BenchmarkMethodologyMetrics
conversational-response-selection-on-douban-1SMN
MAP: 0.529
MRR: 0.569
P@1: 0.397
R10@1: 0.233
R10@2: 0.396
R10@5: 0.724
conversational-response-selection-on-eSMN
R10@1: 0.453
R10@2: 0.654
R10@5: 0.886
conversational-response-selection-on-rrsSMN
MAP: 0.487
MRR: 0.501
P@1: 0.309
R10@1: 0.281
R10@2: 0.442
R10@5: 0.723
conversational-response-selection-on-ubuntu-1SMN
R10@1: 0.726
R10@2: 0.822
R10@5: 0.960
R2@1: 0.926

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp