HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots

{Songlin Hu Mingming Li Chunyuan Yuan Wei Zhou Shangwen Lv Jizhong Han Fuqing Zhu}

Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots

Abstract

Multi-turn retrieval-based conversation is an important task for building intelligent dialogue systems. Existing works mainly focus on matching candidate responses with every context utterance on multiple levels of granularity, which ignore the side effect of using excessive context information. Context utterances provide abundant information for extracting more matching features, but it also brings noise signals and unnecessary information. In this paper, we will analyze the side effect of using too many context utterances and propose a multi-hop selector network (MSN) to alleviate the problem. Specifically, MSN firstly utilizes a multi-hop selector to select the relevant utterances as context. Then, the model matches the filtered context with the candidate response and obtains a matching score. Experimental results show that MSN outperforms some state-of-the-art methods on three public multi-turn dialogue datasets.

Benchmarks

BenchmarkMethodologyMetrics
conversational-response-selection-on-douban-1MSN
MAP: 0.587
MRR: 0.632
P@1: 0.470
R10@1: 0.295
R10@2: 0.452
R10@5: 0.788
conversational-response-selection-on-eMSN
R10@1: 0.606
R10@2: 0.770
R10@5: 0.937
conversational-response-selection-on-rrsMSN
MAP: 0.550
MRR: 0.563
P@1: 0.383
R10@1: 0.343
R10@2: 0.498
R10@5: 0.798
conversational-response-selection-on-ubuntu-1MSN
R10@1: 0.800
R10@2: 0.899
R10@5: 0.978

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp