Command Palette
Search for a command to run...
Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots
{Songlin Hu Mingming Li Chunyuan Yuan Wei Zhou Shangwen Lv Jizhong Han Fuqing Zhu}

Abstract
Multi-turn retrieval-based conversation is an important task for building intelligent dialogue systems. Existing works mainly focus on matching candidate responses with every context utterance on multiple levels of granularity, which ignore the side effect of using excessive context information. Context utterances provide abundant information for extracting more matching features, but it also brings noise signals and unnecessary information. In this paper, we will analyze the side effect of using too many context utterances and propose a multi-hop selector network (MSN) to alleviate the problem. Specifically, MSN firstly utilizes a multi-hop selector to select the relevant utterances as context. Then, the model matches the filtered context with the candidate response and obtains a matching score. Experimental results show that MSN outperforms some state-of-the-art methods on three public multi-turn dialogue datasets.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| conversational-response-selection-on-douban-1 | MSN | MAP: 0.587 MRR: 0.632 P@1: 0.470 R10@1: 0.295 R10@2: 0.452 R10@5: 0.788 |
| conversational-response-selection-on-e | MSN | R10@1: 0.606 R10@2: 0.770 R10@5: 0.937 |
| conversational-response-selection-on-rrs | MSN | MAP: 0.550 MRR: 0.563 P@1: 0.383 R10@1: 0.343 R10@2: 0.498 R10@5: 0.798 |
| conversational-response-selection-on-ubuntu-1 | MSN | R10@1: 0.800 R10@2: 0.899 R10@5: 0.978 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.