HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

A Dynamic Graph Interactive Framework with Label-Semantic Injection for Spoken Language Understanding

Zhihong Zhu Weiyuan Xu Xuxin Cheng Tengtao Song Yuexian Zou

A Dynamic Graph Interactive Framework with Label-Semantic Injection for Spoken Language Understanding

Abstract

Multi-intent detection and slot filling joint models are gaining increasing traction since they are closer to complicated real-world scenarios. However, existing approaches (1) focus on identifying implicit correlations between utterances and one-hot encoded labels in both tasks while ignoring explicit label characteristics; (2) directly incorporate multi-intent information for each token, which could lead to incorrect slot prediction due to the introduction of irrelevant intent. In this paper, we propose a framework termed DGIF, which first leverages the semantic information of labels to give the model additional signals and enriched priors. Then, a multi-grain interactive graph is constructed to model correlations between intents and slots. Specifically, we propose a novel approach to construct the interactive graph based on the injection of label semantics, which can automatically update the graph to better alleviate error propagation. Experimental results show that our framework significantly outperforms existing approaches, obtaining a relative improvement of 13.7% over the previous best model on the MixATIS dataset in overall accuracy.

Benchmarks

BenchmarkMethodologyMetrics
intent-detection-on-mixatisDGIF
Accuracy: 83.3
intent-detection-on-mixsnipsDGIF
Accuracy: 97.8
slot-filling-on-mixatisDGIF
Micro F1: 88.5
slot-filling-on-mixsnipsDGIF
Micro F1: 95.9

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp