HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

N-ary Constituent Tree Parsing with Recursive Semi-Markov Model

{Zeqi Tan Jinlong Li Xin Xin}

N-ary Constituent Tree Parsing with Recursive Semi-Markov Model

Abstract

In this paper, we study the task of graph-based constituent parsing in the setting that binarization is not conducted as a pre-processing step, where a constituent tree may consist of nodes with more than two children. Previous graph-based methods on this setting typically generate hidden nodes with the dummy label inside the n-ary nodes, in order to transform the tree into a binary tree for prediction. The limitation is that the hidden nodes break the sibling relations of the n-ary node’s children. Consequently, the dependencies of such sibling constituents might not be accurately modeled and is being ignored. To solve this limitation, we propose a novel graph-based framework, which is called “recursive semi-Markov model”. The main idea is to utilize 1-order semi-Markov model to predict the immediate children sequence of a constituent candidate, which then recursively serves as a child candidate of its parent. In this manner, the dependencies of sibling constituents can be described by 1-order transition features, which solves the above limitation. Through experiments, the proposed framework obtains the F1 of 95.92% and 92.50% on the datasets of PTB and CTB 5.1 respectively. Specially, the recursive semi-Markov model shows advantages in modeling nodes with more than two children, whose average F1 can be improved by 0.3-1.1 points in PTB and 2.3-6.8 points in CTB 5.1.

Benchmarks

BenchmarkMethodologyMetrics
constituency-parsing-on-ctb5N-ary semi-markov + BERT
F1 score: 92.50
constituency-parsing-on-penn-treebankN-ary semi-markov + BERT-large
F1 score: 95.92

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
N-ary Constituent Tree Parsing with Recursive Semi-Markov Model | Papers | HyperAI