Hao Zhou, Yue Zhang, Chuan Cheng, Shujian Huang, Xinyu Dai and Jiajun Chen (2017) "A Neural Probabilistic Structured-Prediction Method for Transition-Based Natural Language Processing", Volume 58, pages 703-729
We propose a neural probabilistic structured-prediction method for transition-based natural language processing, which integrates beam search and contrastive learning. The method uses a global optimization model, which can leverage arbitrary features over non-local context. Beam search is used for efficient heuristic decoding, and contrastive learning is performed for adjusting the model according to search errors. When evaluated on both chunking and dependency parsing tasks, the proposed method achieves significant accuracy improvements over the locally normalized greedy baseline on the two tasks, respectively.
Click here to return to Volume 58 contents list