Joint learning of morphology and syntax with cross-level contextual information flow

Citation

Can B, Aleçakır H, Manandhar S & Bozşahin C (2022) Joint learning of morphology and syntax with cross-level contextual information flow. Natural Language Engineering, 28 (6), pp. 763-795. https://doi.org/10.1017/s1351324921000371

Abstract
We propose an integrated deep learning model for morphological segmentation, morpheme tagging, part-of-speech (POS) tagging, and syntactic parsing onto dependencies, using cross-level contextual information flow for every word, from segments to dependencies, with an attention mechanism at horizontal flow. Our model extends the work of Nguyen and Verspoor (2018) on joint POS tagging and dependency parsing to also include morphological segmentation and morphological tagging. We report our results on several languages. Primary focus is agglutination in morphology, in particular Turkish morphology, for which we demonstrate improved performance compared to models trained for individual tasks. Being one of the earlier efforts in joint modeling of syntax and morphology along with dependencies, we discuss prospective guidelines for future comparison.

Keywords
Morphology; Syntax; Dependency parsing; Morphological tagging; Morphological segmentation; Recurrent neural networks; Attention

Journal
Natural Language Engineering: Volume 28, Issue 6