Project-then-transfer: Effective two-stage cross-lingual transfer for semantic dependency parsing

Abstract

This paper describes the first report on crosslingual transfer for semantic dependency parsing. We present the insight that there are two different kinds of cross-linguality, namely surface level and semantic level, and try to capture both kinds of cross-linguality by combining annotation projection and model transfer of pre-trained language models. Our experiments showed that the performance of our graph-based semantic dependency parser almost achieved the approximated upper bound.