Cross-lingual natural language processing hinges on the premise that there exists invariance across languages. At the word level, researchers have identified such invariance in the word embedding semantic spaces of different languages. However, in order to connect the separate spaces, cross-lingual supervision encoded in parallel data is typically required. In this paper, we attempt to establish the cross-lingual connection without relying on any cross-lingual supervision. By viewing word embedding spaces as distributions, we propose to minimize their earth mover’s distance, a measure of divergence between distributions. We demonstrate the success on the unsupervised bilingual lexicon induction task. In addition, we reveal an interesting finding that the earth mover’s distance shows potential as a measure of language difference.
CITATION STYLE
Zhang, M., Liu, Y., Luan, H., & Sun, M. (2017). Earth mover’s distance minimization for unsupervised bilingual lexicon induction. In EMNLP 2017 - Conference on Empirical Methods in Natural Language Processing, Proceedings (pp. 1934–1945). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/d17-1207
Mendeley helps you to discover research relevant for your work.