Meta-Learning for Fast Cross-Lingual Adaptation in Dependency Parsing
Authors:
Anna Langedijk,
Verna Dankers,
Phillip Lippe,
Sander Bos,
Bryan Cardenas Guevara,
Helen Yannakoudakis,
Ekaterina Shutova
Abstract:
Meta-learning, or learning to learn, is a technique that can help to overcome resource scarcity in cross-lingual NLP problems, by enabling fast adaptation to new tasks. We apply model-agnostic meta-learning (MAML) to the task of cross-lingual dependency parsing. We train our model on a diverse set of languages to learn a parameter initialization that can adapt quickly to new languages. We find tha…
▽ More
Meta-learning, or learning to learn, is a technique that can help to overcome resource scarcity in cross-lingual NLP problems, by enabling fast adaptation to new tasks. We apply model-agnostic meta-learning (MAML) to the task of cross-lingual dependency parsing. We train our model on a diverse set of languages to learn a parameter initialization that can adapt quickly to new languages. We find that meta-learning with pre-training can significantly improve upon the performance of language transfer and standard supervised learning baselines for a variety of unseen, typologically diverse, and low-resource languages, in a few-shot learning setup.
△ Less
Submitted 23 March, 2022; v1 submitted 10 April, 2021;
originally announced April 2021.
