We find that using sparse character category and capitalization features in conjunction with attention and phonological features yields the best 0-shot transfer performance (no training labels in the target language).
attention provides +6 F1 in 0-shot and 5% labeled-target language data scenarios.