Although F1-scores for zero-shot transfer learning(train: EN, test: ZH/AR) are not the best among multilingual experiments, they are still promising and exceed prior published work given the fact that no data from the target language was used to fine-tune.
training with EN using BERT-CRF was helpful for ZH with a performance not far from monolingual performance.