Compared to ERNIE 2.0, which used many more pre-training tasks and significantly more non-public training data, ZEN is still competitive on SA, SPM and NLI tasks.
zEN outperforms ERNIE 2.0 (B) on SA (TEST) and SPM (TEST), which indicates that ngram enhanced character-based encoders of zEN can achieve performance comparable to approaches using significantly more resources.