Our models use the acronyms WWM and SWM respectively to indicate the type of masking they used.
first important result that should be noted is that LSTM+CRf and LSTM+seq2seq models have similar performances to that of the SEM (CRf) baseline when they are not augmented with any kind of embeddings.