This modification can be applied to several common sequence labeling architectures and requires no additional annotated or unannotated data.
we propose an additional training objective which allows the models to make more extensive use of the available data.