This latter limitation is particularly critical since it leads to significant degradation in performance when the trained system is applied to texts from new domains.
roleF1   For the Brown (OOD) dataset, the role subsystem F1 improves significantly with POS and dependency parse information (+2.72%) while the sense subsystem benefits less (0.96%).