To leverage the power of these two networks, we transfer the knowledge in the sequential model, encoded as its predictive distributions.
we do this by training a single relational model with an objective that measures both its prediction accuracy with respect to the true semantic role labels, and its match to the probability distributions provided by the sequential model.