Moreover, linearization of the dependency graph, because it relies on an eigendecomposition, is not differentiable.
we handle the linearization in data preprocessing so that the model sees only reordered word-vector inputs.