The prior knowledge from the typological database enables the model to forbid the invalid interactions, by generating intermediate feature embeddings in a hierarchical structure.
given n words and l dependency relations, each arc h → m is encoded as the tensor product of three feature vectors for heads Φ h ∈ R n , modifiers Φ m ∈ R n , and the arcs Φ h→m ∈ R l .