Structural embeddings are important complements to existing neural architectures.
it is unclear whether they should be supplied as input to the encoder or be left out of the encoding process and directly concatenated with the encoder hidden states.