The auxiliary prediction modules take − → h t pri and ← − h t pri as input.
this is partly due to the nature of the task which relies on various syntactic features, even when conceptualized as a sequence labeling task He et al., 2018b;.