The auxiliary prediction modules take − → h t pri and ← − h t pri as input.
we add the following four auxiliary prediction modules to the model: The "forward" module makes predictions without seeing the right context of the current word.