While this seems to conflict with the worse result obtained by the bidirectional-RM, it is important to realize that prediction corresponds to the whole sentence probability.
a badly chosen word can have a negative effect on the score of future words.