Specifically, let − → f () and ← − f () be the forward and backward recurrent unit, respectively, then Independent but context dependent selection of words is often sufficient.
the model is unable to select phrases or refrain from selecting the same word again if already chosen.