In bidirectional attention models, interface vectors are transformed vectors of h t with alignment model and target word, but we can still use h f t h b t .
if the optimal distance is sufficiently small, then this method will guide the training in early updates and preserve the true optimal with respect to cross entropy with restriction of generating negative sentences.