That is, the joint probability p(z|x) factors according to The component distributions p(z t |x) can be modeled using a shared bi-directional recurrent neural network.
let − → f () and ← − f () be the forward and backward recurrent unit, respectively, then Independent but context dependent selection of words is often sufficient.