In the second layer of the neural network, the units z represent a predicate labeling e i of every sentence y i ∈ d. However, our intention is to incorporate, into action-value function Q, information from only the most relevant sentence.
in practice, we only perform a predicate labeling of the sentence selected by the relevance component of the model.