Given sentence y i and its dependency parse q i , we model the distribution over predicate labels e i as: Here e j is the predicate label of the j th word being labeled, and e 1:j−1 is the partial predicate labeling constructed so far for sentence y i .
in the second layer of the neural network, the units z represent a predicate labeling e i of every sentence y i ∈ d. our intention is to incorporate, into action-value function Q, information from only the most relevant sentence.