On top of the representation layer, we use a hidden layer to merge X W , X P and X C into a single vector (1) The hidden feature vector h is used to represent the state S = W, P, C , for calculating the scores of the next action.
a linear output layer with two nodes is employed: The first and second node of o represent the scores of SEP and APP given S, namely Score(S, SEP), Score(S, APP) respectively.