To incorporate neural features, HT-D (NN) defines the following scoring function: where Θ is the set of parameters of the neural networks and G is the neural scoring function over the (n,m,h) tuple (Susanto and Lu, 2017b).
the neural features are defined over a fixed-size window surrounding a word in n paired with its immediately associated semantic unit.