For the sake of simplicity, assume that the order of words in an utterance is ignored.
all of these softmax units can share the same set of weights that connect them to hidden units, thus the visible bias term C(V) and the sub-energy func- (1) can be redefined as follows: wherev rk = Dr i=1 v rik denotes the count for the k th word in the r th utterance of the dialogue,v k = R r=1v rk is the count for the k th word in whole dialogue session.