To do this, we combine, via some (additive or multiplicative) function f , the vector representing that word with the vector representing the history up to n − 1 words: One issue that must be resolved in implementing equation 14is that the history vector should remain correctly normalized.
the products h i • p(c i ) must themselves be a valid distribution over context words.