To calculate the phrase score, a linear combination of the hidden layer activations A is computed using W 2 and b 2 .
the five parameters that have to be learned are   We have chosen to generate our word embeddings from Wikipedia.