We will show that such an assumption is quite reasonable under our model, since the prototype projections successfully tease out the proper semantics from these aggregate representations.
it is natural to wonder whether one can do better if one incorporates the compositional model into the training of the word representations in the first place.