Unfortunately, in our composition experiments the BiLinear model fares generally worse than the FullLex model.
a strong argument can be made in favor of a model that learns information about specific words or groups of words.