Even without entity semantics, DISCO2 significantly outperforms these competitive models from prior work.
the surface features remain important, as the performance of DISCO2 is substantially worse when only the distributed representation is included.