Window representations for MemNNs have been shown to work well previously (Hill et al., 2016).
it should be noted that the advantage of working from raw documents in real applications is that data sparsity is less of a concern than for a KB, while on the other hand the KB has the information already parsed in a form amenable to manipulation by machines.