Many attempts have been made on connecting distributed representations of KBs with text in the context of knowledge base completion (Lao et al., 2011;Gardner et al., 2014;Toutanova et al., 2015), relation extraction Chang et al., 2014;Riedel et al., 2013), and question answering (Miller et al., 2016).
these approaches model text using shallow representations such as subject/relation/object triples or bag of words.