2016proposed a neighborhood mixture model which is closely related.
their proposed model learns a fixed mixture over neighbors as opposed to learning an adaptive mixture based on the query, and requires storing an embedding parameter for every entity-relation pair which can be prohibitively large, potentially O(V e × V r ) whereas our model only requires O(V e + V r ).