As we mentioned earlier, the sparse attention vectors fully capture the association between relations and concepts and hence the knowledge transfer among relations.
we visualize the attention vectors for several relations on both WN18 and FB15K in Figure 3.