In the first approach, from given corpora or knowledge bases, word and relation embeddings are jointly learnt such that some objective is optimised (Guo et al., 2016;Yang et al., 2015;Nickel et al., 2016;Bordes et al., 2013;Rocktäschel et al., 2016;Minervini et al., 2017;Trouillon et al., 2016).
first and fourth expectations in (11) involve the same pair of words.