Indeed, if relations and entities are orthogonal (∀r, e (r ⊥ e)), then if two entities e, e and two relations r, r are distinct (i.e., ||e − e || 2 ≥ and ||r − r || 2 ≥ ), it follows that ||e + r − e − r || 2 = ||e − e || 2 + |||r − r || 2 ≥ 2 by Pythagorean theorem.
two sentences whose semantic representations involve two distinct entities and/or relations will have different values.