Using the Google dataset GL (Mikolov et al., 2013b)   the CosAdd method (Mikolov et al., 2013c) shown in (5).
we make a point of comparison to concatenation since it is the most comparable in terms of simplicity, whilst also providing a good baseline of performance on evaluative tasks.