The intrinsic evaluation is based on a set of (true) word similarity benchmarks manually translated from (subsets of) the English SimLex  and re-scored in the target languages.
9 the benchmarks 8 For both models, the hyper-parameters are chosen with a grid search over the intervals h={1024, 2048, 4096}, l={2, 3}, lr={0.1, 0.01, 0.001}, and optimizers in {Adam, SGD}, using a held-out dev set (10% of the constraints).