12 Computational complexity is not an issue for standard semantic benchmarks such as SimLex-999 or MEN: these data sets require only N gt similarity computations in total, where N gt is the number of word pairs in each benchmark (999 or 3000).
in addition, the metric should still reward models that rank relevant responses higher than non-relevant ones.