4): While for the similarity task scores are always calculated pairwise, for spotting the outlier two different methods were tested: the pairwise comparisons and the cluster prototype.
workshops such as RepEval have been organized with the explicit purpose of finding alternative evaluation tasks for DSMs.