From Section 3., we can see that conventional evaluation measures fall short from addressing evaluation criteria.
a good measure for rank-ordering problems needs to address the following: 1. multiple ties 2. non-normal rank value distribution 3. emphasis on high-rank elements In order to demonstrate our algorithm, we start with constructing an example problem.