around 26% of the cases we observe a decreased MAP score, which is on average 0.16 smaller then the scores achieved with the baseline.
figure 2 shows the case, where the ranking is performed correctly, but the precise substitute is not annotated as a correct one.