Besides, P1 P2 P3 P4 P5 P6 P7 if we compare P1 and P2, we will notice that P2 performs just slightly worse than P1 on easy cases, but much better than P1 on difficult cases.
conventional evaluation metric rank P1 as the top system because the P1 gets a lot of credits from a large portion of easy cases.