We perform significance test for these two improvements, and they are both significant under one-tailed t-test (p < 0.05).
when adding the third attention level, the performance does not promote much and almost reaches its plateau.