However, removing PE in the entire model greatly degrades the performance (from 34.71 to 14.47).
for SP, removing PE from our proposed attention variant dramatically degrades the performance (from 24.28 to 30.92).