This indicates that the entity specific model architecture is more efficient in capturing the sort of information required for this knowledge probing task than the general encoderdecoder architecture used by T5.
when T5 is enhanced with an extra pre-training steps focusing on likely answer spans from Wikipedia (T5-11B + SSM) its performance leapfrogs that of EAE.