A likely reason for this observation may be that sharing highlevel features with the retriever could disturb the reading prediction.
the above results demonstrate that an early-stopped retriever with a relatively small J is able to reach a good trade-off between efficiency and effectiveness.