Even if (similarly to WIKIHOP creators) one considers a coarse-to-fine approach, where a set of potentially relevant documents is provided, re-encoding them in a query-specific way remains the bottleneck.
to other proposed methods (e.g., (Dhingra et al., 2018;Raison et al., 2018;Seo et al., 2016)), we avoid training expensive document encoders.