Unlike previous pipelined approaches that contain separate models, we integrate an early-stopped retriever, a distantly-supervised reader, and a span-level answer reranker into a unified network.
we encode segments of text with pre-trained Transformer blocks (Devlin Model Retrieve Read Rerank Architecture DS-QA (Lin et al., 2018) 3 3 7 Pipeline R 3 (Wang et al., 2018a) 3 3 7 Pipeline* Extract-Select (Wang et al., 2018d) 7 3 Pipeline* V-Net (Wang et al., 2018c) 7 3 3 Unified Re-Ranker (Wang et al., 2018b) 3 3 3 Pipeline RE 3 QA 3 3 3 Unified Table 1: Comparison of RE 3 QA with existing approaches.