The second layer leverages the external knowledge to compute F k , which consists of pair-wise knowledge score f k among all candidate n. To enhance the efficiency of the model, a softmax pruning module is applied to select high confident candidates into the second layer.
moreover, a softmax pruning is placed in between the two layers to select high confident candidates.