This helps filter human-generated distractor answers since they unlikely appear in Concept-Net.
our method never uses Concept-Net during finetuning and only observes a small subgraph of ConceptNet (about 30% Ã¢Ë†Â¼ 40% linked concepts without relations) during pre-training.