The reasoner helps the extractor to learn the extracting policy through providing feedbacks regarding how much the extractor contributes to the reasoning.
we define that the fact extractor receives a step-wise delayed reward from the reasoner.