Therefore we define that the fact extractor receives a step-wise delayed reward from the reasoner.
when the reasoner finishes exploration (at time T ) and arrives at the correct target, we consider the path is effective and positive for reasoning.