We train the encoder parameters θ on a downstream task via gradient-based optimization.
we train NLPROLOG with backpropagation using a learning from entailment setting (Muggleton and Raedt, 1994), in which the model is trained to decide whether a Prolog program R entails the truth of a candidate triple c ∈ C, where C is the set of candidate triples.