These induced features represent the information about the derivation history which the training process has decided is relevant to estimating the output probabilities.
this model is making no a priori hard independence assumptions, just a priori soft biases.