We expect all the models to implicitly capture aspects of world knowledge.
the discrete latent variable models provide Viterbi alignments over the training data, from which we can compile a look-up table with the extracted knowledge.