The much bigger number of incorrect labels from the baseline redecoding badly pollute the encoded knowledge.
following (Jiang et al., 2013), we first train the supervised baseline model, and use it to estimate the potential contribution for each sentence in the Wikipedia training data.