In most previous work on KB completion to predict missing relation facts (Mintz et al., 2009;, the methods are evaluated on a subset of facts from a single KB snapshot, that are hidden while training.
given that the missing entries are usually selected randomly, the distribution of the selected unknown entries could be very different from the actual missing facts distribution.