(Wick et al., 2006) report extracting database records by learning record field compatibility.
this matches our intuition: without generalizing to semantic language models, higher order language models will be relatively sparse and contain much noise.