This however, is  impractical since the relevance decision is dependent on the game context, and is hence specific to each time step of each game instance.
for the purposes of this evaluation, we modify the game manual by adding to it sentences randomly selected from the Wall Street Journal corpus (Marcus et al., 1993) -sentences that are highly unlikely to be relevant to game play.