Models of query correction in previous work were trained and evaluated using manually created querycandidate pairs.
human annotators were given a set of queries and were asked to provide a correction for each query when it needed to be rewritten.