We show that in order to produce helpful feedback for responsebased learning, parser performance on incorrect En-glish queries needs to be taken into account, which is standardly ignored in parser evaluation.
for the purpose of parsing translated queries, a parser should retrieve correct answers for correct English queries (true positives), and must not retrieve correct answers for incorrect translations (false positives).