Compared with other QA data collection tasks, human involvement in FreebaseQA is relatively light since each person only needs to make a one-out-of-three choice instead of composing a question or sentence from scratch.
using this method, we may significantly reduce the cost of QA data collection.