Furthermore, we used the interface to calibrate our task for changing parameters such as the amount of time required to complete a rating task, and the desired accuracy level to derive the payment.
crowdsourcing is prone to spammers trying to get paid without performing the task.