2 Automatic speech recognition (ASR) of conversational speech is an extremely difficult problem.
we judge the quality of Mechanical Turk data by comparing the performance of one LVCSR system trained on Turker annotation and another trained on professional transcriptions of the same dataset.