Manually annotating word-level quality labels is time-consuming and expensive; on the other hand, post-editing translated sentences is  commonly part of the workflow of crowd-sourced and professional translation services.
getting quality labels for free from sentences that have already been post-edited is a much more realistic and sustainable process.