It is because wrong translation is also likely to get aligned with the source as it can be the translation of the source words in some other contexts.
reference gives us a pointer to the correct word choice in the given context, hence helping determining W label.