Our evaluation metric is human assessment: Can the translation provided by the system be part of an acceptable translation of the whole sentence?
the noun phrase has to be translated correctly given the sentence context.