It can be argued that quantitative evaluation is the single most important driver for advancing the state of the art in language processing technology today.
evaluation metrics and methodologies need to be carefully considered to insure that they provide proper guidance to researchers.