If systems are to be deployed into situations where such deficiencies might matter, it might be necessary to find more appropriate evaluation methods.
they report a variety of performance statistics for a set of 41 challenging-looking sentences from German computer magazines.