Based on the original annotations, all human name translations were much better than our SMT system.
based on our re-annotation, the results are quite different: our system has a higher NEWA score and better name translations than 3 out of 4 human annotators.