As mentioned in Section 2, some work has been done comparing MT evaluation metrics for statistical systems versus rule-based systems.
the behavior of metrics when it comes to neural MT (NMT), the new paradigm in MT research and development, has not yet been inspected.