For instance, RL systems built with more complicated user simulators will have lower scores on the automatic metrics, compared to those built using simpler user simulators.
the good performance may not necessarily transfer when the system is tested by real users.