Edit distance models tend to do poorly when evaluated on other metrics, as do models trained using METEOR.
training models to METEOR can be made more robust by setting α to 0.5, which balances the importance the metric assigns to precision and recall.