A simple lexicon-based constraint during inference time may also correct this case.
hard-constraint baselines can hardly improve the performance in general because the contributions of different constraints are not learned and their combination may not lead to better predictions.