When we decrease during training, will stay away from core words.
the most important message in the experiments is a suitable manual constraint will certainly help the network extract more effective, robust features and achieves a better score than traditional attention mechanism does.