Such a high entropy can contribute to the low similarity between LSTM with attention and other models.
it is reassuring that that similarity between any pairs is above random, with a sizable margin in most cases (BERT on SHAP is an exception; see supplementary materials).