Finally, as a final (and perhaps thoughtprovoking) finding, the highest attention weights associated to the emoji were given to the words game, boys and football, in that order.
the model relies more on the word boys than on the actual description of the emoji.