In the scoring module, we make final predictions based on the last pass attention of memory module and the context vector c. Note that GAS only uses the original gloss, while GAS ext uses the entended glosses through hypernymy and hyponymy relations.
the relation fusion layer (grey dotted box) only belongs to GAS ext .