The number of heads is set to 8.
we think that the low performance on big AMR graphs is mainly attributed to two reasons: • Big AMR graphs are usually mapped into long sentences while seq2seq model tends to stop early for long inputs.