We quantify the performance gain of each inductive bias we incorporated in the DNPG model.
we compare the DNPG with three variants: one with vanilla attention modules, one with vanilla positional encoding and the one uses vanilla softmax.