We filter the verbs and adjectives through a list of sentiment words (Hu and Liu, 2004) to ensure we do not choose REs that would obviously significantly alter the text's sentiment.
our second model makes use of the transformer architecture, and our implementation replicates Vaswani et al.