To demonstrate that SSAF truly improves the finetuning performance, we compare SSAF against BERT BASE from (Devlin et al., 2018) on all the tasks.
for sentiment analysis, we follow (Ambartsoumian and Popowich, 2018) to make comparisons with the following representa-1 https://github.com/google-research/bert  tive methods: Ave, LSTM, BiLSTM, and CNN from (Barnes et al., 2017); SSAN from (Ambartsoumian and Popowich, 2018).