A clear understanding of those strengths and weaknesses is important to guide further work.
given the idiosyncratic limitations of recurrent and selfattentional models, combining them is an exciting line of research.