(Ravi and Kozareva, 2018) bypasses the need for complex networks with huge parameters but its overall accuracy is 4.2% behind our system, despite being 0.2% higher on SwDA.
learning long-range dependencies is a challenge because of noisier and longer path lengths in the network.