However, the property also hinders its parallelizability thus RNNs are slow to execute on modern hardware optimized for parallel execution.
a number of more parallelizable sequence models were proposed such as ConvS2S (Gehring et al., 2017) and the Transformer (Vaswani et al., 2017).