The recurrences of single-layer T-GRU, T-LSTM, and QRNN are rational.
a single-layer d-dimensional QRNN using K-window convolutions can be recovered by a set of d WFSAs, each with O(2 |⌃| K 1 ) states.