At last, we note that our architecture focuses on improving the efficiency of recurrent layers.
the whole parameter and computational cost reduction depend on the ratio of recurrent layer in the entire network.