This is in contrast to Ir-  2014, who experimented with Elman-type networks and found some improvements using multiple layers of Bi-RNNs.
the performance of the bidirectional recurrent network (Bi-RNN) is somewhat lower, especially on the test set.