After the merge layer, we also add a dense feedforward layer to test whether its inclusion has an impact on the results.
we conducted experiments to test the influence of a dense feedforward layer before softmax to determine the type of class from L. We run experiments using the same architecture with BiLSTMs as well as (unidirectional) LSTMs.