This could be one of the reasons why models using CNN seem to have superior performance when only the best performance is reported.
the same strategy is adopted to our model when there are more than one Bi-LStM layers, in which case the input is added to the Bi-LStM layer's output.