There are already previous attempts to intricately combine both CNN and RNN (Zhou et al., 2016), resulting to a slower model.
hCWE resorts to combine them by simply concatenating the word vectors encoded from both CNN and RNN encoders, i.e.