In informal experiments, we found shallow CNNs incapable to handle even the simplest random split.
it is hard to train very deep LSTMs, and it is not clear that the latter models need the same depth CNNs require to "view" long sequences.