This pipeline addressed the data sparsity by initializing the model with word embeddings which is trained from large unlabeled text corpus.
the convolution layer is not the best way to model long distance dependency since it only includes words within limited context.