The motivation for convolution is that natural language consists of long sequences in which many short subsequences contribute in a stable way to the structure and meaning of the long sequence regardless of the position of the subsequence within the long sequence.
it is advantageous to learn convolutional filters that detect a particular feature regardless of position.