The results without position embeddings (words) show that position information is crucial for convolutional encoders.
for shallow models (Pooling and Convolutional), whereas deeper models are less effected.