ported by the following experiment: We took word embeddings produced by both models on the English PTB, and applied PCA to them.
they do not consider syllables, and they experiment with relatively small models on small data sets (0.6M-1.4M tokens).