ELMo CI uses only the context-insensitive character embeddings produced by ELMo.
a model trained with 25 codes 6 achieves greater than 60% recall at labeling the ground truth trees for WSJ-10, indicating the codes represent some syntactic patterns although not as effectively as when using K-means.