All the data has been tokenized and segmented into sub-word symbols using Byte Pair Encoding (BPE) (Sennrich et al., 2016).
without loss of generality, we choose hierarchical clustering (Rokach and Maimon, 2005) to cluster the embedding vectors in our experiments.