7 The original AllenNLP library uses a byte representation.
the multilingual fork assigns a unique character id to each unicode character, thereby avoiding the need to recognize mutibyte representations.