This bag-of-words encoding of minimal units dramatically reduces the vocabulary size but it inevitably maps different MTUs to the same encoding.
informally, we can think of MTUs as small phrase pairs that cannot be broken down any further without violating the two requirements.