However, we observed that such a simple approach could easily lead to under-sized vocabulary or oversized vocabulary issues.
we are interested in understanding how the end-task classification accuracy is related to the vocabulary size and what is the minimum required vocabulary size to achieve a specific performance.