One possible solution is to merely discard (less important) words from the vocabulary, which can straightforwardly reduce the memory requirement.
such a naive method can cause another well-known drawback regarding the inapplicability of OOV words.