The aforementioned prior work mostly focuses on building the best neural network model independent of any model size or memory constrains.
recent work by Kozareva, 2018, 2019) show the importance of building ondevice text classification models that can preserve user privacy, provide consistent user experience and most importantly are compact in size, while yet achieving state-of-art results.