Large part of the conversational and natural language understanding happens on the server side and then fulfilled resulting in response delays, inconsistent experience and privacy concerns.
there is a huge demand for developing on-device natural language models that work entirely on-device such as mobile phones, tablets, watches and any internet of things (IoT) devices.