Pre-trained language models such as BERT have proven to be highly effective for natural language processing (NLP) tasks.
the high demand for computing resources in training such models hinders their application in practice.