However, a standard language modeling objective does not lead to a model that handles the two challenges mentioned above; in addition, other systematic issues limit its ability to handle TCS.
language models do not directly utilize the ordinal relationships among temporal units.