We see that the model primarily loses out on the text based measure, and performs quite well on the type based one.
this issue can potentially be mitigated with either a more sophisticated tagger module or a better stopword/symbol removal mechanism, which we leave to future work.