This is closely followed by two other ensemble models i.e., BERT+LASER+GBDT and BERT+LAMB, with an F1-score of 0.89.
on forwarded high activations, the notion of bigram, trigram, and quadgram holds true.