One might expect that with the increased number of types, the embedding model would perform better than the classifier since they share parameters across types.
despite the recent popularity of embedding models in NLP, linear model still performs better in our task.