On the other hand, removal of the rare tokens (words appearing in less than 20 titles) seem to Manual translation of the Japanese product title into English: Manual translation of the Japanese product title into English: Manual translation of the Japanese product title into English: Manual translation of the Japanese product title into English: have negligible effect on the context of the titles from the subset of 8000 titles.
the effect is a little more pronounced for the context of the titles from the subset of the 18 categories for which ACNN does better than GBT, but, with a mean error difference of only half of that for the other 17 categories on which it does worse.