In this paper, we reimplemented 2 and tailored this approach to segmenting hashtags by using a language model specifically trained on Twitter data (implementation details in §3.6).
after reexamination, we found annotation errors in 6.8% 5 of the hashtags in this dataset, which is significant given that the error rate of the state-of-theart models is only around 10%.