These general purpose language identification models work well for longer texts which have similar editing style.
their performance drops significantly on shorter texts such as search queries and shorter tweets (Cavnar and Trenkle, 1994;Sibun and Reynar, 1996;Baldwin and Lui, 2010), as do many NLP components (Baldwin et al., 2013).