In addition to lexical features, we also extract syntactic features that can inform the model on any anomaly in the structure of the query.
we annotate the query with POS-tags using SyntaxNet POS tagger (Alberti et al., 2015) and extract POS-1, 2, 3-grams.