Second, we identified words that may be indicative of comments that are over-and underpredicted by the graph-structured model without text and for which the graph-LSTM model with text reduced the error by more than 2 levels.
we choose those words w in comments having the highest ratio r = p(w|t)/p(w), where t indicates an over-or underpredicted comment, subject to minimum occurrence constraints (5 for overpredicted comments, 15 for underpredicted comments).