Turning our attention to the other end of the tail, we find that just over 40 (8%) of the FNs involve tokens for which there is only a single occurrence as a cue in the training data.
these would first appear to be exactly the tokens that we could never get right, given our filtering scheme.