Similar results at the lexical level have been reported using automated annotations (Prud'hommeaux and Rouhizadeh, 2012;Rouhizadeh et al., 2013).
we then calculate two above statistics for each shuffle and count the number of times the observed values exceed the values produced by the 1000 shuffles.