The literature result for CREE (Meurers et al., 2011a) is not completely comparable, as it was computed on the held-out test set that does not satisfy the unseen question task.
it is not surprising that our model does somewhat worse on a purely unseen question evaluation.