It seems that the additional information supplied by the agreement features is not useful enough to outweigh sparse data problems caused by the more fine-grained label set.
we only use case, but designing a smoothing procedure allowing us to use number, gender, and degree is interesting future work.