Compared to only including the features, the model can benefit from adding both, the character level layer and the pretrained word vectors, while the results for tagging proper nouns and articles are still slightly worse than the baseline.
the final experimental setup can optimize the results for every POS tag compared to the baseline, see figure 3.