As a concrete example of an error our model does make, Löwe (lion) is incorrectly predicted to have the first suffix, instead of the correct suffix (not shown) which adds an -n for accusative, genitive, and dative singular as well.
making this prediction correctly is essentially beyond the capacity of a model based purely on orthography.