We performed error analysis on our development set by randomly choosing 100 word errors from the WER alignment and manually annotating them with relevant features.
for each word error we recorded whether or not the error contained punctuation (either in the predicted word or the gold word), whether the text in the corresponding portion of the original image was italicized, and whether the corresponding portion of the image exhibited over-inking, missing ink, or significant ink blotches.