Instead of relying solely on the particular letters that surround the focus letter, we postulate that the learner could achieve better generalization if it had access to information about the types of letters that appear before and after.
instead of treating letters as abstract symbols, we would like to encode knowledge of the similarity between certain letters as features.