Especially in the pun detection task, we observe that our model requires longer contexts (more than 20 words) to detect the homographic puns.
shorter contexts (less than 10 words) are adequate for heterographic pun detection, which indicates the contribution from phonological features.