In the previously mentioned experiments we focused on more abstract features (POS tags), which we combine with punctuation marks to capture a higher-level representation of punctuation usage.
while punctuation has been included in some of these studies (e.g., in character-level models), its impact has not been studied.