The f0 and E features are processed at the word level: each sequence of frames corresponding to a time-aligned word (and potentially its surrounding context) is convolved with N filters of m sizes (a total of mN filters).
figure 3 demonstrates one case where the pause feature helps in correcting a PP attachment error made by a text-only parser.