Using phonological character representations instead yields an improvement of +0.47 F1 and a further +0.8 F1 with attention.
phonological representations benefit more from attention applied over them to beat out orthographic representations in that scenario.