The experiments described above lead to the conclusion that we need a hamza module that can take the raw text and restore the hamzas if necessary, before the text is passed to the diacritization system.
the first step towards this problem is a system that reaches a high accuracy in an in-vitro evaluation, i.e.