There is no significant difference between the F1 scores of our method and the § ¡ ¦ £ ¥ § ¦ © & method with hierarchical structure.
performance on the original training set using SVMs is 0.285 and using NB is 0.519, so this is a difficult learning task and generalization to the test set is quite reasonable.