The highest accuracy and macro F-score are achieved when all types of features are used in combination with the "Rules + Features + Rules as Features" architecture.
this system achieves an accuracy of 53.4% and a macro F-score of 36.6% on the 2000-instance test set.