Most of these works employ traditional technique of using softmax as an activation function on top of a typical convolutional neural network (CNN).
(ii) The set of features is not optimized i.e, optimal subset of features is not extracted, instead complete feature set is appended to the word representations at the input layer.