It has a convolutional layer generating aspect features via ReLU activation function, which controls the magnitude of the sentiment signals according to the given aspect information.
the sigmoid function in GTU and GLU has the upper bound +1, which may not be able to distill sentiment features effectively.