With the help of automatically-mined knowledge, SKEP conducts sentiment masking and constructs three sentiment knowledge prediction objectives, so as to embed sentiment information at the word, polarity and aspect level into pre-trained sentiment representation.
the prediction of aspect-sentiment pairs is converted into multi-label classification, aiming to capture the dependency between words in a pair.