We use the validation set (SE7) to find the optimal hyper parameters of our models: the word embedding size d w , the hidden state size d s of LSTM, the optimizer, etc.
since there are no adverbs and adjectives in SE7, we randomly sample some adverbs and adjectives from training dataset into SE7 for validation.