The challenge requires a model to connect semantically related words and utterances.
we design masked content recovery tasks on both a word level and an utterance level to enhance the self-attention module in terms of awareness of the semantic connections.