Specifically, we first tokenize the question and  Figure 2: An illustration of MTMSN architecture.
the passage using the WordPiece vocabulary (Wu et al., 2016), and then generate the input sequence by concatenating a [CLS] token, the tokenized question, a [SEP] token, the tokenized passage, and a final [SEP] token.