WordPiece is adopted to tokenize sequence in BERT, which may cut a word into pieces, such as converting "Johanson" into "Johan ##son".
additional efforts should be taken to maintain alignments between input tokens and their corresponding labels.