We observe that before finetuning, the attention patterns on [SEP] tokens and periods is almost identical between sentences.
after finetuning, the model attends to sentences differently, likely based on their different role in the sentence that requires different contextual information.