Contextualized word embeddings compute a representation for a target word based on the specific context the word is used within a sentence.
even more so, clustering similar arguments is a demanding task, as fine-grained semantic nuances may determine whether two arguments (talking about the same topic) are similar.