The intuition behind incorporating pre-trained vectors is that they might help the model recognize bridging references of those involving synonyms (e.g., a house ... the home).
we compare the following options: • Random: The embedding is initialized randomly.