It is clear that some characteristics of words (e.g., semantics) usu-ally remain the same across different roles.
it is practical to share some information across rolespecific weights so that the embeddings can benefit from more data and learn better semantic representations while leaving room for role-specific traits.