Firstly, while they can be pretrained with large amounts of data to learn semantic and syntactic similarities between words, each vector is independent.
even though models based on word lookup tables are often observed to learn that cats, kings and queens exist in roughly the same linear correspondences to each other as cat, king and queen do, the model does not represent the fact that adding an s at the end of the word is evidence for this transformation.