For instance, a bag-of-words (BOW) model uses one-hot encoding as vectors and it is still a strong baseline for many tasks.
averaging vectors discards any word order information from the original text, which can be fundamental for more involved NLP problems.