In most extrinsic tasks, embeddings are usually used as a representation of examples which are the inputs of a classifier.
the performance on these extrinsic tasks is determined by two factors: the quality of representation and the quality of that classifier.