Although end-to-end deep learning has made great progress in natural language processing, no one has yet applied it to CLS due to the lack of large-scale supervised dataset.
in this work, we introduce a novel approach to directly address the lack of data.