Over the last few years, it has been convincingly shown the CNNs can produce rich representation of the input image by embedding it to a fixed-length vector, such that this representation can be used by a variety of vision tasks (Sermanet et al., 2013).
it is natural to use CNN as image encoder, In specific, CNN is first pre-trained for classification.