In order to capture much more information from different input sequences, VPN employs a multi-pass encoder, which contains three different encoders in order: raw-word encoder, low-level encoder and highlevel encoder.
the multi-pass encoder is able to encode more and more abstractive infor-mation from words to clusters.