In this study, we present Vocabulary Pyramid Networks (VPN) to tackle the issues of one fixed vocabulary and one-pass decoding simultaneously.
vPN incorporates multipass encoding and decoding with multi-level vocabularies into response generation.