Inspired by Luxburg (2007), we constrain the subtopic embedding to be orthogonal with each other: (3) The purpose of introducing subtopics is not to make the summary diverse.
we obtain a document representation d with a hierarchical RNN.