We show that it can be formulated as a contextual bandit problem if we select the sentences sequentially.
for each document, the context includes its documentary representation learned through rough reading.