In Section 3, we indicated that the positions of rests and their durations are important factors for modeling boundaries of lyrics.
we collect a sequence of notes and rests around the current word position (i.e., time step t) and encode their information into context melody vector n t (see the bottom of Figure 5).