It is a slightly modified version of Goldberg and Nivre (2013)'s algorithm 3, an approach they called learning with exploration.
each v i (Section 2) is the embedding of the i th instantiated symbol of this list.