Specifically, we restrict the action space to be the same as the baselines by considering only term pairs in the hypernym graph, rather than all |V | × |T | possible term pairs.
it is possible that at some point no more hypernym candidates can be found but the remaining vocabulary is still not empty.