We propose to select vocabulary subset based on the dropout ratio by using a threshold α T .
the remaining vocabulary subset is described as follows: where we useV to denote the subset vocabulary of interest, by adjusting α T we are able to control the selected vocabulary size.