Each step, the algorithm chooses the highest score action to perform according to the linear model: Here, is the weight vector and is the feature representation.
( ( ) ( )) denotes features extracted from p i .