This intuition can be implemented in a number of ways in practice; in this work, we focus on models that represent word meaning as a point in a metric space (Widdows, 2005;Sahlgren, 2006;Turney and Pantel, 2010;Clark, 2015).
one member of this family that has been particularly influential recently is the skip-gram learning algorithm (Mikolov et al., 2013a), which is derived from the log-bilinear language model by Mnih and Hinton (2007).