As opposed to early work studying the change in word frequency over time to detect semantic change (Michel et al., 2011), here we are interested in detecting words that have undergone semantic change based purely on their context.
to avoid any bias towards words that have appeared at a certain point in time (e.g., "facebook"), we focus strictly on the words that appear every year, yielding a vocabulary of 168,362 unique words.