We use a slightly different notation in this section: for a word w the ith component of its embedding is given by E w,i .
we denote as E •,1 the first column of E (i.e., the most interpretable dimension).