Note that this also allows our model to generate embedding for unseen text in the new space.
for a text input x, we can compute its embedding e using M hidden layers The first hidden layer l 0 is computed from the input x: Subsequent layers are computed recursively: Then the output from the final layer produces the embedding: f is the non-linear activation function.