As a second method of measuring the extent to which sensitive information remains in the trained embeddings, we train a feedforward neural network to try and predict the attributes of a human entity from their embedding alone.
the input to the network is the embedding of dimension d, and the output is a softmax distribution over labels (male and female for gender).