For textual networks, when the embedding objective is network topology reconstruction, a natural choice is to treat the text as context (Tu et al., 2017).
when modeling the edge w uv , S v and S u are respectively treated as the context for context-aware embeddings z u|c and z v|c , which are then used in the prediction of edge likelihood.