This in and of itself is not a problem for our model, as the edge weights should learn to discount this feature.
the fact that we sample edges to make inference tractable means that more informative edges could be dropped in favor of those that are only connected via a prefix features.