The first idea that comes to mind, is to use the same model while treating various features as word-like elements.
we could simply assume that the contexts we wish to model are the union of all our features.