The prior art of MDTC (Wu and Huang, 2015) decomposes the text classifier into a general one and a set of domain-specific ones.
the general classifier is learned by parameter sharing and domain-specific knowledge may sneak into it.