Because HMMs are equivalent to probabilistic regular grammars, we can extend HMMs with both LVGs and LVeGs.
the hidden states in HMMs can be seen as nonterminals in regular grammars and therefore can be associated with latent variables or latent vectors.