There is no guarantee that one observed continuous variable has the same number of gaussians for all hidden states.