Thanks.
I am not sure whether or not it is nested model. If I can added the sex
cofactor into Markov model directly, I think there is no problem for
likelihood ratio test. But the sex coefficient is very difficult to estimate
using maximum likelihood estimation. So I have to split the dataset into
two parts according to sex and then compare the likelihood before splitting
and after splitting.