Although MCMC performs well, the distribution from which the sample is obtained is only an approximation of the target sampling distribution.
samples obtained from such distributions may produce some bias in sample statistics, like sampling mean.