MARKOV PROCESS

In probability theory, a 'Markov process' is a stochastic process that has the Markov property.
Often, the term Markov chain is used to mean a discrete-time Markov process. Also see continuous-time Markov process.

Contents

See also

References

See also

★ Markov chain

★ Shift of finite type

★ Markov decision process

★ Semi-Markov process

★ Continuous-time Markov process

★ Variable-order Markov model

References

★