Markov Chains

Markov Chains PowerPoint PPT Presentation


  • 94 Views
  • Uploaded on
  • Presentation posted in: General

2. Stochastic Processes. A stochastic process is a collection of random variablesThe index t is often interpreted as time. is called the state of the process at time t.The set T is called the index set of the process.If T is countable, the stochastic process is said to be a discrete-time

Download Presentation

Markov Chains

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


1. Markov Chains J. M. Akinpelu

2. 2 Stochastic Processes A stochastic process is a collection of random variables The index t is often interpreted as time. is called the state of the process at time t. The set T is called the index set of the process. If T is countable, the stochastic process is said to be a discrete-time process. If T is an interval of the real line, the stochastic process is said to be a continuous-time process. The state space E is the set of all possible values that the random variables can assume.

  • Login