Loading in 5 sec....

Overview of Markov chainsPowerPoint Presentation

Overview of Markov chains

- 67 Views
- Uploaded on

Download Presentation
## PowerPoint Slideshow about 'Overview of Markov chains' - kamala

**An Image/Link below is provided (as is) to download presentation**

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

### Overview of Markov chains

David Gleich

Purdue University

Network & Matrix Computations

Computer Science

15 Sept 2011

Lots of words

transient

recurrent

primitive

regular

ergodic

periodic

irreducible

Perron root

Perron vector

stationary distribution

first transition analysis

Cesáro limit

reversible Markov chain

simple stationary distribution

Perron-Frobenius theorem

Some theory

- Theorem Let A ≥ 0 be irreducible then A has a unique positive eigenvector with eigenvalue equal to the spectral radius of A.

In German

Oskar Perron, MathematischeAnnalen, 64:248-263, 1907 doi: 10.1007/BF01449896

Important application

- PageRank
- centrality measures
- spectral graph theory
- random sampling

Probable outline

- Stochastic processes, Markov chains, and random walks, and stochastic matrices
- The Perron-Frobenius theorem and stationary distribution
- Hitting times, commute times, and other transition related problems

Download Presentation

Connecting to Server..