1 / 93

PART 3 Random Processes

PART 3 Random Processes. Huseyin Bilgekul Eeng571 Probability and astochastic Processes Department of Electrical and Electronic Engineering Eastern Mediterranean University. Random Processes. Kinds of Random Processes.

orpah
Download Presentation

PART 3 Random Processes

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PART 3Random Processes Huseyin Bilgekul Eeng571 Probability and astochastic Processes Department of Electrical and Electronic Engineering Eastern Mediterranean University

  2. Random Processes

  3. Kinds of Random Processes

  4. A RANDOM VARIABLEX, is a rule for assigning to every outcome, w, of an experiment a number X(w). Note: X denotes a random variable and X(w) denotes a particular value. A RANDOM PROCESSX(t) is a rule for assigning to every w, a function X(t,w). Note: for notational simplicity we often omit the dependence on w. Random Processes

  5. Conceptual Representation of RP

  6. Ensemble of Sample Functions The set of all possible functions is called the ENSEMBLE.

  7. Random Processes • A general Random or Stochastic Process can be described as: • Collection of time functions (signals) corresponding to various outcomes of random experiments. • Collection of random variables observed at different times. • Examples of random processes in communications: • Channel noise, • Information generated by a source, • Interference. t1 t2

  8. Random Processes Let denote the random outcome of an experiment. To every such outcome suppose a waveform is assigned. The collection of such waveforms form a stochastic process. The set of and the time index t can be continuous or discrete (countably infinite or finite) as well. For fixed (the set of all experimental outcomes), is a specific time function. For fixed t, is a random variable. The ensemble of all such realizations over time represents the stochastic

  9. Random Process for a Continuous Sample Space

  10. Random Processes

  11. Wiener Process Sample Function

  12. Sample Sequence for Random Walk

  13. Sample Function of the Poisson Process

  14. Random Binary Waveform

  15. Autocorrelation Function of the Random Binary Signal

  16. Example

  17. Random Processes Introduction (1)

  18. A random process is a process (i.e., variation in time or one dimensional space) whose behavior is not completely predictable and can be characterized by statistical laws. Examples of random processes Daily stream flow Hourly rainfall of storm events Stock index Introduction

  19. Random Variable • A random variable is a mapping function which assigns outcomes of a random experiment to real numbers. Occurrence of the outcome follows certain probability distribution. Therefore, a random variable is completely characterized by its probability density function (PDF).

  20. STOCHASTIC PROCESS

  21. STOCHASTIC PROCESS

  22. STOCHASTIC PROCESS

  23. The term “stochastic processes” appears mostly in statistical textbooks; however, the term “random processes” are frequently used in books of many engineering applications. STOCHASTIC PROCESS

  24. STOCHASTIC PROC ESS

  25. First-order densities of a random process A stochastic process is defined to be completely or totally characterized if the joint densities for the random variables are known for all times and all n. In general, a complete characterization is practically impossible, except in rare cases. As a result, it is desirable to define and work with various partial characterizations. Depending on the objectives of applications, a partial characterization often suffices to ensure the desired outputs. DENSITY OF STOCHASTIC PROCESSES

  26. For a specific t, X(t) is a random variable with distribution . The function is defined as the first-order distribution of the random variable X(t). Its derivative with respect to x is the first-order density of X(t). DENSITY OF STOCHASTIC PROCESSES

  27. If the first-order densities defined for all time t, i.e. f(x,t), are all the same, then f(x,t) does not depend on t and we call the resulting density the first-order density of the random process ; otherwise, we have a family of first-order densities. The first-order densities (or distributions) are only a partial characterization of the random process as they do not contain information that specifies the joint densities of the random variables defined at two or more different times. DENSITY OF STOCHASTIC PROCESSES

  28. Mean and variance of a random process The first-order density of a random process, f(x,t), gives the probability density of the random variables X(t) defined for all time t. The mean of a random process, mX(t), is thus a function of time specified by MEAN AND VARIANCE OF RP • For the case where the mean of X(t) does not depend on t, we have • The variance of a random process, also a function of time, is defined by

  29. Second-order densities of a random process For any pair of two random variables X(t1) and X(t2), we define the second-order densities of a random process as or . Nth-order densities of a random process The nth order density functions for at times are given by or . HIGHER ORDER DENSITY OF RP

  30. Given two random variables X(t1) and X(t2), a measure of linear relationship between them is specified by E[X(t1)X(t2)]. For a random process, t1 and t2 go through all possible values, and therefore, E[X(t1)X(t2)] can change and is a function of t1 and t2. The autocorrelation function of a random process is thus defined by Autocorrelation function of RP

  31. Autocovariance Functions of RP

  32. Strict-sense stationarity seldom holds for random processes, except for some Gaussian processes. Therefore, weaker forms of stationarity are needed. Stationarity of Random Processes

  33. PDF of X(t) X(t) Time, t Stationarity of Random Processes

  34. Wide Sense Stationarity (WSS) of Random Processes

  35. Equality Note that “x(t, i) = y(t, i) for every i” is not the same as “x(t, i) = y(t, i) with probability 1”. Equality and Continuity of RP

  36. Equality and Continuity of RP

  37. Mean square equality Mean Square Equality of RP

  38. Equality and Continuity of RP

  39. Random Processes Introduction (2)

  40. Stochastic Continuity

  41. Stochastic Continuity

  42. Stochastic Continuity

  43. Stochastic Continuity

  44. Stochastic Continuity

  45. Stochastic Continuity

  46. A random sequence or a discrete-time random process is a sequence of random variables {X1(), X2(), …, Xn(),…} = {Xn()}, . For a specific , {Xn()} is a sequence of numbers that might or might not converge. The notion of convergence of a random sequence can be given several interpretations. Stochastic Convergence

  47. The sequence of random variables {Xn()} converges surely to the random variable X() if the sequence of functions Xn() converges to X() as n  for all , i.e., Xn() X() as n  for all . Sure Convergence (Convergence Everywhere)

More Related