- By
**gaura** - Follow User

- 64 Views
- Uploaded on

Lecture 2 Probability and Measurement Error, Part 1. Syllabus.

Download Presentation
## PowerPoint Slideshow about ' Lecture 2 Probability and Measurement Error, Part 1' - gaura

**An Image/Link below is provided (as is) to download presentation**

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Syllabus

Lecture 01 Describing Inverse ProblemsLecture 02 Probability and Measurement Error, Part 1Lecture 03 Probability and Measurement Error, Part 2 Lecture 04 The L2 Norm and Simple Least SquaresLecture 05 A Priori Information and Weighted Least SquaredLecture 06 Resolution and Generalized Inverses

Lecture 07 Backus-Gilbert Inverse and the Trade Off of Resolution and VarianceLecture 08 The Principle of Maximum LikelihoodLecture 09 Inexact TheoriesLecture 10 Nonuniqueness and Localized AveragesLecture 11 Vector Spaces and Singular Value Decomposition

Lecture 12 Equality and Inequality ConstraintsLecture 13 L1 , L∞ Norm Problems and Linear ProgrammingLecture 14 Nonlinear Problems: Grid and Monte Carlo Searches Lecture 15 Nonlinear Problems: Newton’s Method Lecture 16 Nonlinear Problems: Simulated Annealing and Bootstrap Confidence Intervals Lecture 17 Factor AnalysisLecture 18 Varimax Factors, Empircal Orthogonal FunctionsLecture 19 Backus-Gilbert Theory for Continuous Problems; Radon’s ProblemLecture 20 Linear Operators and Their AdjointsLecture 21 Fréchet DerivativesLecture 22 Exemplary Inverse Problems, incl. Filter DesignLecture 23 Exemplary Inverse Problems, incl. Earthquake LocationLecture 24 Exemplary Inverse Problems, incl. Vibrational Problems

Purpose of the Lecture

review random variables and their probability density functions

introduce correlation and the multivariate Gaussian distribution

relate error propagation to functions of random variables

random variables have systematics

tendency to takes on some values more often than others

in general probability is the integral

probability that d is between d1 and d2

the probability that d has some value is 100% or unity

probability that d is between its minimum and maximum bounds, dmin and dmax

Summarizing a probability density function

typical value

“center of the p.d.f.”

amount of scatter around the typical value

“width of the p.d.f.”

Several possibilities for a typical value

p(d)

d

dML

point beneath the peak or “maximum likelihood point” or “mode”

- dML≠ dmedian ≠ <d>

step 1: usual formula for mean

<d>

d

data

step 2: replace data with its histogram

Ns

≈

<d>

ds

s

histogram

step 3: replace histogram with probability distribution.

Ns

≈

<d>

s

N

p

≈

P(ds)

s

ds

probability distribution

This function grows away from the typical value:

- q(d) = (d-<d>)2

so the function q(d)p(d) is

small if most of the area is near <d> ,that is, a narrowp(d)

- large if most of the area is far from <d> , that is, a wide p(d)
- so quantify width as the area under q(d)p(d)

estimating mean and variance from data

usual formula for square of “sample standard deviation”

usual formula for “sample mean”

MabLab scripts for mean and variance

from tabulated p.d.f. p

dbar = Dd*sum(d.*p);

q = (d-dbar).^2;

sigma2 = Dd*sum(q.*p);

sigma = sqrt(sigma2);

from realizations of data

dbar = mean(dr);

sigma = std(dr);

sigma2 = sigma^2;

uniform p.d.f.

p(d)

box-shaped function

- 1/(dmax-dmin)

d

dmin

dmax

probability is the same everywhere in the range of possible values

uncorrelated random variables

no pattern of between values of one variable and values of another

when d1 is higher than its mean

d2 is higher or lower than its mean

with equal probability

in uncorrelated case

jointp.d.f.is just the product of individualp.d.f.’s

joint p.d.f.mean is a vectorcovariance is a symmetric matrix

diagonal elements: variances

off-diagonal elements: covariances

univariatep.d.f. formed from joint p.d.f.

p(d) → p(di)

behavior of di irrespective of the other ds

integrate over everything but di

covariance matrix

functions of random variables

data with measurement error

inferences with uncertainty

data analysis process

univariatep.d.f.use the chair rule

rule for transforming a univariatep.d.f.

simple example

data with measurement error

inferences with uncertainty

data analysis process

one datum, d

uniform p.d.f.

0<d<1

one model parameter, m

m = 2d

another simple example

data with measurement error

inferences with uncertainty

data analysis process

one datum, d

uniform p.d.f.

0<d<1

one model parameter, m

m = d2

multivariate example

data with measurement error

inferences with uncertainty

data analysis process

2 data, d1 , d2

uniform p.d.f.

0<d<1

for both

- 2 model parameters, m1andm2

m1 = d1+d2

m2 = d2-d2

(A)

m2=d1-d1

-1

-1

1

-1

p(d1)

1

0

d2

1

1

m1=d1+d1

d1

d1

(B)

(D)

-1

-1

Note that the shape in m is different than the shape in d

1

-1

0.5

p(m1)

m2

0

1

1

2

2

m1

m1

(A)

m2=d1-d1

-1

-1

1

-1

p(d1)

1

0

d2

1

1

m1=d1+d1

d1

d1

(B)

(D)

-1

-1

- The shape is a square with sides of length √2. The amplitude is ½. So the area is ½⨉√2⨉√2 = 1

1

-1

0.5

p(m1)

m2

0

1

1

2

2

m1

m1

moral

p(m) can behavior quite differently from p(d)

Download Presentation

Connecting to Server..