- 92 Views
- Uploaded on
- Presentation posted in: General

Scientific Computing

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Linear Systems – Gaussian Elimination

- Solve Ax=b, where A is an nnmatrix andb is an n1 column vector
- We can also talk about non-square systems whereA is mn, b is m1, and x is n1
- Overdetermined if m>n:“more equations than unknowns”
- Underdetermined if n>m:“more unknowns than equations”

- A is singular if some row islinear combination of other rows
- Singular systems can be underdetermined:or inconsistent:

- To solve Ax = b it would be nice to use the inverse to A, that is, A-1
- However, it is usually not a good idea to compute x=A-1b
- Inefficient
- Prone to roundoff error

- Fundamental operations:
- Replace one equation with linear combinationof other equations
- Interchange two equations
- Multiply one equation by a scalar

- These are called elementary row operations.
- Do these operations again and again to reduce the system to a “trivial” system

- Two special forms of matrices are especially nice for solving Ax=b:
- In both cases, successive substitution leads to a solution

- A is lower triangular

- Solve by forward substitution:

- Solve by forward substitution:

- Solve by forward substitution:

Etc

- If A is upper triangular, solve by back-substitution:

- Solve by back-substitution:

Etc

- Do elementary row operations on the augmented system [A|b] to reduce the system to upper triangular form.
- Then, use back-substitution to find the answer.

- Example:
- Augmented Matrix form:

- Row Ops: What do we do to zero out first column under first pivot?
- Zero out below second pivot:

- Back-substitute

- Task: Implement Gaussian Elimination (without pivoting) in a Matlab M-file.
- Notes
- Input = Coefficient matrix A, rhs b
- Output = solution vector x

- Class Exercise: We will go through this code line by line, using the example in Pav section 3.3.2 to see how the code works.

- Matlab:
- >> A=[2 1 1 3; 4 4 0 7; 6 5 4 17; 2 -1 0 7]
- A =
- 2 1 1 3
- 4 4 0 7
- 6 5 4 17
- 2 -1 0 7
- >> b = [7 11 31 15]'
- b =
- 7
- 11
- 31
- 15

>> gauss_no_pivot(A,b)

ans =

1.5417

-1.4167

0.8333

1.5000

- Class Exercise: How would we change the Matlab function gauss_no_pivot so we could see the result of each step of the row reduction?

- Consider this system:
- We immediately run into a problem:we cannot zero out below pivot, or back-substitute!
- More subtle problem:

- Conclusion: small diagonal elements are bad!
- Remedy: swap the row with the small diagonal element with a row below, this is called pivoting

- Our Example:
- Swap rows 1 and 2:
- Now continue:

- Two strategies for pivoting:
- Partial Pivoting
- Scaled Partial Pivoting

- Partial Pivoting:
- At step k, we are working on kth row, pivot = Akk . Search for largest Aik in kth column below (and including) Akk . Let p = index of row containing largest entry.
- If p ≠ k, swap rows p and k.
- Continue with Gaussian Elimination.

- Finding largest entry in a column:
- >> A
- A =
- 2 1 1 3
- 4 4 0 7
- 6 5 4 17
- 2 -1 0 7
- >> [r,m] = max(A(2:4,2))
- r =
- 5
- m =
- 2

- Why isn’t m = 3?

- Swapping rows m and k:
- BB =
- 2 1 1 3
- 4 4 0 7
- 6 5 4 17
- 2 -1 0 7
- >> BB([1 3],:) = BB([3 1], :)
- BB =
- 6 5 4 17
- 4 4 0 7
- 2 1 1 3
- 2 -1 0 7

- Code change?
- All that is needed is in main loop (going from rows k ->n-1) we add
- % Find max value (M) and index (m) of max entry below AAkk
- [M,m] = max(abs(AA(k:n,k)));
- m = m + (k-1); % row offset
- % swap rows, if needed
- if m ~= k, AA([k m],:) = AA([m k],:);
- end

- Class Exercise
- Review example in Moler Section 2.6

Pav, Section 3.2

- Class Exercise: We will work through the example in Pav, Section 3.2.2

- Class Exercise: Do Pav Ex 3.7 for partial pivoting (“naïve Gaussian Elimination”).
- Do Pav Ex 3.7 for scaled partial pivoting.