1 / 64

Linear Equations

Linear Equations. PSCI 702 September 21, 2005. Numerical Errors. Round off Error Truncation Error. Linear Algebraic Equations. Linear Algebraic Equations. In Matrix Format Solution:. Cramer’s Rule. M ij is the determinant of the Matrix A with the ith row and jth column removed.

Download Presentation

Linear Equations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Linear Equations PSCI 702 September 21, 2005

  2. Numerical Errors • Round off Error • Truncation Error

  3. Linear Algebraic Equations

  4. Linear Algebraic Equations • In Matrix Format • Solution:

  5. Cramer’s Rule • Mij is the determinant of the Matrix A with the ith row and jth column removed. • (-1)ij is called the cofactor of element aij.

  6. Cramer’s Rule

  7. Cramer’s Rule

  8. Cramer’s Rule • 3n2 operations for the determinant. • 3n3 operations for every unknown. • Unstable for large Matrices. • Large error propagation. • Good for small Matrices (n<20).

  9. Gaussian Elimination • Divide each row by the leading element. • Subtract row 1 from all other rows. • Move to the second row an continue the process.

  10. Gaussian Elimination

  11. Gaussian Elimination

  12. Gaussian Elimination • Back substitution

  13. Gaussian Elimination • Division by zero: May occur in the forward elimination steps. • Round-off error: Prone to round-off errors.

  14. Gaussian Elimination Consider the system of equations: Use five significant figures with chopping = At the end of Forward Elimination =

  15. Gaussian Elimination Back Substitution

  16. Gaussian Elimination Compare the calculated values with the exact solution

  17. Improvements Increase the number of significant digits Decreases round off error Does not avoid division by zero Gaussian Elimination with Partial Pivoting Avoids division by zero Reduces round off error

  18. Partial Pivoting Gaussian Elimination with partial pivoting applies row switching to normal Gaussian Elimination. How? At the beginning of the kth step of forward elimination, find the maximum of If the maximum of the values is In the pth row, then switch rows p and k.

  19. Partial Pivoting What does it Mean? Gaussian Elimination with Partial Pivoting ensures that each step of Forward Elimination is performed with the pivoting element |akk| having the largest absolute value.

  20. Partial Pivoting: Example Consider the system of equations In matrix form = Solve using Gaussian Elimination with Partial Pivoting using five significant digits with chopping

  21. Partial Pivoting: Example Forward Elimination: Step 1 Examining the values of the first column |10|, |-3|, and |5| or 10, 3, and 5 The largest absolute value is 10, which means, to follow the rules of Partial Pivoting, we switch row1 with row1. Performing Forward Elimination

  22. Partial Pivoting: Example Forward Elimination: Step 2 Examining the values of the first column |-0.001| and |2.5| or 0.0001 and 2.5 The largest absolute value is 2.5, so row 2 is switched with row 3 Performing the row swap

  23. Partial Pivoting: Example Forward Elimination: Step 2 Performing the Forward Elimination results in:

  24. Partial Pivoting: Example Back Substitution Solving the equations through back substitution

  25. Partial Pivoting: Example Compare the calculated and exact solution The fact that they are equal is coincidence, but it does illustrate the advantage of Partial Pivoting

  26. Gauss Jordan Elimination • Start with the following system of Matrices. • Divide each row by the leading element. • Subtract row 1 from all other rows. • In addition to subtracting the line whose diagonal term has been made unity from all those bellow it, also subtract from the equations above it as well.

  27. Gauss Jordan Elimination

  28. Matrix Factorization • Assume A can be written as A=VU where V and U are triangular Matrices.

  29. Matrix Factorization Proof If solving a set of linear equations If Then Multiply by Which gives Remember which leads to Now, if then Now, let Which ends with and (1) (2)

  30. Matrix Factorization How can this be used? Given Decompose into and Then solve for And then solve for

  31. Matrix Factorization How is this better or faster than Gauss Elimination? Let’s look at computational time. n = number of equations To decompose [A], time is proportional to To solve and time is proportional to

  32. Matrix Factorization Therefore, total computational time for LU Decomposition is proportional to or Gauss Elimination computation time is proportional to How is this better?

  33. Matrix Factorization What about a situation where the [C] vector changes? In VU factorization, VU decomposition of [A] is independent of the [C] vector, therefore it only needs to be done once. Let m = the number of times the [C] vector changes The computational times are proportional to VU factorization = Gauss Elimination= Consider a 100 equation set with 50 right hand side vectors VU factorization = Gauss Elimination =

  34. Matrix Factorization Another Advantage Finding the Inverse of a Matrix VU Factorization Gauss Elimination For large values of n

  35. Matrix Factorization Method: Decompose [A] to [V] and [U] [U] is the same as the coefficient matrix at the end of the forward elimination step. [V] is obtained using the multipliers that were used in the forward elimination process

  36. Matrix Factorization Finding the [U] matrix Using the Forward Elimination Procedure of Gauss Elimination

  37. Matrix Factorization Finding the [U] matrix Using the Forward Elimination Procedure of Gauss Elimination

  38. Matrix Factorization Finding the [V] matrix Using the multipliers used during the Forward Elimination Procedure From the first step of forward elimination From the second step of forward elimination

  39. Matrix Factorization Does ?

  40. Matrix Factorization Example: Solving simultaneous linear equations using VU factorization Solve the following set of linear equations using VU Factorization Using the procedure for finding the [V] and [U] matrices

  41. Matrix Factorization Example: Solving simultaneous linear equations using VU factorization Complete the forward substitution to solve for

  42. Matrix Factorization Example: Solving simultaneous linear equations using VU factorization Set Solve for The 3 equations become

  43. Matrix Factorization Example: Solving simultaneous linear equations using VU factorization From the 3rd equation Substituting in a3 and using the second equation

  44. Matrix Factorization Example: Solving simultaneous linear equations using VU factorization Substituting in a3 and a2 using the first equation Hence the Solution Vector is:

  45. Gauss Method An iterative method. • Basic Procedure: • Algebraically solve each linear equation for xi • Assume an initial guess solution array • Solve for each xi and repeat • Use absolute relative approximate error after each iteration to check if error is within a prespecified tolerance.

  46. Gauss Method Why? The Gauss Method allows the user to control round-off error. Elimination methods such as Gaussian Elimination and VU Factorization are prone to round-off error. Also: If the physics of the problem is understood, a close initial guess can be made, decreasing the number of iterations needed.

  47. Gauss Method Algorithm A set of n equations and n unknowns: If: the diagonal elements are non-zero Rewrite each equation solving for the corresponding unknown ex: First equation, solve for x1 Second equation, solve for x2 . . . . . .

  48. Gauss Method Algorithm Rewriting each equation From Equation 1 From equation 2 From equation n-1 From equation n

  49. Gauss Method Algorithm General Form of each equation

  50. Gauss Method Gauss Algorithm General Form for any row ‘i’ How or where can this equation be used?

More Related