- 86 Views
- Uploaded on
- Presentation posted in: General

Advanced Computer Graphics Spring 2009

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Advanced Computer Graphics Spring 2009

K. H. Ko

Department of Mechatronics

Gwangju Institute of Science and Technology

- Linear Algebra
- Systems of Linear Equations
- Matrices
- Vector Spaces

- Linear Equation
- System of Linear Equations (n equations, m unknowns)

- Solve a system of n linear equations in m unknown variables
- A common problem in applications
- In most cases m = n.
- The system has three cases
- No solutions, one solution or infinitely many solutions

- How to solve the system?
- Forward elimination followed by back substitution

- A closer look at two equations in two unknowns
- When the solution method needs to be implemented for a computer, a practical concern is the amount of time required to compute a solution.

- Division is more expensive than multiplication and addition.

- 3 additions
- 3 multiplications
- 3 divisions

- 3 additions
- 5 multiplications
- 2 divisions

- Forward elimination + back substitution = Gaussian elimination

- Basic Operations for Forward Elimination

- Basic Operations for Forward Elimination

- Basic Operations for Forward Elimination

- Basic Operations for Back Substitution

- Example

- Consider

- Consider 3 equations and 3 unknowns

- If the pivot is nearly zero, the division can be a source of numerical errors.
- Use of floating point arithmetic with limited precision is the main cause.

- A better algorithm involves searching the entries with the pivot that is largest in absolute magnitude.

No division by ε. -> Numerically robust and stable.

- However, even the previous approach can be a problem.
- Swap columns to avoid such problem.
- Blackboard!!!

- Generally, for a system of n equations in n unknowns…
- Full Pivoting: Search the entire matrix of coefficients looking for the entry of largest absolute magnitude to be used as the pivot.
- If that entry occurs in row r and column c, then rows r and 1 are swapped followed by a swap of column c and column 1.
- After both swaps, the entry in row 1 and column 1 is the largest absolute magnitude entry in the matrix.

- Generally, for a system of n equations in n unknowns…
- If that entry is nearly zero, the linear system is ill-conditioned and notify the user.
- If you choose to continue, the division is performed and forward elimination begins.

- Look for a good numerical approximation instead of the exact mathematical solution.
- Useful in sparse linear systems
- Approaches
- Splitting Method
- Minimization problem

- Splitting Method

- Issues
- Convergence
- Numerical Stability

- Formulate the linear system Ax=b as a minimization problem

- Square matrices
- Identity matrix
- Transpose of a matrix
- Symmetric matrix: A = AT
- Skew-symmetric: A = -AT

- Upper echelon matrix
- U = [uij](nxm) if uij = 0 for i > j
- If m=n, upper triangular matrix

- Lower echelon matrix
- L = [lij](nxm) if lij = 0 for i < j
- If m=n, lower triangular matrix

- Elementary Row Matrices

- Elementary Row Matrices

- Elementary Row Matrices
- The final result of forward elimination can be stated in terms of elementary row matrices Ek, … E1 applied to the augmented matrix [A|b].
- [U|v] = Ek… E1[A|b]

- The final result of forward elimination can be stated in terms of elementary row matrices Ek, … E1 applied to the augmented matrix [A|b].

- Inverse Matrix
- PA = I: P is a left inverse
- A-1A = I, AA-1 = I.
- Inverses are unique
- If A and B are invertible, so is AB. Its inverse is (AB)-1 = B-1A-1

- LU Decomposition of the matrix A
- The forward elimination of a matrix A produces an upper echelon matrix U.
- The corresponding elementary row matrices are Ek…E1

- U = Ek…E1A., L = (Ek…E1)-1. L is lower triangular.
- A = LU: L is lower triangular and U is upper echelon.

- The forward elimination of a matrix A produces an upper echelon matrix U.

- LDU Decomposition of the matrix A
- L is lower triangular, D is a diagonal matrix, and U is upper echelon with diagonal entries either 1 or 0.

- LDU Decomposition of the matrix A

- In general the factorization can be written as PA = LDU.

- If A is invertible, its LDU decomposition is unique
- If A is symmetric, U in the LDU decomposition must be U = LT.
- A = LDLT.
- If the diagonal entries of D are nonnegative, A = (LD1/2) (LD1/2)T

- The central theme of linear algebra is the study of vectors and the sets in which they live, called vector spaces.
- What is the vector???

- Definition of a Vector Space (the triple (V,+,ᆞ) )

Q & A?