Linear Transformations

1. Linear Transformations

2. Hopfield Network Questions

3. Hopfield Network Questions • The network output is repeatedly multiplied by the weight matrix W. • What is the effect of this repeated operation? • Will the output converge, go to infinity, oscillate? • In this chapter we want to investigate matrix multiplication, which represents a general linear transformation.

4. Linear Transformations A transformation consists of three parts: 1. A set of elements X = {xi}, called the domain, 2. A set of elements Y = {yi}, called the range, and 3. A rule relating each xiÎX to an element yiÎY. A transformation is linear if: 1. For all x1,x2ÎX, A(x1+x2) = A(x1) + A(x2), 2. For all xÎX, aÎÂ , A(ax) = aA(x) .

5. Example - Rotation Is rotation linear? θ

6. Example - Translation Is translation linear?

7. Matrix Representation - (1) Any linear transformation between two finite-dimensional vector spaces can be represented by matrix multiplication. Let {v1, v2, ..., vn} be a basis for X, and let {u1, u2, ..., um} be a basis for Y. Let A:X®Y

8. Matrix Representation - (2) Since A is a linear operator, Since the ui are a basis for Y, (The coefficients aij will make up the matrix representation of the transformation.)

9. a a ¼ a x y 11 12 1 n 1 1 a a ¼ a x y 21 22 2 n 2 2 = a a ¼ a x y m 1 m 2 m n n m Matrix Representation - (3) Because the ui are independent, This is equivalent to matrix multiplication.

10. Summary • A linear transformation can be represented by matrix multiplication. • To find the matrix which represents the transformation we must transform each basis vector for the domain and then expand the result in terms of the basis vectors of the range. Each of these equations gives us one column of the matrix.

11. a a ¼ a x y 11 12 1 n 1 1 a a ¼ a x y 21 22 2 n 2 2 = ¼ ¼ ¼ ¼ ¼ a a ¼ a x y m 1 m 2 m n n m Change of Basis Consider the linear transformation A:X®Y. Let {v1, v2, ..., vn} be a basis for X, and let {u1, u2, ..., um} be a basis for Y. The matrix representation is:

12. a ' a ' ¼ a ' x ' y ' 11 12 1 n 1 1 a ' a ' ¼ a ' x ' y ' 21 22 2 n 2 2 = ¼ ¼ ¼ ¼ ¼ a ' a ' ¼ a ' x ' y ' m 1 m 2 m n n m New Basis Sets Now let’s consider different basis sets. Let {t1, t2, ..., tn} be a basis for X, and let {w1, w2, ..., wm} be a basis for Y. The new matrix representation is:

13. t 1 i t 2 i t = i ¼ t n i w 1 i w 2 i w = i ¼ w m i How are A and A' related? Expand ti in terms of the original basis vectors for X. Expand wi in terms of the original basis vectors for Y.

14. B = t t t ¼ t 1 2 n How are A and A' related? Similarity Transform

15. Example Consider a transformationA :Ｒ3→Ｒ2 whose matrix representation relative to the standard basis sets is Find the matrix for this transformationrelative to the basis sets :

16. Example Step 1 : form the matrices Step 2 : Use

17. Eigenvalues and Eigenvectors Let A:X®X be a linear transformation. Those vectors zÎX, which are not equal to zero, and those scalars l which satisfy A(z) = lz are called eigenvectors and eigenvalues, respectively.

18. z 0 1 0 1 0 11 z z = 0 = = 21 1 0 0 0 0 z 0 21 Computing the Eigenvalues Skewing example (45°): For this transformation there is only one eigenvector.

19. l 0 ¼ 0 1 0 l ¼ 0 – 1 2 B A B [ ] = ¼ ¼ ¼ 0 0 ¼ l Diagonalization Perform a change of basis (similarity transformation) using the eigenvectors as the basis vectors. If the eigenvalues are distinct, the new matrix will be diagonal. Eigenvectors Eigenvalues n

20. Example Diagonal Form: