1  Matrices and Basic Operations

“It is not enough to have a good mind; the main thing is to use it well.”
René Descartes

Handout

1.1 Important Properties

Addition/Subtraction
  1. Commutativity: A\pm B=B\pm A
  2. Associativity: (A+B)+C=A+(B+C)
  3. Identity: A+0=0+A=A
Matrix Multiplication
  1. Non-Commutativity: AB\neq BA, in general
  2. Associativity: (AB)C=A(BC)
  3. Identity: AI=IA=A
  4. Zero: A0=0A=0
  5. Distribution: A(B+C)=AB+AC and (A+B)C=AC+BC
Multiplication by Scala
  1. Associativity: k(A+B)=kA+kB
  2. Zero: 0A=0
Transpose
  1. Idempotent: (A^T)^T=A
  2. Distribution over Sum: (A+B)^T=A^T+B^T
  3. Distribution over Product: (AB)^T=B^TA^T
Inverse (for invertible matrices)
  1. Idempotent: (A^{-1})^{-1}=A
  2. Distribution over Product: (AB)^{-1}=B^{-1}A^{-1}
  3. Transpose: (A^{-1})^T=(A^T)^{-1}
Determinant
  1. Distribution over Product: det(AB)=det(A) det(B)

1.2 Exercises

Exercise 1.1 Solve the system by hand: \begin{aligned} x + y + z &= -1 \\ 5x + 3y - z &= 9 \\ 3x + 2y - 2z &= 5 \end{aligned}

Exercise 1.2 Can two matrices be always added?

Exercise 1.3 If addition is possible, add the following matrices: A=\begin{bmatrix} -1 & 2 & 3\\ 0 & 1 & 5 \end{bmatrix} \text{ and } B=\begin{bmatrix} 1/2 & 1 & 3\\ 2 & -2 & 0 \end{bmatrix}.

Exercise 1.4 For matrices A,B, is it always true that A+B=B+A? Explain your answer.

Exercise 1.5 If multiplication is possible, multiply the following matrices: A=\begin{bmatrix} 1 & 2 & 3\\ 0 & -1 & 5 \end{bmatrix} \text{ and } B=\begin{bmatrix} 1 & 2 & 1\\ 1 & 0 & 2 \end{bmatrix}.

Exercise 1.6 If multiplication is possible, multiply the following matrices: A=\begin{bmatrix} 1 & 2\\ 0 & -1\\ -1 & 3 \end{bmatrix} \text{ and } B=\begin{bmatrix} 1 & 5 & 1\\ 1 & 12 & 2 \end{bmatrix}.

Exercise 1.7 For matrices A and B, is it always true that AB=BA? Explain your answer.

Exercise 1.8 When do the matrix products AB and BA have the same size? Explain your answer.

Exercise 1.9 Give an example of a 4\times 2 diagonal matrix.

Exercise 1.10  

  1. If D=\begin{bmatrix} a & 0 \\ 0 & b \\ \end{bmatrix}  

is a 2 \times 2 diagonal matrix with a=b, then characterize the only matrices that commute (under matrix multiplication) with D.

  1. What if a=b ?

Exercise 1.11  

  1. Is the sum of two diagonal matrices of the same size a diagonal matrix ?

  2. Is the product of two diagonal matrices of the same size a diagonal matrix ?

Exercise 1.12 Intuitively justify the following fact: (AB)^T=B^TA^T.

Exercise 1.13 Is the sum of two symmetric matrices always symmetric?

Exercise 1.14 Is the product of two symmetric matrices always symmetric?

Exercise 1.15 Give an example of a skew-symmetric matrix of order 4\times 4 with at least 4 non-zero elements.

Exercise 1.16 For any matrix A, explain why

  1. A+A^T is symmetric.

  2. A-A^T is skew-symmetric.

Exercise 1.17 If A has an inverse, then show that the inverse is unique.

Exercise 1.18 If A is the inverse of B, then show that B is the inverse of A.

Exercise 1.19  

  1. Is \text{det} (A+B)=\text{det} (A)+ \text{det} (B)?
  2. Is \text{det} (AB)=\text{det} (A) \text{det} (B)?

Exercise 1.20 Suppose A is a 2 \times 2 matrix and B is the matrix we get by interchanging the two rows of A. Show that \text{det} B = - \text{det} A.

Exercise 1.21 Find the determinant of \begin{bmatrix}-1 & 2 & 3\\ 0 & 1 & 5\\ 4 & 1 & -1\end{bmatrix}.

Exercise 1.22 Find a 3\times 3 matrix whose determinant is 6 and the absolute value of each entry is no bigger than 3.

Exercise 1.23 \begin{bmatrix} 2 & 1 & 3 \end{bmatrix}\begin{bmatrix} -1 & 0 & -1\\ -1 & 1 & 0\\ 0 & 1 & 1 \end{bmatrix}\begin{bmatrix} 1 \\ 0 \\ -1 \end{bmatrix}=?

Exercise 1.24 Find the inverse of the following matrix: A=\begin{bmatrix} 1 & 2 & 3\\ 0 & -1 & 2\\ 1 & -2 & 0 \end{bmatrix}.

Exercise 1.25 Find the inverse of the following matrix: \begin{bmatrix} -1 & 0 & -1\\ -1 & 1 & 0\\ 0 & 1 & 1 \end{bmatrix}.

Exercise 1.26 If =\begin{bmatrix} 5 & 3\\ -1 & -2\\ \end{bmatrix}, then show that A satisfies the equation A^2-3A-7I=0.

Exercise 1.27 Consider a n \times n matrix A. Then:

  1. If A is invertible and AB=0 for some n \times n matrix B, then B=0.
  2. If A is not invertible, then we can find a n \times n matrix B with AB=0 but B \ne 0.

The math tree