\begin{equation*}
\left\{ \begin{bmatrix} 1 \\ 0 \end{bmatrix}, \begin{bmatrix} 1 \\ 1 \end{bmatrix}\right\}
\end{equation*}
is a linear independent set and
\begin{equation*}
\left\{ \begin{bmatrix} 1 \\ 2 \end{bmatrix}, \begin{bmatrix} 2 \\ 4 \end{bmatrix}\right\}
\end{equation*}
is a set of linear dependent vectors in \(\mathbb{R}^2\text{.}\)
In general, if we have two vectors
\begin{equation*}
\boldsymbol{u} = \begin{bmatrix} a \\ c\end{bmatrix}, \qquad \boldsymbol{v}= \begin{bmatrix} b\\ d \end{bmatrix}
\end{equation*}
we can determine if they are linearly dependent or independent by solving
\begin{equation*}
k_1 \boldsymbol{u} + k_2 \boldsymbol{v} = \boldsymbol{0}.
\end{equation*}
To determine linear independence, we need to solve for \(k_1\) and \(k_2\text{.}\) This can be found with the augmented matrix:
\begin{equation*}
\left[ \begin{array}{rr|r} a \amp c \amp 0 \\ b \amp d \amp 0 \end{array}\right]
\end{equation*}
Row-reducing
\begin{equation*}
-c R_1 + a R_2 \to R_2 \qquad \left[ \begin{array}{rr|r} a \amp b \amp 0 \\ 0 \amp -c b + ad \amp 0 \end{array}\right]
\end{equation*}
This system has a unique solution (of \(k_1=k_2=0\)) if \(ad-bc \neq 0\) and an infinite set of solutions if \(ad-bc =0\text{.}\) Analogous situations occur in other parts of linear algebra (like the inverse matrix) that are equivalent to this and so we name this function from matrices to the reals. For
\begin{equation}
A = \begin{bmatrix} a \amp b \\ c \amp d \end{bmatrix}\tag{2.8.1}
\end{equation}
define \(\det(A) = ad-bc\text{.}\)
This section expands the definition to other matrix sizes and lists other properties of the determinant.
Subsection 2.8.1 Definition of the Determinant
Before formally defining the determinant for a general matrix, there is some other needed background. We first need to understand a
permutation of a set of integers. In short a permutation is a shuffling of items. In the context of determinants, we need the items to be the first
\(n\) integers.
For example, there are six permutations of \(\{1,2,3\}\text{,}\) specifically \((1,2,3), (1,3,2), (2,1,3), (2,3,1), (3,1,2)\) and \((3,2,1)\text{.}\) Mathematically, we often think of a single permutation as a function from the set \(\{1,2,\ldots, n\}\) to itself. For example, for the permutation \((2,3,1)\text{,}\) the function \(\sigma\) is
\begin{equation*}
\sigma(1) = 2 \qquad \sigma(2) = 3 \qquad \sigma(3)=1.
\end{equation*}
It is important to know that there are
\(n!\) permutations of the set
\(\{1,2,\ldots,n\}\text{.}\) Also, any permutation can be built from a number of swaps of the trivial permutation
\((1,2,\ldots,n)\text{.}\) For example in the example above
\((2,3,1)\) can be created by starting with
\((1,2,3)\) and swapping the first two elements to get
\((2,1,3)\) and then swapping the last two elements to get
\((2,3,1).\)
Definition 2.8.1.
A permutation \(\sigma\) is even if it can be generated from the trivial permutation with an even number of swaps and odd if it can be generated with an odd number of swaps. Also the sign of the permutation, denoted \(\text{sgn}\) is
\begin{equation*}
\sgn(\sigma) = \begin{cases} 1 \amp \text{if $\sigma$ is even} \\ -1 \amp \text{if $\sigma$ is odd.} \end{cases}
\end{equation*}
Definition 2.8.2.
For an \(n \times n\) matrix, \(A\text{,}\) the determinant is
\begin{equation}
\det(A) = \sum_{\sigma} \sgn(\sigma) a_{1,\sigma(1)} a_{2,\sigma(2)} \cdots a_{n,\sigma(n)}\tag{2.8.2}
\end{equation}
where the sum is over all permutations of \(n\text{.}\)
Although this defintion works for square matrices, letβs ground ourselves a bit more before moving on. First, if we have the case of a \(1 \times 1\) matrix, then
\begin{equation*}
\det(A) = \det([a_{1,1}]) = \sum_{\sigma} a_{1,\sigma(1)} = a_{1,1}
\end{equation*}
where we have used the fact that there is one permutation of the set \(\{1\}\text{,}\) resulting in the scalar that is the only entry.
Recall that there are two permutations of \(\{1,2\}\) and that is \((1,2)\) and \((2,1)\text{,}\) so for a \(2 \times 2\) matrix, we have
\begin{equation*}
\begin{aligned}\det\left(\begin{bmatrix} a \amp b \\ c \amp d \end{bmatrix}\right) \amp = \sgn((1,2)) a_{1,\sigma(1)}a_{2,\sigma(2)} + \sgn((2,1)) a_{1,\sigma(1)}a_{2,\sigma(2)} \\ \amp = (1) a_{1,1} a_{2,2} + (-1) a_{1,2} a_{2,1} = ad-bc \end{aligned}
\end{equation*}
where recall that the 2nd term has the permutation \(\sigma(1)=2, \sigma(2)=1\text{.}\) This is identical to the \(2 \times 2\) example above.
It may seem like now that we have the definition in
DefinitionΒ 2.8.2, we can calculate the determinant of any square matrix. The following example shows how to calculate it with a
\(3 \times 3\) matrix:
Example 2.8.3.
\begin{equation*}
A = \begin{bmatrix} 3 \amp 2 \amp -1 \\ 0 \amp 2 \amp 1 \\ 1 \amp 0 \amp -2 \end{bmatrix}
\end{equation*}
Solution.
Note that the permutations of \(\{1,2,3\}\) are those that are above and for a general \(3 \times 3\) matrix \(A\)
\begin{equation}
\begin{aligned} \det(A) \amp = a_{1,1} a_{2,2} a_{3,3} - a_{1,1}a_{2,3}a_{3,2} - a_{1,2} a_{2,1} a_{3,3} \\ \amp \qquad + a_{1,2}a_{2,3}a_{3,1} + a_{1,3} a_{2,2} a_{3,1} - a_{1,3}a_{2,1}a_{3,2} \end{aligned}\tag{2.8.3}
\end{equation}
and then evaluating it with the given element of \(A\)
\begin{equation*}
\begin{aligned} \det(A) \amp = (1)(3)(2)(-2) + (-1)(3)(1)(0) + (-1)2(0)(2) + (1)2(1)(1) \\ \amp \qquad +(1)(-1)(2)(1) + (-1)(-1)(0)(0) \\ \amp = -12 +2 -2 = -12 \end{aligned}
\end{equation*}
This example isnβt too bad. However, due to the nature of permutations, the formula in
(2.8.2) is unwieldy. For a 5 by 5 matrix, there would be
\(5!=120\) terms. Fortunately, there are other formulas available to perform the calculation. One thing to notice is using a little factoring, we can simplify the formula in
(2.8.3) and make it easier to compute. This will be done formally below.
Before presenting other computational methods of the determinant, letβs look at the properties of the determinant.