Basis and Dimension
Basis
Analogous to the definition of a basis for , we can define a basis for a general vector space as follows:
Definition: A set of vectors in is a basis for if
- is a linearly independent set, and
Dimension
If a vector space is spanned by a finite set of vectors, then is said to be finite-dimensional.
Starting from that finite set, if a vector is a linear combination of the others, we can throw it away and the remaining vectors will still span . Repeat this process until you cannot throw away any more vector in the set. It means that no vector in the set is a linear combination of others i.e. the set is now linearly independent. Since it still spans , the set of remaining vectors forms a basis for .
Basis Theorem: Suppose and are both bases for . Then .
Proof: By the above theorem, . Interchange the roles of two bases and apply the theorem again, we have . Hence, .
Thanks to the Basis Theorem, the number of vectors in any basis for are the same. We define this number to be the dimension of , denoted by . By convention, the dimension of the zero vector space is zero.
The dimension of a vector space can be interpreted as
- the smallest number of vectors that can span the vector space, or
- the largest number of linearly independent vectors in the vector space.
- is finite-dimensional and .
- Any basis of is part of a basis for .
- If and , then .
Some Examples
Example 1: is a basis for . .
Example 2: Let . We already proved that is a subspace of . Find a basis for .
If you express the equation as an augmented matrix . It is a matrix already in echelon form. And the variables and are regarded as free variables. Let . Then the solutions are
Therefore, and the two vectors are linearly independent (because one is not a scalar multiple of another). In other words, is a basis for .
Example 3: is a basis for . .
Example 4: For any in . We define the trace of , denoted by , to be the sum of all diagonal entries of . It can be shown that is a subspace of . Find a basis for when and hence .
Idea: There are 6 off-diagonal entries that can be chosen freely. As for the diagonal entries, two of them can be chosen freely and the remaining one is determined because the diagonal sum is zero. Therefore, it is expected that . As for the basis, we will find it out in class.
Exercise
Let .