Basis
Hung-yi Lee
Outline
• What is a basis for a subspace?
• Confirming that a set is a basis for a subspace
• Reference: Textbook 4.2
What is Basis?
Basis Why nonzero?
• Let V be a nonzero subspace of Rn. A basis B for V is
a linearly independent generation set of V.
{e1, e2, , en} is a basis for Rn.
1. {e1, e2, , en} is independent
2. {e1, e2, , en} generates Rn.
{} is a basis for R2
{} {} {} …… any two independent
vectors form a basis for R2
Basis
• The pivot columns of a matrix form a basis for its
columns space.
RREF
pivot columns
Col A = Span
Property
• (a) S is contained in Span S Basis is always in
its subspace
• (b) If a finite set S’ is contained in Span S, then Span S’ is
also contained in Span S
Span S
• Because Span S is a subspace
Span S’
• (c) For any vector z, Span S = Span S{z} if and only if z
belongs to the Span S
z
z
Theorem
• 1. A basis is the smallest generation set.
• 2. A basis is the largest independent vector set in
the subspace.
• 3. Any two bases for a subspace contain the same
number of vectors.
• The number of vectors in a basis for a nonzero
subspace V is called dimension of V (dim V).
Textbook P245
Null B
Theorem 3 Null C
• Any two bases of a subspace V contain the same
number of vectors
Suppose {u1, u2, …, uk} and {w1, w2, …, wp} are two bases of V.
Let A = [u1 u2 uk] and B = [w1 w2 wp].
Since {u1, u2, …, uk} spans V, ci Rk s.t. Aci = wi for all i
A[c1 c2 cp] = [w1 w2 wp] AC = B
Now Cx = 0 for some x Rp ACx = Bx = 0
B is independent vector set x= 0 c1 c2 cp are independent
ci Rk p k
Reversing the roles of the two bases one has k p p = k.
Every basis of Rn
Theorem 3 has n vectors.
• The number of vectors in a basis for a subspace V is
called the dimension of V, and is denoted dim V
• The dimension of zero subspace is 0
dim R2 =2 dim R3=3
Example
Find dim V
𝑥1 =3 𝑥2 −5 𝑥 3 +6 𝑥 4
dim V = 3
Basis? Independent vector set that
generates V
Theorem 1
A basis is the smallest generation set.
If there is a generation set S for subspace V,
The size of basis for V is smaller than or equal to S.
Reduction Theorem
There is a basis containing in any generation
set S.
S can be reduced to a basis for V by removing
some vectors.
Theorem 1 – Reduction Theorem
所有的 generation set 心中都有一個 basis
S can be reduced to a basis for V by removing some
vectors.
Suppose S = {u1, u2, , uk} is a generation set of
subspace V
Subspace Let A = [ u1 u2 uk ].
¿ 𝐶𝑜𝑙 𝐴
The basis of Col A is
the pivot columns of A Subset of S
Theorem 1 – Reduction Theorem
所有的 generation set 心中都有一個 basis
Subspace ¿ 𝐶𝑜𝑙 𝐴 = Span
{[ ] [ ] [ ] [ ] [ ] [ ]}
1 2 −1 2 1 2 Smallest generation set
−1 −2 1 2 3 6
𝑆= , , , , ,
2 4 −3 2 0 3
−3 6 2 0 3 9 Generation set
RREF
𝐴=¿
Theorem 2
A basis is the largest independent set in the
subspace.
If the size of basis is k, then you cannot find more than k
independent vectors in the subspace.
Extension Theorem
Given an independent vector set S in the space
S can be extended to a basis by adding more vectors
Theorem 2 – Extension Theorem
Independent set:
我不是一個 basis 就是正在成為一個
basis
There is a subspace V
Given a independent vector set S (elements of S are in V)
If Span S = V, then S is a basis
If Span S ≠ V, find v1 in V, but not in Span S
S = S {v1} is still an independent set
If Span S = V, then S is a basis
If Span S ≠ V, find v2 in V, but not in Span S
S = S {v2} is still an independent set V
…… You will find the basis in the end.
More from Theorems
A basis is the smallest generation set.
A vector set generates Rm must contain at least m vectors.
Rm have a basis {e1, e2, , em}
Because a basis is the smallest generation set
Any other generation set has at least m vectors.
A basis is the largest independent set in the
subspace.
Any independent vector set in Rm contain at most m vectors.
雕塑 … 主要是使用雕(通過減除材料
Summary 來造型)及塑(通過疊加材料來造
型)的方式 …… (from wiki)
Same size
刪去 疊加
Independent
Generation vector set
set
Basis
Confirming that
a set is a Basis
Intuitive Way
• Definition: A basis B for V is an independent
generation set of V.
Is C a basis of V ?
Independent? yes
Generation set? difficult
generates V
Another way
Find a basis for V
• Given a subspace V, assume that we already know that dim
V = k. Suppose S is a subset of V with k vectors
If S is independent S is basis
If S is a generation set S is basis
Dim V = 2 (parametric representation) Is C a basis of V ?
C is a subset of V with 2 vectors
C is a basis of V
Independent? yes
Assume that dim V = k. Suppose
Another way S is a subset of V with k vectors
If S is independent S is basis
By the extension theorem, we can add more
vector into S to form a basis.
However, S already have k vectors, so it is already
a basis.
If S is a generation set S is basis
By the reduction theorem, we can remove some
vector from S to form a basis.
However, S already have k vectors, so it is already
a basis.
Example
• Is B a basis of V ?
Independent set in V? yes
Dim V = ? 3 B is a basis of V.
Example
B is a subset of V with 3
• Is B a basis of V = Span S ?
vectors
[ ]
1 0 0 − 2/ 3
0 1 0 1 /3
𝑅 𝐴=
0 0 1 2/3 𝑑𝑖𝑚𝐴=3
0 0 0 0
[ ]
1 0 0
0 1 0 𝐼𝑛𝑑𝑒𝑝𝑒𝑛𝑑𝑒𝑛𝑡
𝑅𝐵=
0 0 1
0 0 0 B is a basis of V.