Module 3 Vector Space Notes and Questions
Module 3 Vector Space Notes and Questions
Page 1 of 31
VECTOR OPERATIONS
A vector is a quantity with both magnitude and direction, there are two operations defined on
vectors and these both have a very direct geometric interpretation. We draw a vector as a line
with an arrow, for now I will call the end without the arrow the 'start' of the vector and the
end with the arrow the 'end' of the vector.
• Vector addition: to add two vectors we take the start of the second vector and move it
to the end of the first vector. The addition of these two vectors is the vector from the
start of the first vector to the end of the second vector.
• Scalar multiplication changes the length of a vector without changing its direction, i.e.,
we 'scale' it by the multiplying factor. So scalar multiplication involves multiplying a
scalar (single number) by a vector to give another number.
Page 2 of 31
Vector Spaces
Definition: A vector space is a set V of elements called vectors, having two operations called
addition and scalar multiplication defined on it that satisfying the following ten axioms (or
rules). The axioms must hold for all vectors u, v and w in V and for all scalars α and β.
Closure Axioms
Addition Axioms
(5) There exists an element of V, called a zero vector, denoted 0, such that
u + 0 = u for all u in V.
(6) For each u in V, there is an element − u in V, called the additive inverse of u, such that
u + (−u) = 0.
(7) α (u + v) = αu + αv
(8) (α + β) u = αu + βu
(10) 1u = u
Remark: Every vector space has a unique zero vector and every vector in the space has a
unique inverse. The two most common sets of scalars used in vector spaces are the set of real
numbers R and the set of complex numbers C. The vector spaces are then called real vector
spaces and complex vector spaces.
Page 3 of 31
Examples
Therefore, property (2) of the definition of a vector space fails, and consequently the unit disc
Example 2. Let V = {(x, y) ∈ R2 | y = x2} be the graph of the quadratic function. Is V a vector
space?
For example, both u = (1, 1) and v = (2, 4) are in V but u + v = (3, 5) is not in V.
Example 3. Let V = {(x, y) ∈ R2 | y = 2x} be the graph of the function f(x) = 2x. Is V a vector
space?
Solution: Let u = (a, 2a), v = (b, 2b) and w = (c, 2c) be points in V and and be scalars.
Then
Page 4 of 31
(u + v) + w = u + (v + w).
Therefore, Addition is associative
(v) There is a zero vector 0 = (0, 0) in V such that
u + 0 = (a, 2a) + (0, 0) = (a, 2a) = u
(vi) There is an additive inverse −u = (−a, −2a) in V such that
u + (−u) = 0.
(vii) α (u + v) = (a + b, 2a + 2b)
= ((a + b), (2a + 2b))
= (a + b, 2a + 2b)
= (a, 2a) + (b, 2b)
= (a, 2a) +(b, 2b)
= αu + αv
(viii) (α + β) u = (α + β) (a, 2a)
= ((α + β) a, (α + β)2a)
= (αa + βa, 2αa + 2βa)
= (a, 2a) + (a, 2a)
= (a, 2a) + (a, 2a)
= αu + u
(ix) α(βu) = α ((a, 2a))
= α (a, 2a)
= (αa, 2αa)
= α (a, 2a)
= (αβ)u
(x) 1u = 1(a, 2a) = (a, 2a) = u
Example 4. Let V = Pn[t] = {a0 + a1t + a2t2 + · · · + antn | a0, a1, . . ., an ∈ R} be the set of all
polynomials in the variable t and of degree n. Is V a vector space?
Page 5 of 31
w = w0 + w1t + · · ·+ wntn be polynomials in V and and be scalars. Then
Page 6 of 31
(ix) α(βu) = α ((u0 + u1t + · · ·+ untn))
= α (u0 + u1 t + · · · + un tn)
= αu0 + αu1t + · · ·+ untn
= α (u0 + u1t + · · ·+ untn)
= (αβ)u
(x) 1u = 1(u0 + u1t + · · ·+ untn)
= 1.u0 +1. u1t + · · ·+1.untn
= u0 + u1t + · · ·+ untn
=u
All the axioms of vector space are satisfied.
Example 5. Show that the set of all 2 2 matrices is a vector space over the field of reals R
under usual addition and multiplication.
𝑤 𝑥
Solution: Let 𝑉 = {( 𝑦 𝑧 ) | 𝑤, 𝑥, 𝑦, 𝑧 ∈ 𝑅} be the set of all 2 2 matrices.
𝑎 𝑏 𝑒 𝑓 𝑖 𝑗
Let 𝐴 = [ ], 𝐵 = [ ] and 𝐶 = [ ] be 2 2 matrices in V and and be scalars.
𝑐 𝑑 𝑔 ℎ 𝑘 𝑙
Then
𝑎 𝑏 𝑒 𝑓 𝑎+𝑒 𝑏+𝑓
(i) 𝐴+𝐵 =[ ]+[ ]=[ ]∈𝑉
𝑐 𝑑 𝑔 ℎ 𝑐+𝑔 𝑑+ℎ
𝑎 𝑏 𝛼𝑎 𝛼𝑏
(ii) 𝛼𝐴 = 𝛼 [ ]=[ ]∈𝑉
𝑐 𝑑 𝛼𝑐 𝛼𝑑
Therefore, V is closed under scalar multiplication.
𝑎 𝑏 𝑒 𝑓 𝑎+𝑒 𝑏+𝑓
(iii) 𝐴+𝐵 =[ ]+[ ]=[ ]
𝑐 𝑑 𝑔 ℎ 𝑐+𝑔 𝑑+ℎ
𝑒 𝑓 𝑎 𝑏 𝑒+𝑎 𝑓+𝑏
𝐵+𝐴 =[ ]+[ ]=[ ]
𝑔 ℎ 𝑐 𝑑 𝑔+𝑐 ℎ+𝑑
A+B=B+A
Therefore, Addition is commutative.
𝑎+𝑒 𝑏+𝑓 𝑖 𝑗 𝑎+𝑒+𝑖 𝑏+𝑓+𝑗
(iv) (𝐴 + 𝐵) + 𝐶 = [ ]+[ ]=[ ]
𝑐+𝑔 𝑑+ℎ 𝑘 𝑙 𝑐 +𝑔+𝑘 𝑑+ℎ+𝑙
Page 7 of 31
𝑎 𝑏 𝑒+𝑖 𝑓+𝑗 𝑎+𝑒+𝑖 𝑏+𝑓+𝑗
𝐴 + (𝐵 + 𝐶) = [ ]+[ ]=[ ]
𝑐 𝑑 𝑔+𝑘 ℎ+𝑙 𝑐+𝑔+𝑘 𝑑+ℎ+𝑙
(A + B) + C = A + (B + C).
Therefore, Addition is associative
0 0
(v) There exists a zero matrix 0 = [ ] such that
0 0
𝑎 𝑏 0 0 𝑎 𝑏
𝐴+0 =[ ]+[ ]=[ ]=𝐴
𝑐 𝑑 0 0 𝑐 𝑑
−𝑎 −𝑏
(vi) There is an additive inverse −𝐴 = [ ] in V such that
−𝑐 −𝑑
𝑎 𝑏 −𝑎 −𝑏 0 0
𝐴 + (−𝐴) = [ ]+[ ]=[ ]=0
𝑐 𝑑 −𝑐 −𝑑 0 0
𝑎+𝑒 𝑏+𝑓
(vii) 𝛼(𝐴 + 𝐵) = 𝛼 [ ]
𝑐+𝑔 𝑑+ℎ
𝛼(𝑎 + 𝑒) 𝛼(𝑏 + 𝑓)
=[ ]
𝛼(𝑐 + 𝑔) 𝛼(𝑑 + ℎ)
𝛼𝑎 + 𝛼𝑒 𝛼𝑏 + 𝛼𝑓
=[ ]
𝛼𝑐 + 𝛼𝑔 𝛼𝑑 + 𝛼ℎ
𝛼𝑎 𝛼𝑏 𝛼𝑒 𝛼𝑓
=[ ]+[ ]
𝛼𝑐 𝛼𝑑 𝛼𝑔 𝛼ℎ
𝑎 𝑏 𝑒 𝑓
= 𝛼[ ]+𝛼[ ]
𝑐 𝑑 𝑔 ℎ
= αA + αB
𝑎 𝑏
(viii) (α + β)A = (α + β) [ ]
𝑐 𝑑
(α + β)𝑎 (α + β)𝑏
= [ ]
(α + β)𝑐 (α + β)𝑑
αa + βa αb + βb
= [ ]
αc + βc αd + βd
αa αb βa βb
= [ ]+ [ ]
αc αd βc βd
𝑎 𝑏 𝑎 𝑏
= 𝛼[ ]+𝛽[ ]
𝑐 𝑑 𝑐 𝑑
= αA + A
𝑎 𝑏
(ix) α(βA) = α ([ ])
𝑐 𝑑
βa βb
=α[ ]
βc βd
αβa αβb
=[ ]
αβc αβd
Page 8 of 31
𝑎 𝑏
= α [ ]
𝑐 𝑑
= (αβ)A
𝑎 𝑏 𝑎 𝑏
(x) 1A = 1[ ]=[ ]=𝐴
𝑐 𝑑 𝑐 𝑑
Example 6. Let V = Mm × n be the set of all m × n matrices. Under the usual operations of
addition of matrices and scalar multiplication, is Mn × m a vector space?
closed under these two operations. The 0 vector in Mm × n is the matrix of size m × n having
all entries equal to zero. It can be verified that all other properties of the definition of a vector
Example 7. Prove that the set of all real valued continuous (differentiable & integrable)
functions of x defined in the interval [0, 1] is a vector space.
Solution: Let V be the set of all real valued continuous functions of x defined in the interval
[0, 1]. Let f, g h V and and be scalars.
Define their sum, f + g, to be the function such that (f + g) (x) = f(x) + g(x) and
define their scalar multiplication f, is the function such that (f) (x) = [f(x)].
Then
(i) If f and g are continuous functions, then we know that their sum f + g is also
continuous.
Page 9 of 31
(iii) (f + g) (x) = f(x) + g(x)
= g(x) + f(x)
= (g + f) (x)
f+g=g+f
Page 10 of 31
All the axioms of vector space are satisfied.
i.e., the set of all real valued continuous functions of X defined in the interval [0, 1] is a vector
space
Exercise
1. Show that the set V of all ordered pairs (x, y) of real numbers form a vector space over
the field of real numbers R.
2. Show that the set V of all ordered triplets (x, y, z) of real numbers form a vector space
over the field of real numbers R.
𝒙 𝟎
3. Show that the set 𝑽 = {( ) | 𝒙, 𝒚 ∈ 𝑹} is a vector space over the field of reals R
𝟎 𝒚
under usual addition and multiplication.
𝒂 𝟎
4. Show that the set 𝑽 = {( ) | 𝒂, 𝒃 ∈ 𝑹} is a vector space over the field of reals R
𝒃 𝟎
under usual addition and multiplication.
5. Is the set of 3 3 symmetric matrices a vector space?
6. Prove that the set of all convergent sequences of real numbers is a vector space over
the field of real numbers.
7. Prove that the set of all ordered n-triples of complex numbers forms a vector space
over the field of complex numbers.
8. Show that the set V of all ordered pairs of integers does not form a vector space over
the field of real numbers R.
9. Show that the set of all pairs of real numbers over the field of reals defined as
(x1, y1) + (x2, y2) = (3y1 + 3y2, -x1 – x2) and c(x1, y1) = (3cy1 – cx1) does not form a
vector space.
Page 11 of 31
Subspaces of Vector Spaces
i.e., the vectors u + v and ku both lie in the same line or same plane as u and v.
Page 12 of 31
Theorem: A non-empty subset W of a vector space V is a subspace of V iff u, v W and and
are scalars then u + v W.
Remark: The intersection of two subspaces of a vector space V is a subspace of V but the union
of two subspaces of V need not be a subspace of V.
Note: To prove the subset W of V is a subspace of V, we can prove it either by using definition
or by Theorem.
Examples
Example 1. Let W = {(x, y) ∈ R2 | y = 2x} be the graph of the function f(x) = 2x. Is W a subspace
of V = R2?
(ii) Let α be any scalar and let u = (a, 2a) be an element of W. Then
All three conditions of a subspace are satisfied for W and therefore W is a subspace of V.
Solution: (i) The set W contains the zero vector (0, 0).
(ii) Let u = (x1, y1) W then x1 ≥ 0 and y1 ≥ 0, and similarly let v = (x2, y2) W then x2
≥ 0 and y2 ≥ 0. Then the sum u + v = (x1 + x2, y1 + y2) has components x1 +y1 ≥ 0 and x2 +
y2 ≥ 0 and therefore u + v is in W. Thus, W is closed under addition.
For example, if u = (1, 1) and α = −1 then αu = (−1, −1) is not in W because the components
of αu are clearly not non-negative.
Therefore, W is not a subspace of V
Page 13 of 31
Example 3. Let V = M n × n be the vector space of all n × n matrices. We define the trace of a
matrix A ∈ M n × n as the sum of its diagonal entries: tr(A) = a11 + a22 + · · · + ann. Let W be the
set of all n × n matrices whose trace is zero: W = {A ∈ M n × n | tr(A) = 0}. Is W a subspace of
V?
Solution: (i) If 0 is the n × n zero matrix then clearly tr(0) = 0, and thus 0 ∈ M n × n.
(ii) Suppose that A and B are in W. Then necessarily tr(A) = 0 and tr(B) = 0.
Consider the matrix C = A + B. Then
tr(C) = tr (A + B) = (a11 + b11) + (a22 + b22) + · · · + (ann + bnn)
= (a11 + · · · + ann) + (b11 + · · · + bnn)
= tr(A) + tr(B)
=0
Therefore, tr(C) = 0 and consequently C = A + B ∈ W,
Thus, W is closed under addition.
(iii) Now let α be a scalar and let C = αA. Then
tr(C) = tr(αA) = (αa11) + (αa22) + · · · + (αann) = α tr(A) = 0.
Thus, tr(C) = 0, that is, C = αA ∈ W, and consequently W is closed under scalar multiplication.
Therefore, the set W is a subspace of V.
Example 4. Let V = Pn[t] and consider the subset W of V: W = {u ∈ Pn[t] | u′ (1) = 0}. In other
words, W consists of polynomials of degree n in the variable t whose derivative at t = 1 is zero.
Is W a subspace of V?
Solution: (i) The zero polynomial 0(t) = 0 clearly has derivative at t = 1 equal to zero, that is,
(ii) Now suppose that u(t) and v(t) are two polynomials in W. Then, u′ (1) = 0 and also v′
(1) = 0. To verify whether or not W is closed under addition, we must determine whether the
sum polynomial (u + v) (t) has a derivative at t = 1 equal to zero. From the rules of
differentiation, we compute
Page 14 of 31
(iii) Now let α be any scalar and let u(t) be a polynomial in W. Then u′ (1) = 0. To determine
whether or not the scalar multiple αu(t) is in W we must determine if αu(t) has a derivative
Therefore, the polynomial (αu) (t) is in W and thus W is closed under scalar multiplication.
All three properties of a subspace hold for W and therefore W is a subspace of Pn[t].
Example 5. Let V = Pn[t] and consider the subset W of V: W = {u ∈ Pn[t] | u (2) = −1}. In other
words, W consists of polynomials of degree n in the variable t whose value t = 2 is −1. Is W a
subspace of V?
Solution: (i) The zero polynomial 0(t) = 0 clearly does not equal to −1 at t = 2.
Therefore, W does not contain the zero polynomial and, because all three conditions of a
Example 6. Let V = R3 be a vector space and consider the subset W of V consisting of vectors
of the form (a, a, b), where the first two components are the same. Is W a subspace of V?
Solution: (i) The set W contains the zero vector (0, 0, 0).
(ii) Let u = (a, a, b) and v = (c, c, d) then u + v = (a + c, a + c, b + d) W.
Thus, W is closed under addition.
(iii) If we multiply (a, a, b) by a scalar k, we get (ka, ka, kb) W.
Thus, W is closed under scalar multiplication.
Therefore, W is a subspace of V.
Example 7. Let V = R3 be a vector space and consider the subset W of V consisting of vectors
of the form (a, a2, b), where the second component is the square of the first. Is W a subspace
of V?
Solution: (i) The set W contains the zero vector (0, 0, 0).
(ii) Let u = (a, a2, b) and v = (c, c2, d) then u + v = (a + c, a2 + c2, b + d) W because the
second component of this vector is not the square of the first.
Thus, W is not closed under addition.
Page 15 of 31
Example 8. Prove that the set W of 2 2 diagonal matrices is a subspace of the vector space
M22 of 2 2 matrices.
0 0
Solution: (i) The set W contains the zero matrix [ ].
0 0
𝑎 0 𝑐 0 𝑎+𝑐 0
(ii) Let 𝑢 = [ ] and 𝑣 = [ ] are in W then 𝑢 + 𝑣 = [ ] W.
0 𝑏 0 𝑑 0 𝑏+𝑑
𝑎 0 𝑘𝑎 0
(iii) Let k be a scalar and 𝑢 = [ ] ∈ 𝑊, then 𝑘𝑢 = [ ] W.
0 𝑏 0 𝑘𝑏
Therefore, W is a subspace of V.
Example 9. Let W be the set of vectors of the form (a, a, a + 2). Show that W is not a subspace
of V = R3.
Solution: (i) The set W does not contain the zero vector (0, 0, 0).
Therefore, W is not a subspace of V.
Example 10. Prove that the subset W = {(x, y, z) | x2 + y2 + z2 1} of the vector space V(R3) is
a subspace of V(R3).
Solution: (i) The set W contain the zero vector (0, 0, 0) such that 02 + 02 + 02 1.
(ii) Let u = (1, 0, 0) such that 12 + 02 + 02 1 and v = (0, 0, 1) such that 02 + 02 + 12 1 are
in W then u + v = (1, 0,1) such that 12 + 02 + 12 = 2 which is not less than or equal to 1.
i.e., u + v = (1, 0,1) W
Therefore, W is not a subspace of V.
Example 11. Prove that the subset W = {(x, y, z) | x – 3y + 4z = 0} of the vector space R3 is a
subspace of R3.
Solution: W is a non-empty subset of R3 since at least one element (0, 0, 0) W such that
0 – 3(0) + 4(0) = 0.
Let u = (x1, y1, z1) such that x1 – 3y1 + 4z1 = 0 and v = (x2, y2, z2) such that x2 – 3y2 + 4z2 = 0
and and be scalars then
u + v = (x1, y1, z1) + (x2, y2, z2)
Page 16 of 31
= (x1– 3y1 + 4z1) + (x2– 3y2 + 4z2)
= (0) + (0) = 0
Therefore, u + v W
Thus, W is a subspace of the vector space R3.
Example 12. Prove that the subset W = {(x, y, z) | x + y + z = 0} of the vector space V3 (R) is a
subspace of V3 (R).
Solution: W is a non-empty subset of V3 (R) since at least one element (0, 0, 0) W such that
0 + 0 + 0 = 0.
Let u = (x1, y1, z1) such that x1 + y1 + z1 = 0 and v = (x2, y2, z2) such that x2 + y2 + z2 = 0 and
and be scalars then
u + v = (x1, y1, z1) + (x2, y2, z2)
= (0) + (0) = 0
Therefore, u + v W
Example 13. Prove that the subset W = {(x, y, z) | x = y = z} of the vector space V3 (R) is a
subspace of V3 (R).
Solution: W is a non-empty subset of V3 (R) since at least one element (0, 0, 0) W such that
0 = 0 = 0.
Let u = (x1, y1, z1) such that x1 = y1 = z1 and v = (x2, y2, z2) such that x2 = y2 = z2 and and
be scalars then
u + v = (x1, y1, z1) + (x2, y2, z2)
Page 17 of 31
As, x1 = y1 = z1 and x2 = y2 = z2
Therefore, u + v W.
Thus, W is a subspace of the vector space V3 (R).
EXERCISE
Page 18 of 31
LINEAR SPAN
The span of a set of vectors, also called linear span, is the linear space formed by all the
vectors that can be written as linear combinations of the vectors belonging to the given set.
Definition:
Let V be a vector space and v1, v2, ..., vm be any m vectors in a vector space V. Any vector
of the form c1v1 + c2v2 + … + cmvm where c1, c2, …, cm are scalars is called a linear combination
of the vectors v1, v2, …, vm.
Let V be a vector space and S be any non-empty subset of V. Then the linear span of S
is the set of all linear combination of any finite number of elements of S and is denoted by L(S).
i.e., L(S) = {c1v1 + c2v2 + … + cmvm | vi S and ci F}, i = 1, 2, …, m.
Examples
Example 1: Determine whether the vector (8, 0, 5) is a linear combination of the vectors
(1, 2, 3), (0, 1, 4), and (2, −1, 1) in R3.
Solution: Examine the following identity for values of c1, c2, and c3
c1 (1, 2, 3) + c2 (0, 1, 4) + c3 (2, −1, 1) = (8, 0, 5)
This identity leads to the following system of linear equations:
c1 + 2c3 = 8, 2c1 + c2 − c3 = 0 and 3c1 + 4c2 + c3 = 5
It can be shown that this system has the unique solution,
c1 = 2, c2= −1, c3 = 3
Thus, the vector (8, 0, 5) can be written in one way as a linear combination,
(8, 0, 5) = 2(1, 2, 3) − 1(0, 1, 4) + 3(2, −1, 1)
Note: If the system had no solutions, then it would not have been possible to express it as a
linear combination of the other vectors. It is possible for some vectors to be written in many
ways as linear combinations of other vectors.
Example 2: Express the vector (2, − 1, − 8) as a linear combination of the vectors (1, 2, 1),
(1, 1, −1), and (4, 5, −2) in R3.
Solution: Let (2, − 1, − 8) = c1 (1, 2, 1) + c2 (1, 1, −1) + c3 (4, 5, −2)
This identity leads to the following system of linear equations:
Page 19 of 31
c1 + c2 + 4c3 = 2, 2c1 + c2 + c3 = − 1 and c1 − c2 −2c3 = − 8
It can be shown that this system has the unique solution,
c1 = − 4, c2= 2, c3 = 1
Thus, the vector (2, − 1, − 8) can be written in one way as a linear combination,
(2, − 1, − 8) = − 4 (1, 2, 1) + 2 (1, 1, −1) + 1(4, 5, −2)
Example 3: Determine whether the vector (3, −1, 11) lies in the subspace Span {(−1, 5, 3),
(2, −3, 4 )} of R3.
Solution: To prove that (3, − 1, ) is in the span of the vectors (−1, 5, 3) and (2, −3, ),
we have to express (3, − 1, ) as a linear combination of these.
(3, − 1, ) = c1 (−1, 5, 3) + c2 (2, −3, 4)
This identity leads to the following system of linear equations:
−c1 + 2c2 = 3, 5c1 − 3c2 = − and 3c1 + 4c2 =
It can be shown that this system has the unique solution,
c1 = 1 and c2=
Thus, the vector (3, − 1, ) can be written in one way as a linear combination,
(3, − , ) = 1 (−1, 5, 3) + 2 (2, −3, 4)
Thus, the vector (3, −1, 11) lies in the subspace Span {(−1, 5, 3), (2, −3, 4)}.
Example 4: Prove that the vector (3, − 7, ) is in the span of the vectors (1, −3, 2), (2, 4, 1) and
(1, 1, ).
Solution: To prove that (3, − 7, ) is in the span of the vectors (1, −3, 2), (2, 4, 1), and (1, 1, ),
we have to express (3, − 7, ) as a linear combination of these.
(3, − 7, ) = c1 (1, −3, 2) + c2 (2, 4, 1) + c3 (1, 1, )
This identity leads to the following system of linear equations:
c1 + 2c2 + c3 = 3, −3c1 + 4c2 + c3 = − and 2c1 + c2 + c3 =
It can be shown that this system has the unique solution,
c1 = 2, c2= −1, c3 = 3
Thus, the vector (3, − 7, ) can be written in one way as a linear combination,
(3, − 7, ) = 2 (1, −3, 2) −1 (2, 4, 1) + 3 (1, 1, )
Thus, the vector (3, − 7, ) is in the span of the vectors (1, −3, 2), (2, 4, 1), and (1, 1, ).
Page 20 of 31
−𝟏 𝟕 𝟏 𝟎
Example 5: Determine whether the matrix [ ] is a linear combination of [ ],
𝟖 −𝟏 𝟐 𝟏
𝟐 −𝟑 𝟎 𝟏
[ ] and [ ] in the vector space M2(R) of 2 2 matrices.
𝟎 𝟐 𝟐 𝟎
Solution: Examine the following identity for values of c1, c2, and c3
1 0 2 −3 0 1 −1 7
𝑐1 [ ] + 𝑐2 [ ] + 𝑐3 [ ] = [ ]
2 1 0 2 2 0 8 −1
𝑐1 + 2𝑐2 −3𝑐2 + 𝑐3 −1 7
[ ] = [ ]
2𝑐1 + 2𝑐3 𝑐1 + 2𝑐2 8 −1
This system has the unique solution c1 = 3, c2 = −2, c3 = 1. The given matrix is thus the
following linear combination of the other three matrices.
−1 7 1 0 2 −3 0 1
[ ]= 3 [ ]−2 [ ] + [ ].
8 −1 2 1 0 2 2 0
Two polynomials can only be equal for all values of x if the corresponding coefficients are
equal. Compare the coefficients of x2, x and the constant terms on both sides of the equation.
The given function is thus the following linear combination of the other two functions.
Page 21 of 31
Example 7: Let f (x) = 2x2 − 5 and g (x) = x +1. Show that the function h (x) = 4x2 + 3x − 7
lies in the subspace Span {f, g} of P2.
Solution: To prove that the function h (x) is in the span of the subspace span of {f, g}, we
We examine the identity c1 f(x) + c2 g(x) = h(x) for values of c1 and c2.
A set {v1, v2, ..., vn} of vectors of a vector space V said to be linearly independent if there exists
scalars c1, c2, …, cn such that c1v1 + c2v2 + … + cnvn = 0 then c1 = 0, c2 = 0, …, cn = 0.
A set {v1, v2, ..., vn} of vectors of a vector space V said to be linearly dependent if it is not linearly
independent,
i.e., the set {v1, v2, ..., vn} of a vector space V said to be linearly dependent if there exists scalars
c1, c2, …, cn not all zero such that c1v1 + c2v2 + … + cnvn = 0
Note: Two vectors are linearly dependent iff one is a multiple of the other.
Property: A subset S = {(x1, y1, z1), (x2, y2, z2), (x3, y3, z3)} of V3(R) is linearly dependent iff
𝑥1 𝑦1 𝑧1
|𝑥2 𝑦2 𝑧2 | = 0.
𝑥3 𝑦3 𝑧3
This property can be extended to a subset of n vectors in the vector space Vn(R)
Page 22 of 31
Note: The following theorem gives insight into the significance of linear dependence: the
vectors are linearly dependent in the sense that it is possible to express one of the vectors
linearly in terms of the others.
Theorem: A set consisting of two or more vectors in a vector space is linearly dependent iff it
is possible to express one of the vectors as a linear combination of the other vectors.
For example:
The set {(1, 2, 0), (3, 1, 2), (9, 8, 4)} is linearly dependent, since
(9, 8, 4) = 3 (1, 2, 0) + 2 (3, 1, 2).
The set {x − 1, 3x + 5, 5x + 3} is linearly dependent since
5x + 3 = 2(x − 1) + (3x + 5).
Let us consider the implications of this result for two and three vectors.
Linear Dependence of {v1, v2}
The set {v1, v2} is linearly dependent if and only if it is possible to write one vector as a scalar
multiple of the other vector. Let v2 = cv1. This means that v1 and v2 are collinear; see the
following figure for vectors in R3. On the other hand, the set {v1, v2} is linearly independent if
and only if it is not possible to write one vector as a scalar multiple of the other.
Page 23 of 31
lies in the plane generated by v2 and v3 (or line, if the vectors are collinear); see the following
Figure for vectors in R3. On the other hand, {v1, v2, v3} is linearly independent if and only if the
vectors do not lie in a plane.
Examples
Example 1: Show that the set S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} is linearly independent in V 3(R).
Page 24 of 31
Example 3: Prove that the set S = {(1, 3, 2), (1, −7, −8), (2, 1, −1)} is linearly dependent.
Example 4: Determine whether the set {(1, 2, 0), (0, 1, −1), (1, 1, 2)} is linearly independent
in R3 or not?
Solution:
1 2 0
|0 1 −1| = 1(2 + 1) − 2(0 + 1) + 0 = 1 ≠ 0
1 1 2
Example 5: Show that the set S = {(1, 2, 4), (1, 0, 0), (0, 1, 0), (0, 0, 1)} is linearly dependent.
Solution: S can be written as {(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 2, 4)}
Consider, 1 (1, 0, 0) + 2 (0, 1, 0) + 4 (0, 0, 1)
= (1, 0, 0) + (0, 2, 0) + (0, 0, 4)
= (1, 2, 4)
Therefore, (1, 2, 4) can be expressed as a linear combination of its preceding vectors as
1 (1, 0, 0) + 2 (0, 1, 0) + 4 (0, 0, 1).
Therefor, S is linearly dependent.
Example 6: Show that the set {x2 + 1, 3x − 1, −4x + 1} is linearly independent in the vector
space of all polynomials over the field of real numbers.
Solution: Consider the identity c1 (x2+ 1) + c2 (3x - 1) + c3 (−4x + 1) = 0.
This gives c1x2 + (3c2 − 4c3) x + c1 − c2 + c3 = 0.
Such a polynomial can only be zero if each coefficient is zero.
Page 25 of 31
Thus c1 = 0, 3c2 − 4c3 = 0, c1 − c2 + c3 = 0.
This system of equations has the unique solution c1 = 0, c2 = 0, c3 = 0.
The functions are linearly independent.
Example 7: Show that the set {x + 1, x − 1, −x + 5} is linearly dependent in the vector space
of all polynomials over the field of real numbers.
Solution: Consider the identity c1 (x + 1) + c2 (x − 1) + c3 (−x + 5) = 0.
Rewrite as (c1 + c2 − c3) x + (c1 − c2 + 5c3) = 0.
Each coefficient must be zero.
Thus, c1 + c2 − c3 = 0, c1 − c2 + 5c3 = 0.
This system has many solutions, c1 = −2k, c2 = 3k, c3 = k.
Thus, −2k (x + 1) + 3k (x - 1) + k (−x + 5) = O.
If k = l for example, −2 (x + 1) + 3 (x − 1) + 1 (−x + 5) = 0.
The functions are linearly dependent.
BASIS AND DIMENSION
Definition: Let V be a vector space and S = {v1, ..., vn} be a subset of V. Then a set S of vectors
is called a basis for a vector space V if
(i) the set S spans V and
(ii) S is linearly independent.
A vector space V is said to be finite dimensional if it has a finite basis. If there is no finite basis,
we call V an infinite dimensional vector space.
The dimension of a finite dimensional vector space V over a field F is the number of elements
in a basis of V and is denoted by dim (V).
If a vector space V has a basis consisting of n vectors, then the dimension of V is n.
i.e., dim (V) = n
For example,
Consider the set {(1, 2, 3), (−2, 4, 1)} of vectors in R3.
These vectors generate a subspace V of R3 consisting of all vectors of the form
v = c1(1, 2, 3) + c2(−2, 4, 1)
Thus, the vectors (1, 2, 3) and (−2, 4, 1) span this subspace.
Furthermore, since the second vector is not a scalar multiple of the first vector the vectors are
linearly independent.
Therefore {(1, 2, 3), (−2, 4, 1)} is a basis for V. Thus dim (V) = 2.
Page 26 of 31
Properties:
1. For n vector of n dimensional vector space V to be a basis, it is sufficient that they
span V or that they are linearly independent.
2. Let A be any m n matrix which is equivalent to a row reduced echelon matrix E.
Then the non-zero rows of E form a basis of the subspace spanned by the rows of A.
Theorem: Let V be an n dimensional vector space and let S be a set with n vectors. Then the
following are equivalent.
1. S is a basis for V.
2. S is linearly independent.
3. S spans V.
Theorem: If S = {v1, v2, ... , vn} is a basis for a vector space V and T = {w1, w2, ... , wk} is a linearly
independent set of vectors in V, then k < n.
Remark: If S and T are both bases for V then k = n. This says that every basis has the same
number of vectors. Hence the dimension is will defined.
Note:
(i) Since the dimension of a vector space is the number of elements in a basis, the number
of non-zero rows in E is the dimension of the subspace spanned by the rows of A.
(ii) Since the rank of a matrix is the number of non-zero rows, the dimensional of the
subspace spanned by the rows of A is equal to the rank of A.
(iii) To find the basis and the dimension of a subspace spanned the vectors, reduce the matrix
whose rows are the given vectors to echelon form.
EXAMPLES
Example 1: Determine whether the set of vectors {(1, 2, 3), (-2, 1, 3), (3, 1, 0)} is a basis for R3
or not.
Solution: The dimension of R3 is three. Thus, a basis for R3 consists of three vectors. We have
the correct number of vectors for a basis. Normally we would have to show that this set is
linearly independent and that it spans R3, property tells us that we need to check only one of
these two conditions. Let us check for linear independence (this is the easier of the two
conditions to check).
1 2 3
Consider the determinant |−2 1 3| = 1(0 − 3) − 2(0 − 9) + 3(−2 − 3) = 0
3 1 0
Page 27 of 31
Therefore, the vectors are linearly dependent.
Therefore, It is not a basis of R3.
Example 2: Prove that the set {(1, 3, −1), (2, 1, 0), (4, 2, 1)} is a basis for R3.
Solution:
1 3 −1
Consider the determinant |2 1 0 | = 1(1 − 0) − 3(2 − 0) − 1(4 − 4) = −5 ≠ 0
4 2 1
Thus, the vectors are linearly independent.
The set {(l, 3, -1), (2, 1, 0), (4, 2, 1)} is therefore a basis for R3.
Example 3: Find a basis for the subspace V of R4 spanned by the vectors (1, 2, 3, 4),
(−1, −1, −4, −2), (3, 4, 11, 8).
Solution: We construct a matrix A having these vectors as row vectors.
1 2 3 4
𝐴 = [−1 −1 −4 −2]
3 4 11 8
Determine the reduced echelon form of A. We get
1 2 3 4 1 2 3 4 1 2 3 4
[−1 −1 −4 −2] ≈ [0 1 −1 2 ] ≈ [0 1 −1 2]
3 4 11 8 0 −2 2 −4 0 0 0 0
The nonzero vectors of this reduced echelon form, namely (1, 2, 3, 4) and (0, 1, −1, 2),
are a basis for the subspace V. The dimension of this subspace is two.
Example 4. Find the basis and dimension of the subspace spanned by the vectors {(1, −2, 3),
(1, −3, 4), (−1, 1, −2)} in the vector space V3(R).
Solution: Let S = {(1, −2, 3), (1, −3, 4), (−1, 1, −2)} be the given set in the vector space V3(R).
Dim[V3(R)] = 3.
1 −2 3
Consider, | 1 −3 4 | = 1(6 − 4) + 2(−2 + 4) + 3(1 − 3) = 0
−1 1 −2
1 −2 3 1 −2 3 1 −2 3
Consider, [ 1 −3 4 ] ≈ [0 −1 1] ≈ [0 −1 1]
−1 1 −2 0 −1 1 0 0 0
Page 28 of 31
Therefore, Subspace is S’ = {(1, −2, 3), (0, -1, 1)} and the dimension of subspace S’ is 2
V3(R). Dim[V3(R)] = 3.
2 4 2 1 2 1 1 2 1 1 2 1
Consider, [ 1 −1 0 ]≈[ 1 −1 0 ]≈[ 0 −3 −1 ]≈[ 0 −3 −1]
1 2 1 1 2 1 0 0 0 0 0 0
0 3 1 0 3 1 0 3 1 0 0 0
Therefore, Subspace is S’ = {(1, 2, 1), (0, −3, −1)} and the dimension of subspace S’ is 2
V3(R). Dim[V3(R)] = 3.
Page 29 of 31
To find the basis and dimension of the subspace of S
2 −3 1 1 1 1 1 1 1 1 1 1
Consider, [ 3 0 1 ] ≈ [3 0 1] ≈ [ 0 −3 −2 ] ≈ [ 0 −3 −2 ]
0 2 1 0 2 1 0 2 1 0 0 −7
1 1 1 2 −3 1 0 −5 −1 0 0 7
1 1 1
≈ [ 0 −3 −2 ]
0 0 −7
0 0 0
Therefore, Subspace is S’ = {(1, 1, 1), (0, −3, −2), (0, 0, −7)} and the dimension of subspace S’
𝟏 𝟎 𝟎 𝟏 𝟎 𝟎 𝟎 𝟎
Example 8. Show that the set S = {[ ],[ ],[ ],[ ]} form a basis of the vector
𝟎 𝟎 𝟎 𝟎 𝟏 𝟎 𝟎 𝟏
space of the vector space M2(R) of 2 2 matrices and find its dimension.
𝑎 𝑏
Solution: Let [ ] ∈ M2(R)
𝑐 𝑑
𝑎 𝑏 1 0 0 1 0 0 0 0
Let [ ] = 𝑎[ ]+𝑏 [ ]+𝑐 [ ]+𝑑 [ ]
𝑐 𝑑 0 0 0 0 1 0 0 1
1 0 0 1 0 0 0 0 0 0
Therefore, S spans M2(R) and 𝑐1 [ ] + 𝑐2 [ ] + 𝑐3 [ ] + 𝑐4 [ ]=[ ]
0 0 0 0 1 0 0 1 0 0
𝑐1 𝑐2 0 0
implies [𝑐 𝑐 ] = [ ]
3 4 0 0
c1 = 0, c2= 0, c3 = 0, c4 = 0
Given set is linearly independent.
Therefore, S is a basis of M2(R) and dim(S) = 4.
Example 9. Let V = P3 (polynomials of degree 3) and let S = {1, t, t2, t3}. Show that S is a
basis for V.
Linear Independence:
Then since a polynomial is zero if and only if its coefficients are all zero, we have
c1 = c2 = c3 = c4 = 0
Page 30 of 31
Hence S is a linearly independent set of vectors in V.
Span
a + bt + ct2 + dt3
We just let
c1 = a, c2 = b, c3 = c, c4 = d
Hence S spans V.
In general the basis {1, t, t2, ... , tn} is called the standard basis for Pn.
Page 31 of 31
Module-3
Vector Space and Linear Transformations (8 hours)
Importance of Vector Space and Linear Transformations in the field of
Computer Science & Engineering.
Vector spaces: Definition and examples, subspace, linear span, linearly
independent and dependent sets, Basis and dimension. Problems.
Linear transformations: Definition and examples, Algebra of
transformations, Matrix of a linear transformation. Change of coordinates,
Rank and nullity of a linear operator, rank-nullity theorem. Inner product
spaces and orthogonality. Problems.
Self-study: Angles and Projections. Rotation, Reflection, Contraction and
Expansion.
Applications: Image processing, AI & ML, Graphs and networks, Computer
graphics.
(RBT Levels: L1, L2 and L3)
Reference Books
1. David C Lay: “Linear Algebra and its Applications”, Pearson Publishers, 4th
Ed., 2018.
2. Gareth Williams: “Linear Algebra with applications”, Jones Bartlett
Publishers Inc., 6th Ed., 2017.
3. Gilbert Strang: “Linear Algebra and its Applications”, Cengage Publications,
4th Ed., 2022.
Page 1 of 30
LINEAR TRANSFORMATION
Standard Basis
A standard basis, also called a natural basis, is a special orthonormal vector basis in which
each basis vector has a single nonzero entry with value 1.
Page 2 of 30
EXAMPLES
Example 1: Prove that the transformation T: R2 → R2 defined by T (x, y) = (2x, x + y) is
linear.
Solution: Let x = (x1, y1) and y = (x2, y2) be elements of R2 and let c be a scalar.
Then,
T (x + y) = T ((x1, y1) + (x2, y2))
= T (x1 + x2, y1 + y2) by vector addition
= (2x1 + 2x2, x1 + x2 + y1 + y2) by definition of T
= (2x1, x1 + y1) + (2x2, x2 + y2) by vector addition
= T (x1, y1) + T (x2, y2) by definition of T
= T (x) + T (y)
Thus, T preserves vector addition.
We now show that T preserves scalar multiplication.
T (cx) = T (c (x1, y1))
= T (cx1, cy1) by scalar multiplication of a vector
= (2cx1, cx1+ cy1) by definition of T
= c (2x1, x1 + y1) by scalar multiplication of a vector
= c T (x1, y1) by definition of T
= c T (x)
Thus, T preserves scalar multiplication.
Therefore, T is linear.
Example 2: Prove that the transformation T: R2 → R2 defined by T (x, y) = (3x, x + y) is linear.
Find the images of the vectors (1, 3) and (− 1, 2) under this transformation.
Solution: Let x = (x1, y1) and y = (x2, y2) be arbitrary vectors in R2 and c an arbitrary scalar.
Then
T (x + y) = T (x1 + x2, y1+ y2)
= (3(x1 + x2 ), x1 +x2 + y1 + y2)
= (3x1, x1 + y1) + (3x2, x2 + y2)
= T(x) + T(y)
Thus, T preserves vector addition.
We now show that T preserves scalar multiplication.
T (c x) = T (cx1, cy1)
= (3cx1, cx1 + cy1)
= c (3x1, x1 + y1)
= c T(x)
Page 3 of 30
Therefore, T is linear.
By definition of T, we have
T (1, 3) = (3.1, 1 + 3) = (3, 4),
T (−1, 2) = (3. (−1), −1 + 2) = (−3, 1).
Example 6: Verify whether the transformation T: R1 → R3 defined by T (x) = (x, 2x2, x3) is
linear or not.
Solution: Let x = (x1) and y = (x2) be arbitrary vectors in R1 and c be a scalar.
Then
T (x + y) = T (x1 + x2)
= (x1 + x2 , 2(x1 + x2), (y1+y2 ))
T(x) + T(y) = (x1 , 2x1, y1) + (x2 , 2x2, y2)
= (x1 + x2 , 2x12 +2x2, y13+y2 )
Page 5 of 30
T (x + y) T(x) + T(y)
Page 6 of 30
T (x + y) T(x) + T(y)
= T (xe1 + ye2)
= x T(e1) + y T(e2)
−1 4 5 −2
= 𝑥 ( 3 , 3) + 𝑦 (3 , )
3
−𝑥 5𝑦 4𝑥 2𝑦
=(3 + , − )
3 3 3
−𝑥+5𝑦 4𝑥−2𝑦
=( , )
3 3
−𝑥+5𝑦 4𝑥−2𝑦
i.e., T (x, y) = ( , ) is the required liner transformation.
3 3
Example 11. Find a linear transformation T: V2(R) → V3(R) such that T(−1, 1) = (−1, 0, 2) and
T(2, 1) = (1, 2, 1).
Solution: Let us express (−1, 1) and (2, 1) as linear combination of the standard basis
vectors e1 = (1, 0) and e2 = (0, 1).
(−1, 1) = −1(1, 0) + 1(0, 1) = –e1 + e2
2 2 −1 −1 2 5
T(e1) = (3 , 3 , ) and T(e2) = ( 3 , 3 , 3)
3
= T (xe1 + ye2)
= x T(e1) + y T(e2)
2 2 −1 −1 2 5
= 𝑥 (3 , 3 , ) + 𝑦 ( 3 , 3 , 3)
3
Page 8 of 30
Example 12. Find a linear transformation T: V3(R) → V2(R) such that T(1, 0, 0) = (−1, 0),
T(0, 1, 0) = (1, 1) and T(0, 0, 1) = (0, −1).
Solution: e1 = (1, 0, 0), e2 = (0, 1, 0) and e3 = (0, 0, 1).
= (−x + y, y – z)
Example 13. Find a linear transformation T: V3(R) → V3(R) such that T( 1, 1) = (1, 1, 1),
T(1, 2, 3) = (−1, −2, −3) and T(1, 1, 2) = (2, 2, 4).
Solution: Let us express ( 1, 1), (1, 2, 3) and (1, 1, 2) as linear combination of the standard
i.e., T(e1) + T(e2) + T(e3) = (1, 1, 1), T(e1) + 2T(e2) + 3T(e3) = (−1, −2, −3) and
T(e1) = (4, 5, 8), T(e2) = (−4, −5, −10) and T(e3) = (1, 1, 3)
= T (xe1+ye2+ze3)
Page 10 of 30
In order to find this matrix, we must first define a special set of vectors from the domain called
the standard basis.
Page 11 of 30
Examples
1 1 0 1 0 1
T(𝑒⃗⃗⃗⃗)
1 = T [0] = [0] , T(𝑒
⃗⃗⃗⃗)
2 = T [1] = [1] and T(𝑒
⃗⃗⃗⃗)
3 = T [0] = [0]
0 1 0 0 1 1
1 1 1
Therefore, the matrix of the linear transformation is 𝐴 = [0 1 0].
1 0 1
1 0 0
−1 1 0
T(𝑒⃗⃗⃗⃗)
1 = T [ 0] = [ ] , T(𝑒
⃗⃗⃗⃗)
2 = T [ 1] = [ ] and T(𝑒
⃗⃗⃗⃗)
3 = T [ 0] = [ ]
0 1 −1
0 0 1
−1 1 0
Therefore, the matrix of the linear transformation is 𝐴 = [ ].
0 1 −1
1 1 0 −1 0 1
T(𝑒⃗⃗⃗⃗)
1 = T [ 0] = [ 2 ] , T(𝑒
⃗⃗⃗⃗)
2 = T [ 1] = [ 0 ] and T(𝑒
⃗⃗⃗⃗)
3 = T [ 0] = [ −1]
0 1 0 1 1 −2
1 −1 1
Therefore, the matrix of the linear transformation is 𝐴 = [2 0 −1].
1 1 −2
2 3 0
Therefore, the matrix of the linear transformation is 𝐴 = [ ].
0 1 2
1 2 0 1
T(𝑒⃗⃗⃗⃗)
1 = T [ ] = [ ] and T(𝑒
⃗⃗⃗⃗)
2 = T[ ] = [ ]
0 1 1 −2
2 1
Therefore, the matrix of the linear transformation is 𝐴 = [ ].
1 −2
1 0 0
1 −1 0
T(𝑒⃗⃗⃗⃗)
1 = T [0] = [ ] , T(𝑒
⃗⃗⃗⃗)
2 = T [1] = [ ] and T(𝑒⃗⃗⃗⃗)
3 = T [0] = [ ]
0 0 2
0 0 1
1 −1 0
Therefore, the matrix of the linear transformation is 𝐴 = [ ].
0 0 2
1 0 0
1 1 0
T(𝑒⃗⃗⃗⃗)
1 = T [ 0] = [ ] , T(𝑒
⃗⃗⃗⃗)
2 = T [ 1] = [ ] and T(𝑒
⃗⃗⃗⃗)
3 = T [ 0] = [ ]
0 1 1
0 0 1
1 1 0
Therefore, the matrix of the linear transformation is 𝐴 = [ ].
0 1 1
Page 13 of 30
1 1 1
2 1 1
T [1] = [ ] , T [0] = [ ] and T [1] = [ ]
2 0 1
1 0 0
2 1 1
Therefore, the matrix of the linear transformation is 𝐴 = [ ].
2 0 1
1 0 0
Let 𝑓1 = [0] , 𝑓2 = [1], 𝑓3 [0] be the standard basis for R3
0 0 1
1 1
1 0
T(𝑒⃗⃗⃗⃗)
1 = T [ ] = [ 0] = 1𝑓1 + 0𝑓2 + 1𝑓3 and T(𝑒
⃗⃗⃗⃗)
2 = T [ ] = [ 1] = 1𝑓1 + 1𝑓2 + 1𝑓3
0 1
1 0
1 1
Therefore, the matrix of the linear transformation is 𝐴 = [0 1].
1 0
Example 9. Find the matrix of the linear transformation T: R2 → R3 such that
T(−1, 1) = (−1, 0, 2) and T(2, 1) = (1, 2, 1).
1 0
Solution: The standard basis for R2 is ⃗⃗⃗⃗
𝑒1 = [ ] and ⃗⃗⃗⃗
𝑒2 = [ ]
0 1
−1 1 0 2 1 0
[ ] = −1 [ ] + 1 [ ] = −𝑒⃗⃗⃗⃗1 + ⃗⃗⃗⃗
𝑒2 and [ ] = 2 [ ] + 1 [ ] = 2𝑒⃗⃗⃗⃗1 + ⃗⃗⃗⃗
𝑒2
1 0 1 1 0 1
−1 2
T [ ] = T(−𝑒
⃗⃗⃗⃗1 + ⃗⃗⃗⃗)
𝑒2 and T [ ] = T(2𝑒⃗⃗⃗⃗1 + ⃗⃗⃗⃗)
𝑒2
1 1
−1 1
−T(𝑒⃗⃗⃗⃗)
1 +T(𝑒
⃗⃗⃗⃗)
2 = [ 0 ] and 2T(𝑒
⃗⃗⃗⃗)
1 + T(𝑒
⃗⃗⃗⃗)
2 = [ 2]
2 1
2/3 −1/3
T(𝑒⃗⃗⃗⃗)
1 = [ 2/3 ] and T(𝑒
⃗⃗⃗⃗)
2 = [ 2/3 ]
−1/3 5/3
2/3 −1/3
Therefore, the matrix of the linear transformation is 𝐴 = [ 2/3 2/3 ].
−1/3 5/3
Page 14 of 30
Example 10. Find the matrix of the linear transformation T: R2 → R2 such that
T(, 3) = (1, 0) and T(3, 2) = (1, −1).
1 0
Solution: The standard basis for R2 is ⃗⃗⃗⃗
𝑒1 = [ ] and ⃗⃗⃗⃗
𝑒2 = [ ]
0 1
2 1 0 3 1 0
[ ] = 2 [ ] + 3 [ ] = 2𝑒⃗⃗⃗⃗1 + 3𝑒⃗⃗⃗⃗2 and [ ] = 3 [ ] + 2 [ ] = 3𝑒⃗⃗⃗⃗1 + 2𝑒⃗⃗⃗⃗2
3 0 1 2 0 1
2 3
T [ ] = T(2𝑒⃗⃗⃗⃗1 + 3𝑒⃗⃗⃗⃗)
2 and T [ ] = T(3𝑒
⃗⃗⃗⃗1 + 2𝑒⃗⃗⃗⃗)
2
3 2
1 1
2T(𝑒⃗⃗⃗⃗)
1 + 3T(𝑒
⃗⃗⃗⃗)
2 = [ ] and 3T(𝑒
⃗⃗⃗⃗)
1 + 2T(𝑒
⃗⃗⃗⃗)
2 =[ ]
0 −1
1/3 1/5
T(𝑒⃗⃗⃗⃗)
1 =[ ] and T(𝑒⃗⃗⃗⃗)
2 =[ ]
−3/5 2/5
1/3 1/5
Therefore, the matrix of the linear transformation is 𝐴 = [ ].
−3/5 2/5
Example 11. Find the matrix of the linear transformation T: R2 → R3 defined by
T(x, y) = (2y – x, y, 3y – 3x) relative to bases
B1 = {(1, 1), (−1, 1)} and B2 = {(1, 1, 1), (1, −1, 1), (0, 0, 1)}.
Solution: B1 = {(1, 1), (−1, 1)} and B2 = {(1, 1, 1), (1, −1, 1), (0, 0, 1)}
1 1 1 0 3 1 1 0
1 −1
T [ ] = [1] = 𝑎1 [1] + 𝑎2 [−1] + 𝑎3 [0] and T [ ] = [1] = 𝑏1 [1] + 𝑏2 [−1] + 𝑏3 [0]
1 1
0 1 1 1 6 1 1 1
𝑎1 + 𝑎2 = 1, 𝑎1 − 𝑎2 = 1, 𝑎1 + 𝑎2 + 𝑎3 = 0 and 𝑏1 + 𝑏2 = 3, 𝑏1 − 𝑏2 = 1, 𝑏1 + 𝑏2 + 𝑏3 = 6
𝑎1 = 1, 𝑎2 = 0, 𝑎3 = −1 and 𝑏1 = 2, 𝑏2 = 1, 𝑏3 = 3
1 2
Therefore, the matrix of the linear transformation is 𝐴 = [ 0 1].
−1 3
−𝟏 𝟎
Example 12. Find the linear transformation for the matrix 𝑨 = [ 𝟐 𝟎] with respect to the
𝟏 𝟑
bases B1 = {(1, 0, 0), ( 1, 0), (0, 0, 1)} and B2 = {(1, 0), (0, 1)}.
Page 15 of 30
−1 0
Solution: The given matrix is 𝐴 = [ 2 0]
1 3
Define the linear transformation T: R3 → R2 by
1
1 0 −1
T [0] = −1 [ ] + 0 [ ] = [ ],
0 1 0
0
0
1 0 2
T [1] = 2 [ ] + 0 [ ] = [ ] and
0 1 0
0
0
1 0 1
T [0] = 1 [ ] + 3 [ ] = [ ]
0 1 3
1
𝑥
Let [𝑦] R3
𝑧
𝑥 1 0 0
Now, T [𝑦] = x T [0] + y T [1] + z T [0]
𝑧 0 0 1
−1 2 1
= x [ ] + y[ ]+ z [ ]
0 0 3
−𝑥 + 2𝑦 + 𝑧
= [ ]
3𝑧
Therefore, the linear transformation is T(x, y, z) = (−x + 2y + z, 3z).
Page 18 of 30
𝑥 𝑦 𝑧
−2 − 2 −2
= [− 𝑥 + 𝑦 − 3𝑧]
2 2 2
𝑥
𝑥 𝑦 𝑧 𝑥 𝑦 3𝑧
Therefore, the linear transformation is T(x, y, z) = (− 2 − 2 − 2, − 2 + 2 − , x).
2
−𝟏 𝟎
Example 16. Find the linear transformation for the matrix 𝑨 = [ 𝟐 𝟎] with respect to the
𝟏 𝟑
bases B1 = {(1, 2, 0), ( −1, 0), (1, −1, 1)} and B2 = {(1, 0), (2, −1)}.
−1 0
Solution: The matrix is 𝐴 = [ 2 0]
1 3
Define the linear transformation T: R3 → R2 by
1
1 2 −1
T [2] = −1 [ ] + 0 [ ] = [ ],
0 −1 0
0
0
1 2 2
T [−1] = 2 [ ] + 0 [ ] = [ ] and
0 −1 0
0
1
1 2 7
T [−1] = 1 [ ] + 3 [ ] = [ ]
0 1 −3
1
1 1 0 0
Now, [2] = 1 [0] + 2 [1] + 0 [0]
0 0 0 1
1 1 0 0
T [2] = 1 T [0] + 2 T [1] + 0 T [0]
0 0 0 1
−1
[ ] = T(𝑒⃗⃗⃗⃗)
1 + 2 T(𝑒 ⃗⃗⃗⃗)
2 ------ (1)
0
0 1 0 0
[−1] = 0 [0] − 1 [1] + 0 [0]
0 0 0 1
0 1 0 0
T [−1] = 0 T [0] − 1 T [1] + 0 T [0]
0 0 0 1
2
[ ] = − T(𝑒⃗⃗⃗⃗)
2 ------ (2)
0
1 1 0 0
And [−1] = 1 [0] − 1 [1] + 1 [0]
1 0 0 1
1 1 0 0
T [−1] = 1 T [0] − 1 T [1] + 1 T [0]
1 0 0 1
Page 19 of 30
7
[ ] = T(𝑒⃗⃗⃗⃗)
1 − T(𝑒
⃗⃗⃗⃗)
2 + T(𝑒
⃗⃗⃗⃗)
3 ------ (3)
−3
Solving (1), (2) and (3), we get
3 −2 2
T(𝑒⃗⃗⃗⃗)
1 = [ ] , T(𝑒
⃗⃗⃗⃗)
2 =[ ] and T(𝑒⃗⃗⃗⃗)
3 =[ ]
0 0 −3
𝑥 1 0 0
Now, T [𝑦] = x T [0] + y T [1] + z T [0]
𝑧 0 0 1
= 𝑥 T(𝑒⃗⃗⃗⃗)
1 + 𝑦 T(𝑒
⃗⃗⃗⃗)
2 + 𝑧 T(𝑒
⃗⃗⃗⃗)
3
3 −2 2
= x [ ] + y[ ]+ z [ ]
0 0 −3
3𝑥 − 2𝑦 + 2𝑧
= [ ]
−3𝑧
Therefore, the linear transformation is T(x, y, z) = (x −2y + 2z, −3z).
Therefore, the linear transformation is T(x, y, z) = (−x + 2y + z, 3z).
Coordinate Vector
In a vector space, any vector can be written as a linear combination of a basis. The
coefficients of the linear combination are called the coordinates of the vector with respect to
the basis.
If B = {v1, v2, . . ., vn} is a basis for a vector space V, then any vector v ∈ V has a unique
representation v = x1v1 + x2v2 + ・ ・ ・ + xnvn, where xi ∈ R.
𝑥1
The column vector vB = [ ⋮ ] is called the co-ordinate vector of v relative to this basis.
𝑥𝑛
The scalars x1, x2, . . ., xn are called the coordinates of v with respect to the ordered basis
v1, v2, . . ., vn.
Example 1. Find the coordinates of the vector v = (7, 4) with respect to the vectors u1 = (2, 1)
and u2 = (3, 1) form a basis for R2.
Solution: In order to find the coordinate vector v relative to the basis S = {u1, u2}, we must
find scalars x1 and x2 such that x1u1 + x2 u2 = v.
2 3 7
x1[ ] + x2 [ ] = [ ]
1 1 4
2x1 + 3x2 =7 and x1 + x2 = 4
By solving we get, x1 = 5, x2 = − 1
5
The co-ordinate vector of v is vs = [ ].
−1
Page 20 of 30
Example 2. Find the coordinate vector w whose coordinates with respect to the basis
u1 = (1, −1) and u2 = (1, 1) are (0, 1).
Solution: In order to find the coordinate vector w relative to the basis S= {u1, u2}, we must
find scalars x1 and x2 such that x1u1 + x2 u2 = w.
1 1 0
x1[ ] + x2 [ ] = [ ]
−1 1 1
x1+ x2 = 0 and −x1 + x2 = 1
By solving we get, x1= − ½, x2 = ½
1
−
The co-ordinate vector of w is ws = [ 1 2].
2
Example 3. Find the co-ordinate vector of (10, 5, 0) relative to the vectors (1, −1 ,1), (0 ,1, 2)
and (3 ,0, −1).
Solution: Let v = (10, 5, 0) and u1 = (1, −1 ,1), u2 = (0 ,1, 2) and u3 = (3 ,0, −1).
In order to find the coordinate vector v relative to the basis S= {u1, u2, u3}, we must find
scalars x1, x2 and x3 such that x1u1 + x2 u2 + x3 u3 = v.
1 0 3 10
x1[−1] + x2 [1] + x3 [ 0 ]= [ 5 ]
1 2 −1 0
x1+ 3x3 = 10, −x1 + x2 = 5 and x1 +2x2 − x3 =0
By solving we get, x1= − 3, x2 = 2 and x3 = 1
−3
The co-ordinate vector of v is vs = [ 2 ].
1
Change-of-coordinates
A change-of-coordinates matrix is such a matrix that mathematically
vectors one by one with the transition matrix, which gives us the basis vectors
Page 21 of 30
Now if we have to convert them to a standard Rn coordinate, the change-of-coordinates
| | |
matrix is simply given by: [𝑣1 … 𝑣𝑛 ]
| | |
The standard change of coordinates matrix or the transition matrix M for the
following basis vectors:
𝑎 𝑑 𝑔
B = {[𝑏 ] , [ 𝑒 ] , [ℎ ]}
𝑐 𝑓 𝑖
𝑎 𝑏 𝑐
is given by M = [𝑑 𝑒 𝑓]
𝑔 ℎ 𝑖
Example: Find the transition matrix from the basis v1 = (1, 2, 3), v2 = (1, 0, 1), v3 = (1, 2, 1)
to the basis u1 = (1, 1, 0), u2 = (0, 1, 1), u3 = (1, 1, 1).
Solution: It is convenient to make a two-step transition:
First from v1, v2, v3 to e1, e2, e3 and then from e1, e2, e3 to u1, u2, u3.
Let U1 be the transition matrix from v1, v2, v3 to e1, e2, e3 and U2 be the transition matrix from
u1, u2, u3 to e1, e2, e3:
Page 22 of 30
1 1 1 1 0 1
U1 = (2 0 2) and U2 = (1 1 1)
3 1 1 0 1 1
Thus, the transition matrix from v1, v2, v3 to u1, u2, u3 is U2 −1 U1.
1 0 1 −1 1 1 1
U2 −1 U1 = (1 1 1) (2 0 2)
0 1 1 3 1 1
0 1 −1 1 1 1
= (−1 1 0 ) (2 0 2 )
1 −1 1 3 1 1
−1 −1 1
= ( 1 −1 1)
2 2 0
Page 23 of 30
The Fundamental Spaces of a Matrix
Suppose that A is a m n matrix that maps vectors in Rn to vectors in Rm. The four
fundamental subspaces associated with A, two in Rn and two in Rm, are:
• row space of A, the set of all x for which Ax is nonzero,
• null space of A, the set of all x for which Ax = 0,
• column space of A, the set of all y for which ATy is nonzero.
• left null space of A, the set of all y for which ATy = 0.
The row space and the null space are orthogonal to each other and span all of Rn. The column
space and the left null space are also orthogonal to each other and span all of Rm.
ROW SPACE, COLUMN SPACE AND NULLSPACE
Let A be a m n matrix, then
(i) the row space of A is the subspace of Rn spanned by the row vectors of A
(ii) the column space of A is the subspace of Rm spanned by the column vectors of A.
(iii) The solution space of the homogeneous system of equations Ax = 0, which is a
subspace of Rn, is called the nullspace (or kernal) of A.
Dimension and rank.
The dimension of a subspace is the number of linearly independent vectors required
to span that space.
The Fundamental Theorem of Linear Algebra is
“The dimension of the row space is equal to the dimension of the column space”.
In other words, the number of linearly independent rows is equal to the number of linearly
independent columns. This may seem obvious, but it is actually a subtle fact that requires
Page 24 of 30
left nullspace ��Rm ker(��)ker(AT) �−�m−r Last �−�m−r columns
(kernel) of �U
Row Space and Null Space are orthogonal complements i.e. transpose of any vector in row
space multiplied with any vector in null space will give 0 as product.
Null space is a matrix, which on multiplication with A gives zero matrix as product.
Column space of any matrix is orthogonal to left null space of that matrix.
Example Find bases for the row space, the column space and the null space of the matrix
−𝟐 −𝟓 𝟖 𝟎 −𝟏𝟕
𝑨= [ 𝟏 𝟑 −𝟓 𝟏 𝟓 ]
𝟑 𝟏𝟏 −𝟏𝟗 𝟕 𝟏
𝟏 𝟕 −𝟏𝟑 𝟓 −𝟑
Solution: To find bases for the row space and the column space, reduce the matrix to row
echelon form:
Page 25 of 30
1 3 −5 1 5
𝐴 ~𝐵 = [0 1 −2 2 −7]
0 0 0 −4 20
0 0 0 0 0
The first 3 rows of B form a basis for the row space of A.
Thus, basis for row A = {(1, 3, -5, 1, 5), (0, 1, -2, 2, -7), (0, 0, 0, -4, 20)}.
For the column space, observe from B that the pivots are in column 1, 2 and 4. Hence columns 1,
2 and 4 of A (not B) form a basis of col A:
−2 −5 0
Basis for col A: {[ 1 ] , [ 3 ] , [1]}
3 11 7
1 7 5
NULLSPACE
The nullspace N(T) of a linear transformation T: U → V is
N(T) = {x ∈ U | T(x) = 0}.
NULLITY
RANGE
The range R(T) of a linear transformation T: U → V is
R(T) = {y ∈ V ∣ y = T(x) for some x ∈ U}.
RANK
The rank of T is the dimension of R(T).
Examples
Example 1: Find the kernel and range of the linear operator T (x, y, z) = (x, y, O)
Solution: Since the linear operator T maps R3 into R3 the kernel and range will both be
subspaces of R3.
Kernel: ker(T) is the subset that is mapped into (0, 0, 0).
We see that, T (x, y, z) = (x, y, O) = (0, 0, 0) if x = 0, y = 0
Thus ker (T) is the set of all vectors of the form (0, 0, z).
We express this ker(T) = {(0, 0, z)}
Geometrically, ker(T) is the set of all vectors that lie on the z-axis.
Range: The range of T is the set of all vectors of the form (x, y, 0).
Thus range(T) = {(x, y, O)}
range(T) is the set of all vectors that lie in the xy-plane.
Example 2: Find the kernel and range of the linear operator T (x, y, z) = (x + y, z) of R3 → R2
Solution: Since the linear operator T maps R3 into R2 the kernel is subspaces of R3 and range
will both be subspaces of R2.
Kernel: ker(T) is the subset that is mapped into (0, 0, 0).
Page 27 of 30
We see that, T (x, y, z) = (x + y, z) = (0, 0) if x = 0, y = 0, z = 0
Thus ker (T) is the set of all vectors of the form (0, 0, 0).
We express this ker(T) = {(0, 0, 0)}
Range: The range of T is the set of all vectors of the form (x + y, z).
Thus range(T) = {(x, y, O)}
range(T) is the set of all vectors that lie in the xy-plane.
Example 3: Determine the kernel and the range of the transformation defined by the following
matrix.
𝟏 𝟐 𝟑
𝑨 = [𝟎 −𝟏 𝟏]
𝟏 𝟏 𝟒
Solution: A is 3 3 matrix. Thus, A defines a linear operator T: R3 → R3, T (x) = Ax
The elements of R3 are written in column matrix form for the purpose of matrix multiplication.
For convenience, we express the elements of R3 in row form at all other times.
Kernel: The kernel will consist of all vectors x = (x1, x2, x3) in R3 such that T (x) = 0
Thus
1 2 3 𝑥1 0
[0 −1 1] [𝑥2 ] = [0]
1 1 4 𝑥3 0
This matrix equation corresponds to the following system of linear equations.
x1 + 2x2 + 3x3 = 0
−x2 + x3 = 0
x1 + x2 + 4x3 = 0
On solving this system, we get many solutions, x1 = −5k, x2 = k, x3 = k.
The kernel is thus the set of vectors of the form (−5k, k, k). i.e., Ker (T) = {(−5k, k, k)}
Ker (T) is a one-dimensional subspace of R3 with basis (−5, 1, 1)
Range: The range is spanned by the column vectors of A. Write these column vectors as
rows of a matrix and compute an echelon form of the matrix. The nonzero row vectors
will give a basis for the range. We get
1 0 1 1 0 1 1 0 1 1 0 1
[2 −1 1] ≈ [ 0 −1 −1 ] ≈ [0 1 1 ] ≈ [ 0 1 1]
3 1 4 0 1 1 0 1 1 0 0 0
The vectors (1, 0, 1) and (0, 1, 1) span the range of T.
An arbitrary vector in the range will be a linear combination of these vectors,
s (l, O, 1) + t (O, 1, 1)
Thus, the range of T is
Page 28 of 30
Range (T) = {(s, t, s + t)}
The vectors (1, 0, 1) and (0, 1, 1) are also linearly independent.
Range (T) is a two-dimensional subspace of R3 with basis {(1, 0, 1), (0, 1, 1)}.
Example 4: Consider the following matrix A and the linear transformation T defined by A. Find
rank(A), dim domain(T), dim range(T), dim ker(T), and nullity(T).
𝟏 𝟎 𝟑
𝑨 = [𝟎 𝟏 𝟓]
𝟎 𝟎 𝟎
Hence verify Rank-nullity theorem.
Solution: Observe that the matrix A is in echelon form. The nonzero row vectors are linearly
independent. Thus, rank(A) = 2. Therefore, rank (T) = 2.
Since A is 3 3 matrix, T: R3 → R3. Thus, dim domain(T) = 3.
dim range(T) = rank(A) = 2.
dim ker(T) = dim domain(T) − dim range(T) = 3 − 2 = 1.
nullity(T) = dim kernel(T) = 1.
Example 5: Verify Rank-nullity theorem for the linear transformation R: V3(R) → V2(R)
defined by T (x, y, z) = (y – x, y – z).
1 1 1
Solution: The standard basis for R3 is ⃗⃗⃗⃗
𝑒1 = [0] , ⃗⃗⃗⃗
𝑒2 = [1] and ⃗⃗⃗⃗
𝑒3 = [0]
0 0 1
1 0 0
−1 1 0
T(𝑒⃗⃗⃗⃗)
1 = T [ 0] = [ ] , T(𝑒
⃗⃗⃗⃗)
2 = T [ 1] = [ ] and T(𝑒
⃗⃗⃗⃗)
3 = T [ 0] = [ ]
0 1 −1
0 0 1
−1 0 1 0 1 0 1 0
Consider, [ 1 1 ] ≈ [1 1] ≈ [0 1] ≈ [0 1]
0 −1 0 1 0 1 0 0
The final matrix is in echelon form. It has two non-zero rows.
Therefore, dim R(T) = 2.
R(T) = {(1, 0), (0, 1)} V2(R) = Range space.
To find nullity: T (x, y, z) = (0, 0)
(y – x, y – z) = (0, 0)
y – x = 0 and y – z = 0
x=y=z
Page 29 of 30
Therefore, the null space N(T) = {(x, x, x) | x R}.
Thus, Nullity = N(T) = 1
Thus, Rank + Nullity = 2 + 1 = 3 = dim (V3(R))
Page 30 of 30