Not all matrices are diagonalizable, however, most matrices are, in a sense that any non-diagonalizable matrix is infinitesimally close to a diagonalizable one.
Symmetric matrices are always diagonalizable, with real eigenvalues and orthogonal eigenvectors
Any square matrix can be written as A=VDV−1, where V is a square (possibly complex-valued) invertible matrix, and D:=diag(J(λ1),…,J(λp)) where each block J(λ) is a Jordan Block
λ1,…,λp are (possibly equal) eigenvalues of A
By convention J(λ)=λ when the size of that matrix is 1 .
A diagonalizable matrix has Jordan blocks of size 1 only.
The λi ‘s are (possibly equal, possibly complex) eigenvalues.
Applications:
Matrrix powers:
Assume that A is diagonalizable: A=VDV−1, with D diagonal. Then any power of A can be easily computed, as Ak=VDkV−1,k=1,2,3,…
Cayley-Hamilton Theorem: For any square matrix A, if p(λ):=det(λI−A) is the characteristic polynomial of A, then p(A)=0
Matrix exponential:
For a square matrix we define the exponential as eA:=k=0∑+∞k!1Ak
Using the Jordan decomposition we can prove that the series always converges.
For diagonalizable matrices A=VDV−1 with D=diag(λ1,…,λn) and V invertible, we have eA=VeDV−1,eD:=diag(eλ1,…,eλn)
Roots of polynomial:
We can use eigenvalue decomposition to find the zeroes of a (univariate) polynomial: let p(s):=sn+a1sn−1+…+an−1s+an
where a∈Rn is given.
Define the n×n “companion” matrix A=00⋮0−a110⋮0−a201⋮0−a3⋯⋯⋱⋯⋯00⋮1−an
Fact: we have p(s)=det(sI−A)
proof: s is root if and only if the vector v:=(1,s,...,sn−1) is an eigenvector of A, with eigenvalue s
Linear discrete dynamical systems:
Consider the (discrete-time) linear dynamical system x(t+1)=Ax(t)+Bu(t),t=0,1,2,…,
We have for every T≥0:x(T)=ATx(0)+t=0∑T−1AtBu(t)
Asymptotic stability:
Assume that u(t)=0 for every t:x(t+1)=Ax(t),t=0,1,2,…
The system is said to be asymptotically stable if, from any initial condition, we return to the equilibrium state x=0 : that is T→+∞limx(T)=0
Asymptotic stability is equivalent to AT→0 as T→+∞. In turn, this is the same as ∣λi∣<1, for every i=1,…,n.
Continuous-time case
Consider the (continuous-time) linear dynamical system dtdx(t)=Ax(t)+Bu(t),t≥0
For every T≥0:x(T)=eTAx(0)+∫0Te(T−t)ABu(t)dt
Proof: we can show that dtdetA=AetA
Asymptotic stability is equivalent to eTA→0 as T→+∞. In turn, this is the same as Re(λi):=λi+λˉi<0, for every i=1,…,n.
examples: structure dynamics
Dynamical model of mechanical structure (e.g., bridge) My¨(t)+Ky(t)=f(t) where
y(t)∈Rn contains position at n discrete locations on bridge
M, the “mass matrix”, is positive-definite
K, the “stiffness” matrix, is positive semi-definite
f(t) is a forcing function (e.g., wind)
Stability of system related to eigenvalues of A:=(0−M−1KI0)