Questions tagged [diagonalization]

For questions about matrix diagonalization. Diagonalization is the process of finding a corresponding diagonal matrix for a diagonalizable matrix or linear map. This tag is NOT for diagonalization arguments common to logic and set theory.

A square matrix $A$ is diagonalisable if there is an invertible matrix $P$ such that $P^{-1}AP$ is a diagonal matrix. One can view $P$ as a change of basis matrix so that, if $A$ is viewed as the standard matrix of a linear map $T$ from a vector space to itself in some basis, it is equivalent to say there exists an ordered basis such that the standard matrix of $T$ is diagonal. Diagonal matrices present the eigenvalues of the corresponding linear transformation along its diagonal. A square matrix that is not diagonalizable is called defective.

Not every matrix is diagonalisable over $\mathbb{R}$ (i.e. only allowing real matrices $P$). For example, $$\begin{pmatrix} 0 & -1 \\ 1 & 0 \end{pmatrix}$$

Diagonalization can be used to compute the powers of a matrix $A$ efficiently, provided the matrix is diagonalizable.

Diagonalization Procedure :

Let $A$ be the $n×n$ matrix that you want to diagonalize (if possible).

  • Find the characteristic polynomial $p(t)$ of $A$.
  • Find eigenvalues $λ$ of the matrix $A$ and their algebraic multiplicities from the characteristic polynomial $p(t)$.
  • For each eigenvalue $λ$ of $A$, find a basis of the eigenspace $E_λ$. If there is an eigenvalue $λ$ such that the geometric multiplicity of $λ$, $dim(E_λ)$, is less than the algebraic multiplicity of $λ$, then the matrix $A$ is not diagonalizable. If not, $A$ is diagonalizable, and proceed to the next step.

  • If we combine all basis vectors for all eigenspaces, we obtained $n$ linearly independent eigenvectors $v_1,v_2,…,v_n$.

  • Define the nonsingular matrix $$P=[v_1\quad v_2\quad …\quad v_n]$$
  • Define the diagonal matrix $D$, whose $(i,i)$-entry is the eigenvalue $λ$ such that the $i^{th}$ column vector $v_i$ is in the eigenspace $E_λ$.
  • Then the matrix A is diagonalized as $$P^{−1}AP=D$$

References:

Diagonal Matrix on Wikipedia

Matrix Diagonalization on Wolfram MathWorld

2248 questions
161
votes
7 answers

Intuitively, what is the difference between Eigendecomposition and Singular Value Decomposition?

I'm trying to intuitively understand the difference between SVD and eigendecomposition. From my understanding, eigendecomposition seeks to describe a linear transformation as a sequence of three basic operations ($P^{-1}DP$) on a vector: Rotation…
user541686
  • 12,494
  • 15
  • 48
  • 93
59
votes
3 answers

Eigenvalues of the rank one matrix $uv^T$

Suppose $A=uv^T$ where $u$ and $v$ are non-zero column vectors in ${\mathbb R}^n$, $n\geq 3$. $\lambda=0$ is an eigenvalue of $A$ since $A$ is not of full rank. $\lambda=v^Tu$ is also an eigenvalue of $A$ since $$Au = (uv^T)u=u(v^Tu)=(v^Tu)u.$$…
43
votes
3 answers

Diagonalizable transformation restricted to an invariant subspace is diagonalizable

Suppose $V$ is a vector space over $\mathbb{C}$, and $A$ is a linear transformation on $V$ which is diagonalizable. I.e. there is a basis of $V$ consisting of eigenvectors of $A$. If $W\subseteq V$ is an invariant subspace of $A$ (so $A(W)\subseteq…
NGY
  • 947
  • 1
  • 8
  • 13
43
votes
2 answers

Simultaneous diagonalization of commuting linear transformations

Let $V$ be a vector space of finite dimension and let $T,S$ linear diagonalizable transformations from $V$ to itself. I need to prove that if $TS=ST$ every eigenspace $V_\lambda$ of $S$ is $T$-invariant and the restriction of $T$ to $V_\lambda$…
user6163
40
votes
2 answers

Are most matrices diagonalizable?

More precisely, does the set of non-diagonalizable (over $\mathbb C$) matrices have Lebesgue measure zero in $\mathbb R^{n\times n}$ or $\mathbb C^{n\times n}$? Intuitively, I would think yes, since in order for a matrix to be non-diagonalizable…
34
votes
5 answers

Symmetric matrix is always diagonalizable?

I'm reading my linear algebra textbook and there are two sentences that make me confused. (1) Symmetric matrix $A$ can be factored into $A=Q\lambda Q^{T}$ where $Q$ is orthogonal matrix : Diagonalizable ($Q$ has eigenvectors of $A$ in its columns,…
niagara
  • 685
  • 1
  • 9
  • 17
33
votes
5 answers

If two matrices have the same eigenvalues and eigenvectors are they equal?

The question stems from a problem i stumbled upon while working with eigenvalues. Asking to explain why $A^{100}$ is close to $A^\infty$ $$A= \left[ \begin{array}{cc} .6 & .2 \\ .4 & .8 \end{array} \right] $$ $$A^\infty= \left[…
31
votes
2 answers

Are idempotent matrices always diagonalizable?

How to prove that any idempotent matrix is diagonalizable?
Lao-tzu
  • 2,658
  • 1
  • 20
  • 33
31
votes
5 answers

How to determine the diagonalizability of these two matrices?

I am trying to figure out how to determine the diagonalizability of the following two matrices. For the first matrix $$\left[\begin{matrix} 0 & 1 & 0\\0 & 0 & 1\\2 & -5 & 4\end{matrix}\right]$$ There are two distinct eigenvalues, $\lambda_1 =…
dtg
  • 1,343
  • 11
  • 27
  • 34
25
votes
2 answers

Can a matrix be invertible but not diagonalizable?

While reading a chapter on diagonalizable matrices, I found myself wondering: Can a matrix $A \in \mathbb R^{n \times n}$ be invertible but not diagonalizable? My quick Google search did not return a clear answer.
Garrett
  • 1,241
  • 1
  • 9
  • 17
23
votes
4 answers

Block diagonal matrix diagonalizable

I am trying to prove that: The matrix $C = \left(\begin{smallmatrix}A& 0\\0 & B\end{smallmatrix}\right)$ is diagonalizable, if only if $A$ and $B$ are diagonalizable. If $A\in GL(\mathbb{C}^n)$ and $B\in GL(\mathbb{C}^m)$ are diagonalizable, then…
FASCH
  • 1,632
  • 1
  • 16
  • 28
22
votes
3 answers

Intuition on spectral theorem

In the last month I studied the spectral theorems and I formally understood them. But I would like some intuition about them. If you didn’t know spectral theorems, how would you come up with the idea that symmetric/normal endomorphisms are the only…
22
votes
5 answers

A matrix is diagonalizable, so what?

I mean, you can say it's similar to a diagonal matrix, it has $n$ independent eigenvectors, etc., but what's the big deal of having diagonalizability? Can I solidly perceive the differences between two linear transformation one of which is…
xzhu
  • 3,933
  • 1
  • 26
  • 50
20
votes
2 answers

Quick way to check if a matrix is diagonalizable.

Is there any quick way to check whether a matrix is diagonalizable or not? In exam if a question is asked like "Which of the following matrix is diagonalizable?" and four options are given then how can one check it quickly? I hope my question makes…
zafran
  • 824
  • 1
  • 5
  • 14
19
votes
3 answers

Eigenvector and eigenvalue for exponential matrix

$X$ is a matrix. Let $v$ be an eigenvector of $X$ with corresponding eigenvalue $a$. Show that $v$ is also an eigenvector of $e^{X}$ with eigenvalue $e^{a}$ If $X$ is diagonalizable, then we can start writing out terms using Taylor expansion of…
1
2 3
99 100