Questions tagged [linear-algebra]

For questions about vector spaces of all dimensions and linear transformations between them, including systems of linear equations, bases, dimensions, subspaces, matrices, determinants, traces, eigenvalues and eigenvectors, diagonalization, Jordan forms, etc. For questions specifically concerning matrices, use the (matrices) tag. For questions specifically concerning matrix equations, use the (matrix-equations) tag.

Linear algebra is concerned with vector spaces of all dimensions and linear transformations between them (e.g. $(x_1, \dots, x_n)\mapsto a_1x_1 + \dots + a_nx_n$). Concepts include systems of linear equations, bases, dimensions, subspaces, matrices, determinants, kernels, null spaces, column spaces, traces, eigenvalues and eigenvectors, diagonalization, Jordan normal forms, and so forth.

This is a general tag, and most of the subjects included in its scope also have secondary tags (e.g. , , , , , etc.). Please consider using the appropriate secondary tags as they are applicable.

See here for more information.

116358 questions
187
votes
7 answers

How to intuitively understand eigenvalue and eigenvector?

I'm learning multivariate analysis and I have learnt linear algebra for two semester when I was a freshman. Eigenvalue and eigenvector is easy to calculate and the concept is not difficult to understand.I found that there are many application of…
181
votes
12 answers

Inverse of the sum of matrices

I have two square matrices: $A$ and $B$. $A^{-1}$ is known and I want to calculate $(A+B)^{-1}$. Are there theorems that help with calculating the inverse of the sum of matrices? In general case $B^{-1}$ is not known, but if it is necessary then it…
Tomek Tarczynski
  • 2,524
  • 4
  • 18
  • 17
167
votes
20 answers

Calculate Rotation Matrix to align Vector A to Vector B in 3d?

I have one triangle in 3d space that I am tracking in a simulation. Between time steps I have the the previous normal of the triangle and the current normal of the triangle along with both the current and previous 3d vertex positions of the…
user1084113
  • 1,849
  • 4
  • 13
  • 10
163
votes
8 answers

Is there a quick proof as to why the vector space of $\mathbb{R}$ over $\mathbb{Q}$ is infinite-dimensional?

It would seem that one way of proving this would be to show the existence of non-algebraic numbers. Is there a simpler way to show this?
Elchanan Solomon
  • 27,884
  • 6
  • 55
  • 88
161
votes
7 answers

Intuitively, what is the difference between Eigendecomposition and Singular Value Decomposition?

I'm trying to intuitively understand the difference between SVD and eigendecomposition. From my understanding, eigendecomposition seeks to describe a linear transformation as a sequence of three basic operations ($P^{-1}DP$) on a vector: Rotation…
user541686
  • 12,494
  • 15
  • 48
  • 93
156
votes
21 answers

Looking for an intuitive explanation why the row rank is equal to the column rank for a matrix

I am looking for an intuitive explanation as to why/how row rank of a matrix = column rank. I've read the proof on Wikipedia and I understand the proof, but I don't "get it". Can someone help me out with this ? I find it hard to wrap my head around…
hari_sree
  • 1,821
  • 3
  • 12
  • 6
150
votes
1 answer

Is the following matrix invertible?

$$\begin{bmatrix} 1235 &2344 &1234 &1990\\ 2124 & 4123& 1990& 3026 \\ 1230 &1234 &9095 &1230\\ 1262 &2312& 2324 &3907 \end{bmatrix}$$ Clearly, its determinant is not zero and, hence, the matrix is invertible. Is there a more elegant way to do…
Yongkai
  • 1,729
  • 3
  • 12
  • 7
147
votes
16 answers

Where to start learning Linear Algebra?

I'm starting a very long quest to learn about math, so that I can program games. I'm mostly a corporate developer, and it's somewhat boring and non exciting. When I began my career, I chose it because I wanted to create games. I'm told that Linear…
Sergio Tapia
145
votes
19 answers

What is the difference between a point and a vector?

I understand that a vector has direction and magnitude whereas a point doesn't. However, in the course notes that I am using, it is stated that a point is the same as a vector. Also, can you do cross product and dot product using two points instead…
6609081
  • 1,555
  • 2
  • 11
  • 6
141
votes
3 answers

Why is the eigenvector of a covariance matrix equal to a principal component?

If I have a covariance matrix for a data set and I multiply it times one of it's eigenvectors. Let's say the eigenvector with the highest eigenvalue. The result is the eigenvector or a scaled version of the eigenvector. What does this really…
Ryan
  • 5,069
  • 6
  • 18
  • 10
140
votes
12 answers

Why do we use the word "scalar" and not "number" in Linear Algebra?

During a year and half of studying Linear Algebra in academy, I have never questioned why we use the word "scalar" and not "number". When I started the course our professor said we would use "scalar" but he never said why. So, why do we use the word…
LiziPizi
  • 2,717
  • 3
  • 19
  • 34
135
votes
8 answers

Show that the determinant of $A$ is equal to the product of its eigenvalues

Show that the determinant of a matrix $A$ is equal to the product of its eigenvalues $\lambda_i$. So I'm having a tough time figuring this one out. I know that I have to work with the characteristic polynomial of the matrix $\det(A-\lambda I)$.…
onimoni
  • 5,646
  • 8
  • 26
  • 42
131
votes
9 answers

Is the inverse of a symmetric matrix also symmetric?

Let $A$ be a symmetric invertible matrix, $A^T=A$, $A^{-1}A = A A^{-1} = I$ Can it be shown that $A^{-1}$ is also symmetric? I seem to remember a proof similar to this from my linear algebra class, but it has been a long time, and I can't find it in…
gregmacfarlane
  • 1,501
  • 2
  • 11
  • 11
130
votes
10 answers

Physical meaning of the null space of a matrix

What is an intuitive meaning of the null space of a matrix? Why is it useful? I'm not looking for textbook definitions. My textbook gives me the definition, but I just don't "get" it. E.g.: I think of the rank $r$ of a matrix as the minimum number…
user541686
  • 12,494
  • 15
  • 48
  • 93
130
votes
10 answers

When is matrix multiplication commutative?

I know that matrix multiplication in general is not commutative. So, in general: $A, B \in \mathbb{R}^{n \times n}: A \cdot B \neq B \cdot A$ But for some matrices, this equations holds, e.g. A = Identity or A = Null-matrix $\forall B \in…
Martin Thoma
  • 9,359
  • 14
  • 56
  • 123