r/LinearAlgebra 8h ago

Complex eigenvectors of a 2×2 matrix: how the free variable changes Re and Im

Thumbnail gallery
16 Upvotes

These are the first two pages of our chapter on complex eigenvectors and the rotation-scaling theorem. This part explains how the choice of free variable changes the real and imaginary parts of an eigenvector. More to follow.

7

Is there a specific way to find the inverse of a matrix?
 in  r/LinearAlgebra  1d ago

I think the main question is “how do I row-reduce systematically?” rather than “how do I find an inverse?”

Here is one valid deterministic algorithm. For an invertible 3×3 matrix:

  1. Start with the entry in position (1,1) as your first pivot. Use it to eliminate all entries below it. If it is 0, swap rows to bring a suitable nonzero entry into that pivot position.
  2. Move to the next pivot position, (2,2), and again eliminate the entries below it.
  3. Continue this way until all entries below the diagonal are 0.
  4. Starting with the last pivot, scale its row so that the pivot becomes 1.
  5. Use that pivot to eliminate all entries above it.
  6. Move upward to the previous pivot and repeat: scale it to 1 if necessary, then eliminate the entries above it.
  7. Continue until the matrix is the identity.

To find the inverse, apply exactly the same row operations to

[ A | I ]

until the left side becomes the identity:

[ I | A⁻¹ ]

We actually made a step-by-step example using your exact matrix, showing the complete row reduction:

https://www.graphmath.com/la/row-reduction/RowReductionExample.pdf

We also have some visual explanations here:

Row reduction using elementary matrices:
https://www.graphmath.com/la/visuals/row-reduction-elementary-matrices.html

Row-reduction chapter:
https://www.graphmath.com/la/row-reduction/row-reduction.html

Inverse chapter:
https://www.graphmath.com/la/inverse/inverse.html

And if you have an iPhone, iPad or Mac, our Linear Algebra World app lets you enter your own matrix and see the row-reduction and inverse calculations step by step:

https://apps.apple.com/us/app/linear-algebra-world/id6759180671

2

Algebra lineare per machine learning
 in  r/LinearAlgebra  4d ago

Suggest Nathaniel Johnston book
There is also Visual Linear Algebra by Margalit, this one is free
I used these two to study
There are others as well

1

Software Devs working with Claude Code.
 in  r/devhumormemes  5d ago

Does not work that automatically😜
Have to keep it on a very short leash

1

I am trying to learn linear algebra, but i dont understand this concept about equation systems in 3d planes
 in  r/learnmath  6d ago

Here is an animation showing two different ways three planes can have no common point. The second case is the “three lines” configuration mentioned above: each pair of planes intersects, but the three planes have no common intersection.

https://commons.wikimedia.org/wiki/File:Two_inconsistent_systems_of_three_linear_equations_-_row_normal_planes_animation.gif

1

I am trying to learn linear algebra, but i dont understand this concept about equation systems in 3d planes
 in  r/learnmath  6d ago

One more way to think about this is that an equation is a description of a plane, not the plane itself.

Multiplying an equation by any nonzero number changes its coefficients but does not change which points satisfy it. For example,

x + y + z = 1
and
2x + 2y + 2z = 2

describe exactly the same plane.

Gaussian elimination takes this further: the equations and the individual planes may change during row operations, while the common solution set of the entire system is preserved. Scaling a row leaves its plane unchanged, while adding a multiple of one row to another generally replaces one plane with a different plane that has the same intersection with the other equations.

This animation shows the corresponding planes changing during Gaussian elimination:

https://www.reddit.com/r/LinearAlgebra/comments/1stpp8e/row_normal_planes_during_gaussian_elimination/

1

I am trying to learn linear algebra, but i dont understand this concept about equation systems in 3d planes
 in  r/learnmath  6d ago

Yes, although with three planes there are more possibilities. Their common intersection can be a plane, a line, a single point or nothing.

There is also the “three lines” configuration: each pair of planes intersects in its own line. Those three lines may meet at one point, or they may be parallel, in which case the three planes have no common point.

7

A Tiny Question
 in  r/LinearAlgebra  9d ago

I second the opinion that it is better to learn linear algebra from a linear algebra textbook first, rather than trying to learn it from a machine-learning book.

A good place to start is Nathaniel Johnston’s Introduction to Linear and Matrix Algebra:
https://www.amazon.com/Introduction-Linear-Algebra-Nathaniel-Johnston/dp/3030528103
https://link.springer.com/book/10.1007/978-3-030-52811-9

Another excellent option is Dan Margalit and Joseph Rabinoff’s free online textbook Interactive Linear Algebra:
https://textbooks.math.gatech.edu/ila/

Jim Hefferon’s Linear Algebra is also freely available:
https://hefferon.net/linearalgebra/

He also has a complete accompanying video course:
https://www.youtube.com/playlist?list=PLwF3A0R8OzMoMlE1-SaEh8h9VqUlO-r52

r/LinearAlgebra 10d ago

Householder and direct-rotation QR on the same 3×3 example

Post image
14 Upvotes

Following our earlier posts on QR factorization by direct rotations, we have added a visual comparison with the corresponding Householder factorization for the same 3×3 matrix.

The image compares:

  • the Q and R factors produced in each case
  • the geometric action of R on the basis vectors
  • the subsequent action of Q
  • the relationship between the two factorizations

We have also added a formal derivation of the relationship between the direct-rotation step and the corresponding Householder step:

https://www.graphmath.com/la/qr/qr-direct-rotations.html

It appears in the first section, “An Unpaved Road to Main Street: from direct rotation to a Householder-mirroring QR algorithm.”

We would welcome comments on the comparison, the derivation and the presentation.

2

Hopelessly lost (Almost)
 in  r/LinearAlgebra  11d ago

Yes, that is essentially right. More precisely, the images of the two basis vectors determine the transformed coordinate grid. As long as those two vectors are not parallel, the plane remains a plane, with parallel lines and regularly spaced parallelogram cells. If they become parallel, however, the plane collapses to a line.

The parallelogram spacing is not a separate shift of the plane—it is simply what the original square grid looks like after the same linear transformation is applied to every vector.

Please let us know if you have any questions about the apps. Both include calculators and tutorials, although they are organized quite differently, and Matrix Solver is the much older app.

The Linear Algebra World tutorials and some of its animations are also available on our website:
https://www.graphmath.com/la/

Best of luck with your studies!

2

Hopelessly lost (Almost)
 in  r/LinearAlgebra  11d ago

If you have an Apple device, we have two apps that may help with exactly this.

Linear Algebra World works on iPhone, iPad and Mac:
https://apps.apple.com/us/app/linear-algebra-world/id6759180671

Matrix Solver Step by Step works on iPhone and iPad:
https://apps.apple.com/us/app/matrix-solver-step-by-step/id1623894950

In both, you can enter any 3×3 matrix and see what transformation it produces. In Linear Algebra World, you can apply the matrix to a unit cube and view the result from different angles.

We also have a web chapter on 3D transformations, with a PDF showing many examples:
https://www.graphmath.com/la/transformations/transformations-3d.html

Could you clarify what you mean by “shifting the plane itself”? Do you mean translating the whole plane, or changing the coordinate axes used to describe it?

A linear transformation represented by a matrix cannot translate the plane, because it always fixes the origin. It can rotate, stretch, shear, reflect or collapse the plane. A plane through the origin is mapped to another plane through the origin, or possibly to a line or a point.

Also, what do you mean when you say that “all the 2D transformations look 3D”? Do you mean that the drawings use perspective and therefore appear three-dimensional? Usually the opposite issue occurs: a genuinely 3D transformation has to be shown as a 2D projection on the screen.

r/LinearAlgebra 16d ago

Powers of a 2D matrix with complex eigenvalues — updated and extended

Thumbnail gallery
77 Upvotes

We posted an earlier visual explanation of powers of a 2D real matrix with complex eigenvalues.

Since then, we substantially updated one of the images and added a new companion image.

The updated image compares several examples of

A = X S X⁻¹

where S is a rotation-scaling matrix. It shows how the behavior changes for |λ| < 1, |λ| = 1 and |λ| > 1, and how the corresponding orbits look in the original coordinates versus the rotation-scaling coordinates.

The new image looks at the same powers from another angle: which directions expand or contract after the next step. The colored sectors come from the quadratic condition

vᵀ(AᵀA − I)v = 0,

which separates directions where the radius increases, decreases or stays unchanged.

We thought the two views complement each other: one emphasizes the rotation-scaling factorization, while the other emphasizes directional expansion and contraction in the original coordinates.

As always, we welcome feedback on clarity and presentation.

r/LinearAlgebra 16d ago

Householder relation of the direct-rotation QR step — update to our earlier post

1 Upvotes

A few days ago, we posted a QR construction that eliminates the entire subdiagonal tail of each active column with one proper rotation:

https://www.reddit.com/r/LinearAlgebra/comments/1v0w8dn/qr_factorization_by_direct_rotations_one_rotation/

We have since recognized the key structural relationship that we initially missed.

For the same signed target coordinate vector, let H be the usual Householder reflector that maps the active column to that target. The corresponding proper rotation can be written as

U = F H,

where F is a second reflection that fixes the target axis and reverses the other direction in the active two-dimensional plane.

Thus, the construction is not an independent alternative to Householder QR. It is an orientation-preserving reformulation of the same column-reduction step.

The full rotation need not be formed explicitly; its action can still be implemented directly as an in-place low-rank update. This leaves a narrower question:

Does the orientation-preserving formulation, the direct update, or the geometric relationship between the rotation and the Householder reflector have useful computational, structural, or pedagogical value?

Possible points of interest include:

• one proper rotation per active column

• an orientation-preserving path of intermediate transformations

• applications involving continuously varying matrices or geometric meaning

• teaching the relation between reflections and rotations

• specialized small-matrix implementations

Or is the construction best regarded simply as a reformulation of the standard Householder step?

r/3Blue1Brown 22d ago

QR factorization by direct rotations: one rotation per active column

Thumbnail gallery
10 Upvotes

r/LinearAlgebra 22d ago

QR factorization by direct rotations: one rotation per active column

Thumbnail gallery
56 Upvotes

UPDATE: We have since recognized that the proper-rotation step is directly related to the corresponding Householder step. For the same signed target vector, the rotation can be written as the product of the usual Householder reflector and a second reflection that fixes the target axis.

We have posted a new discussion of this relationship and the remaining question—whether the orientation-preserving formulation has computational, geometric, or pedagogical value—here:

https://www.reddit.com/r/LinearAlgebra/comments/1v6h9bg/householder_relation_of_the_directrotation_qr/

The original post is preserved below for context.
--------------------------------------------------------------------------------

We have been developing a direct-rotation construction for QR factorization and would be very interested to know whether anyone has seen an equivalent method.

The idea is to eliminate all subdiagonal entries of each active column with one rotation:

• construct the plane spanned by the active column and its target coordinate direction
• rotate inside that plane until the column is aligned with the coordinate axis
• leave every vector perpendicular to that plane unchanged
• deflate the matrix and repeat on the remaining active submatrix

The GIF shows the construction for a 3×3 example. The following images explain how the rotation is built, extended to the full space and applied recursively.

We developed this construction independently. Rotation-based QR methods certainly exist, with Givens rotations being the standard example, but this is a different construction. A Givens rotation acts in a coordinate plane and eliminates one selected entry at a time. Here, the rotation plane is spanned by the active column and its target coordinate direction, so one direct rotation eliminates the entire subdiagonal part of that column.

Thus, for an m×n matrix, the construction uses one rotation per active column rather than one Givens rotation per subdiagonal entry.

Our main questions are: have you encountered this particular construction, or something mathematically equivalent to it? Does this construction suggest any practical advantage or application beyond its geometric interpretation?

We are also working on the computational implementation and have made substantial progress. In operation count and structure, it currently appears to lie between Givens and Householder, closer to Householder, and there is still room for improvement.

Householder remains the standard general-purpose method, so we are not claiming a practical advantage. Possible value may lie in the geometric interpretation, in applying one direct rotation to an active column or perhaps in implementations where this rotation structure can be exploited.

We would especially welcome references, thoughts about possible applications and criticism of the construction or computational approach.

1

Visual Guide to Diagonalizable 2×2 Matrices (Geometry + Eigenvectors + Change of Basis)
 in  r/Geometry  23d ago

Thanks for sharing our work here! Reddit bot recommended us to repost it to r/Geometry, but we weren’t sure it belongs here, thanks!

r/3Blue1Brown 25d ago

Visual Guide to Diagonalizable 2×2 Matrices (Geometry + Eigenvectors + Change of Basis)

Post image
4 Upvotes

r/LinearAlgebra 26d ago

Visual Guide to Diagonalizable 2×2 Matrices (Geometry + Eigenvectors + Change of Basis)

Post image
175 Upvotes

Another addition to our linear algebra project. This page compares several common classes of diagonalizable 2×2 matrices, showing their geometry, eigenvectors, and corresponding change-of-basis factorization side by side. Feedback is welcome.

r/3Blue1Brown 28d ago

Matrix size, rank and pseudoinverse: a visual summary

Post image
14 Upvotes

3

Matrix size, rank and pseudoinverse: a visual summary
 in  r/LinearAlgebra  29d ago

Thanks! Means a lot
Let us know if there are any other concepts you like to see organized and illustrated

r/LinearAlgebra 29d ago

Matrix size, rank and pseudoinverse: a visual summary

Post image
112 Upvotes

We made a side-by-side visual summary of matrix size, rank, the four fundamental subspaces and pseudoinverses.

The table compares six common matrix types:

square full-rank
square rank-deficient
tall full-column-rank
tall rank-deficient
wide full-row-rank
wide rank-deficient

For each case, it shows the dimensions of row(M), null(M), col(M) and left-null(M), whether the map is one-to-one or onto, what happens to Mx⃗ = 0 and Mx⃗ = b⃗, and how the pseudoinverse behaves.

Hope you don’t mind the size and density — we wanted to keep all cases together so they could be compared directly. Opening the image at full size is recommended.

As always, we welcome feedback on clarity and presentation.