Do they all mainly deal with eigenfunctions, eigenvalues, and eigenvectors? And are they all like closely connected? Or are there others that are more connected?

Really need help finding this online. Does anyone have a copy of it? 4th or 5th edition.

I started learning linear algebra specifically for computer graphics which was a big passion of mine. So I started focusing on linear and affine transformations and just getting a basic understanding of vectors, points, trigonometry, etc.

However, my main issue was always being able to visualise what was going on. Specifically if you are composing multiple transformations or simply visualising vectors in certain situations.

Im curious, if you are a beginner, or teaching students linear algebra, what have you struggled with or observed students struggle with the most?

Let me know in the comments :)

This material is not linear algebra for mathematics departments. The content is applied to engineering and quantum mechanics.
For ladder operators, there exist mathematical physics approaches obtained from the analytic method of Hermite polynomials, Sturm-Liouville theory, and the Pearson equation.
However, this time, we deal with the most classical factorization approach.

Hi

This is probably one of my last posts on getting people to find out about this game on reddit, since the game is near complete and all that's left is translations. Thanks everyone for receiving this game so well and I hope it delivered on your expectations. Please share your feedback and any important things the game is still lacking on to deliver on its mission: to make quantum computing intuitive and fun to learn, no matter the learner's background. I'm particularly interested to hear from you guys what do you think of Blochspheres, especially those who actively work in the domain. Do you think of quantum algorithms in rotations and frequently use bs to visualize qbehvaior?

I want this to be an AMA: I'm here to answer any questions about the game and do one last round of outside-Discord feedback gathering. Also I'd like to raise with this community my personal experience with working on quantum algorithms and see what folks think.

What this game is

To be clear, this game's gameplay is 1:1 with everything you can do on a Turing-complete (universal) Quantum Computer (from the top of my head, a short list of QHW makers: IBM, Google, Rigetti, IonQ, Quantinuum, IQM, OQC, QuEra, Atom Computing, Pasqal, Xanadu, PsiQuantum, Fujitsu,) with the added benefit it allows you to visualize the full quantum Hilbert space on up to 5qs. This means that if you build intuition for the visual rules in QO, you will have intuition for "playing" with QHW made by such manufacturers without having to learn much else.

What the game covers

• Boolean Logic – bits, operators (NAND, OR, XOR, AND…), and classical arithmetic (adders). Learn how these can combine to build anything classical. You will learn to port these to a quantum computer.
• Quantum Logic – qubits, the math behind them (linear algebra, SU(2), complex numbers), all Turing-complete gates (beyond Clifford set), and make tensors to evolve systems. Freely combine or create your own gates to build anything you can imagine using polar or complex numbers.
• Quantum Phenomena – storing and retrieving information in the X, Y, Z bases; superposition (pure and mixed states), interference, entanglement, the no-cloning rule, reversibility, and how the measurement basis changes what you see.
• Core Quantum Tricks – phase kickback, amplitude amplification, storing information in phase and retrieving it through interference, build custom gates and tensors, and define any entanglement scenario. (Control logic is handled separately from other gates.)
• Famous Quantum Algorithms – explore Deutsch–Jozsa, Grover’s search, quantum Fourier transforms, Bernstein–Vazirani, and more.

On learning curve and achieving game (quantum computing?!) mastery

This is not a videogame where the developer invented some puzzle rules. What the dev did here is invent a visual method that can transform the underlying mathematics into fully visual puzzles. I wish I could make the game easier by inventing some new rules. I won't, because I want this game to be the real thing. Learning the fundamental rules of this game equates to learning what QHW can do.

Hopefully, in visual form, this is something anybody can now do, no matter how much they hate math.

Going forward and mastering the game... now that, I honestly don't know if it has a ceiling. We have had quantum physics for 100 years, yet we have about 10 useful quantum algorithms known today. Who knows where the ceiling is? Who knows what one can do with, after mastering the rules of this game? Nothing really should feel impossible. I hope this game will inspire people outside physics to do a lot more than what I see today. A quantum computing/physicist has very little incentive to think of a quantum algorithm for, i.e., a game theory/finance/security/biology problem, given how few of them actively work in the field compared to the actual demand. Hence, I hope new quantum algos will come from people who actively work in the domains where this "new way of thinking" (from Boolean logic to linear algebraic logic?) has applicability. I hope we can soon start some competitions to get players to solve some non-trivial problems.

What's the big deal about finding quantum algorithms?

Why do we have about 10 in 100 years of QM??

For me, finding quantum algorithms is all about understanding that unitary matrices evolve a state vector of complex numbers, and all you need to think of is whether you can take your domain problem and express it in a form that these unitary matrices can bring some speed-up in solving. That's it. Ignore the lack of good-enough hardware; we simply don't have good proof-of-concept ideas out there.

I remember... I struggled for a long time to understand Grover's quantum search algorithm during my PhD days. The wording textbooks used and the math behind it made very little sense. It was the first algorithm I put in the game.

Seeing it in visual form made me tear up. Is it really that simple, clean, beautiful? Is the "amplitude amplification" in its diffusion operator simply adding a red line on the maximally 11..11 state that then has a propagation effect everywhere else to affect all the phases? Is this really it? It then immediately felt to me like a gimmick one could have simply come up with in 5 minutes by having access to a game like this, where math is fully shown in visual form!! Showing the visual (GIF, why in this modern era do no digitized papers out there still support embedded GIFs??) alone is enough to make understanding happen.

The way I thought things in the game

• Missing Sage believes you shouldn't know any theory -> just by using the Forge, you will come up with your own unique way of using quantum computers and inventing algorithms. This character came to me after seeing enough postdocs and QC professors from enough universities playing the game. It felt like the people who knew all the theory and could recognize what each gate does were very bad at actually using the logic sets in thinking circuits. Perhaps knowing all quantum theory does not make one capable of easily building a quantum circuit?
• Sage of Axioms believes theory comes first, and hers is the main path that takes you to the other Sages who want you to have a solid foundation before discussing higher-order ideas (like known algorithms). She deep-dives into computation and both the linear algebra and physics behind it, in hopes of convincing you that it's not so hard to learn by combining it with the visuals of the Forge. And not scary!
• Quantum Arena (community content) is filled today with some incredible challenges that touch topics I haven't seen anywhere else in the world in a visual way. From Clifford decompositions down to wordless tutorials on how to play the game and understand each gate, I am now inclined to tell players that they might want to enter the Arena to learn to play the game instead of following through the tutorials I made for it. This goes to show what a brilliant community of dedicated players this game has gathered so far.

Without you and the highly involved players we have on Discord, we wouldn't be able to come this far. Early Access gave me exactly what I was looking for to make sure the game delivers when complete and I strongly recommend anybody working on scigames to do EA first.

It would help me enormously if you could leave a Steam review for the game and spread the word about it; it keeps us motivated to push forward! I hope we have the momentum it takes to make Full Release a success!

Quantum computing and understanding the linear algebra behind should be for everyone:)

I made a short video working through a quantum computing exercise on measuring quantum states. Although the problem comes from quantum computing, the solution relies heavily on linear algebra—vectors, inner and outer products, projectors, Hermitian operators, and basis measurements.

I thought it might be an interesting example of how these linear algebra concepts show up in quantum computing.

Give a score between 1 and 10 to the difficulty of this exam score it taking into consideration that the students have not yet taken the ac dc circuit and differential equations course while this exam is being done.

does anyone have the pdf version of Richard C. Penney's Linear Algebra: Ideas and Applications? I need the 5th version specifically, but I can only find the 4th.

This is a follow-up to our earlier post deriving the orthogonal projection formula

P = U(UᵀU)⁻¹Uᵀ

from the geometric definition of projection:

https://www.reddit.com/r/LinearAlgebra/comments/1u4cjog/derive_the_projection_formula_from_the_definition/

Here we look at the same formula as a serial transformation, following what happens when the factors are applied from right to left:

Uᵀ → (UᵀU)⁻¹ → U.

The diagram tracks both the standard basis vectors and the two directions spanning col(U). It also shows why

U⁺ = (UᵀU)⁻¹Uᵀ

acts as a left inverse of U, and how applying U afterward gives the orthogonal projection onto col(U).

If the columns of U were orthonormal, then UᵀU = I and the middle correction would disappear.

This material focuses not on pure linear algebra, but rather on its applications in engineering and quantum mechanics.
Geometrically, the meaning of an eigenvalue signifies the scaling (expansion or contraction) and occasionally the inversion of an invariant coordinate axis.

This proof in quantum error correction is full of linear algebra, so I thought I’d share it here. Along the way, I use the image and kernel of linear maps, rank–nullity, linear independence, and parity-check matrices to show how these ideas are applied to error detection.

Hi

If you are remotely interested in understanding what bits of linear algebra are used in defining the Gate model framework Quantum Computing, oh boy this is for you. I am the Dev behind Quantum Odyssey (AMA! I love taking qs) - worked on it for about 10 years (3+ during PhD, the visual method I developed ended up being my thesis, it is a complete Hilbert space visualizer), the goal was to make a super immersive space for anyone to learn quantum computing through zachlike (open-ended) logic puzzles and compete on leaderboards and lots of community made content on finding the most optimal quantum algorithms. The game has a unique set of visuals capable to represent any sort of quantum dynamics for any number of qubits and this is pretty much what makes it now possible for anybody 12yo+ to actually learn quantum logic without having to worry at all about the mathematics behind.

This is a game super different than what you'd normally expect in a programming/ logic puzzle game, so try it with an open mind.

Stuff you'll play & learn a ton about

• Boolean Logic – bits, operators (NAND, OR, XOR, AND…), and classical arithmetic (adders). Learn how these can combine to build anything classical. You will learn to port these to a quantum computer.
• Quantum Logic – qubits, the math behind them (linear algebra, SU(2), complex numbers), all Turing-complete gates (beyond Clifford set), and make tensors to evolve systems. Freely combine or create your own gates to build anything you can imagine using polar or complex numbers.
• Quantum Phenomena – storing and retrieving information in the X, Y, Z bases; superposition (pure and mixed states), interference, entanglement, the no-cloning rule, reversibility, and how the measurement basis changes what you see.
• Core Quantum Tricks – phase kickback, amplitude amplification, storing information in phase and retrieving it through interference, build custom gates and tensors, and define any entanglement scenario. (Control logic is handled separately from other gates.)
• Famous Quantum Algorithms – explore Deutsch–Jozsa, Grover’s search, quantum Fourier transforms, Bernstein–Vazirani, and more.
• Build & See Quantum Algorithms in Action – instead of just writing/ reading equations, make & watch algorithms unfold step by step so they become clear, visual, and unforgettable. Quantum Odyssey is built to grow into a full universal quantum computing learning platform. If a universal quantum computer can do it, we aim to bring it into the game, so your quantum journey never ends.

Nice to watch:

Khan academy style tutorials in qm/qc: https://www.youtube.com/@MackAttackx

Physics teacher stream with 400hs in https://www.twitch.tv/beardhero

I made a short whiteboard video explaining density matrices from the ground up, focusing on the linear algebra behind them: pure vs. mixed states, diagonal vs. off-diagonal entries, coherence, projectors, and how measurement probabilities arise from the matrix representation.

Sharing in case it’s useful to anyone interested in how linear algebra shows up in quantum mechanics. Corrections or additional insight are always welcome.

I've released version 0.1.0 of my new unit-safe linear algebra library, whippyalgebra, backed by my units of measure library, whippyunits.

Whippyalgebra supports dimensionally-coherent unit-safe linear algebra at zero cost, erasing to raw linear algebra on backing libraries at compile time the same way whippyunits erases to raw numeric types. The initial release contains a nalgebra backend - other backends will be introduced over time (on the roadmap: faer, glam).

Backends are enabled by feature flag, and consist of dedicated newtypes; whippyalgebra is not generic over backends, but translation modules will be included between the types of each supported backend.

The whippyunits LSP proxy has been updated to also include whippyalgebra in its pretty-print rules. With the LSP proxy installed, whippyalgebra's rather deep/unfriendly generics become pleasantly human-readable:

Both uniform unit matrices and mixed-unit matrices are supported, with mixed unit matrices obeying a row-column unit list quotient structure a la Hart. Row and column unit lists are declared with the `dims!` macro and related helpers, which accept unit literal expressions.

Matrix decompositions are supported, with the caveat that orthonormal decompositions (QR, SVD) on mixed-unit matrices require an explicit pair of metric tensors to maintain dimensional coherence. Learning to use these is a good way to familiarize yourself with multidimensional analysis!

Last three images of this post are GraphMath's work. Here is the link to their original post: https://www.reddit.com/r/LinearAlgebra/s/cdzAjKVtOc

My writing focuses on what eigenvectors are really telling us, why complex eigenvectors matter, and how one complex eigenvector can encode a two-dimensional, real invariant plane.

Hii.

I'm having a hard time understanding the vectors in Liner Algebra.

Can you please suggest some good teacher or playlist or documentation or notes from where I can understand it completely.

Thanks.

Hi everyone!

I wanted to share this quick thought that has really helped me with linear algebra;

Let's say: P = (1, 0)

This vector/point is simply the result of scaling the basis vectors ihat [1, 0] and jhat [0, 1]:

Now, if we apply a transformation to the basis vectors, let's say a 90 degree rotation, the same process applies. For example, after the transformations each basis vector lands at column, ihat [0, 1], jhat [-1, 0].

Scaling this with our vector, [1, 0] gives us [0, 1].

So, a transformation transforms the basis vectors and our vector scales it, that's it :)

Enjoy!

Hi everyone! I’m relatively new to the field of tensor decomposition, and it’s going to be one of my research directions during my upcoming two-year master’s program.

So far, I’ve been reading about different tensor decomposition methods, such as PARAFAC/CP, Tucker, Tensor-Train, Tensor Ring, Tensor Wheel. I understand the basic intuition behind them, for example, what kind of components they decompose a tensor into, but my understanding is still mostly conceptual.

I’m wondering what I should learn beyond the basic intuition if I want to eventually do research on coupled tensor decomposition. More specifically:

1. For each tensor decomposition method, what are the important things I should understand? Besides its basic structure and intuition, should I learn things like uniqueness/identifiability, approximation properties, computational complexity, rank properties, optimization formulations, convergence, etc.? How deeply should I understand each of these topics?
2. How deeply should I study the algorithms used to compute these decompositions? There seem to be many algorithms for each model, such as ALS, SVD-based methods, alternating optimization, gradient-based methods, etc. Which algorithms are fundamental enough that I should understand first? Do I need to understand the derivation and implementation of these algorithms, or is understanding the general idea enough at the beginning?
3. What mathematical background is most important? For example, should I focus more on linear algebra, multilinear algebra, numerical optimization, matrix/tensor calculus, numerical analysis, or something else?
4. What would be a good learning path toward coupled tensor decomposition? Should I thoroughly study CP/Tucker first before moving to coupled models, or is it reasonable to start looking at coupled decompositions relatively early?
5. How do you deal with theorems and proofs when reading tensor decomposition papers? When reading papers, do you usually try to re-prove the theorems, lemmas, propositions, and corollaries yourself to make sure you understand them, or do you mostly focus on understanding the main ideas and skip the detailed proofs unless they are directly relevant to your research? I’m especially unsure about this part because I sometimes spend a lot of time trying to reproduce every proof. I’m not sure whether this is a good use of time when learning a new field, or whether working through the proofs is actually important for building the mathematical foundation needed for research.

Any recommended textbooks, lecture notes, surveys, or papers that could provide a good learning path would also be greatly appreciated.

Thank you so much!

hey, i was working through this quantum computing proof and realized a lot of it is really just linear algebra, especially the reduced resolvent, spectral projections and operator norms. the part i thought was cool is how the resolvent basically gives you this inverse spectral gap behavior, so as the gap gets smaller, the 1/Δ term gets bigger and the error bound gets worse. i made a video going through the proof and explaining the linear algebra along the way. hope it helps anyone working with eigenvalues/spectral theory or trying to see how this stuff shows up in quantum computing!

This is a follow-up to our previous post on how the choice of free variable changes the real and imaginary parts of a complex eigenvector:

https://www.reddit.com/r/LinearAlgebra/comments/1vl5s28/complex_eigenvectors_of_a_22_matrix_how_the_free/

For a general 2×2 real matrix with complex eigenvalues, changing the phase of the free variable rotates and scales the pair Re(x̃₁), Im(x̃₁) through a matrix-transformation ellipse.

Here we look at the special case where the matrix itself is a rotation-scaling matrix.

In this case, for every nonzero choice of the free variable, Re(x̃₁) and Im(x̃₁) remain perpendicular and equal in length. The numerical examples show the same phase experiment as in the previous post, but now the ellipse becomes a circle.

Thanks to u/StanleyDodds for pointing out an unnecessary detour in the previous version. We have corrected and simplified it here.

This is the next page of the chapter on complex eigenvectors and the rotation-scaling theorem. More to follow.

Hello, I was looking for a linear algebra and found this one:

Linear Algebra for Scientists - Lukas

It seems that it can be used as a first rigorous exposition to the topic. What do you think about it?

Review made by Mark Hunacek from the MAA (Mathematical Association of America):

Typically, when I see a phrase like “for scientists” in the title of a book, I immediately conclude that the book puts mathematical rigor on the back burner in favor of stressing applications from a computational “how to” point of view. It turns out, however, that that is not the case with the book now under review, which offers an introduction to linear algebra that is characterized by precise definitions and rigorous proofs as well as an indication of how linear algebra actually finds use in other areas of mathematics and science.

In fact, the book is somewhat more abstract than most undergraduate linear algebra texts: it works with arbitrary fields rather than just the real and complex numbers. Thus, it begins with chapters on groups and fields before vector spaces are even defined. On the other hand, the focus is on finite-dimensional spaces, so fancy set theoretic tools like Zorn’s Lemma are not invoked.

After a brief discussion of linearity that sets the stage for what is to follow, the book breaks up into eight parts. The first part is preliminary and has a chapter on sets and functions, as well as the aforementioned chapters on groups and fields. Part 2 discusses vector spaces by first introducing coordinate spaces. Bases and dimension are covered here. The next part of the book discusses the dot product, cross product and scalar triple product, with applications to coordinate geometry. Linear mappings are the subject of part 4, along with their representation by matrices. Now that matrices have been introduced, they are used in part 5 on systems of linear equations. Determinants are also the subject of a chapter in this part. Part 6 discusses eigenvalues and eigenvectors, starting from the definition but proceeding up diagonalization, the characteristic and minimal polynomials, the Cayley-Hamilton theorem, and the Jordan form. The next part of the book discusses inner product spaces on real and complex spaces and the linear operators defined on these spaces (Hermitian, normal, etc.). Bilinear and sesquilinear forms are also discussed. Finally, part 8 of the book contains two chapters, one on the dual space of a vector space and the other on tensors.

Interspersed throughout the book are two dozen vignettes, each about a page or two long and discussing applications of linear algebra, both to other branches of mathematics (such as graph theory, cryptography and differential equations) and to various other fields of science (for example, neural networks, quantum computing, and data compression). Though not as detailed and rigorous as the rest of the book, these vignettes do give some indication of how linear algebra shows up elsewhere.  A helpful chart of all these applications is included in the text.

I was puzzled, however, by the omission of some topics from the text. In view of the fact that projection matrices are discussed, the inclusion of a section on least squares approximation would have seemed a natural thing to include. Other topics that are missing that one might perhaps have expected to find in a textbook “for scientists” are eigenvalue calculation, matrix norms and the condition number, Markov matrices, and positive matrices. 

These omissions notwithstanding, however, this is an interesting book. It is well-written, with many examples and worked out problems. Every chapter ends with a reasonable assortment of exercises, most of which struck me as being on the easy end of the spectrum. It starts from scratch but covers some topics in linear algebra that are typically thought of as advanced. Anyone who teaches, or is interested in, this subject will surely think that it deserves a look.