🎓 Matrix Learning Lab

Interactive visualizations and explorations for linear algebra — from first principles to matrix decompositions

🎯 What Are Matrices?

Welcome to your interactive journey into linear algebra! Let's start with the absolute basics and build up from there.

Part 1: A Matrix is Just a Grid of Numbers

Think of it like a table or spreadsheet:

│  1   2  │
│  3   4  │

This is a 2×2 matrix (2 rows, 2 columns).
We read it as "2 by 2".

Part 2: Larger Matrices and Real Data

Matrices can be any size! Here's a 3×3 matrix:

│  5   8   3  │
│  2   9   7  │
│  6   1   4  │

This is a 3×3 matrix (3 rows, 3 columns).

In the real world, matrices store actual data. Each row might represent a person, and each column a different feature:

📊 Real-Life Data Matrix Example:

Person	Age	Income ($)	Health Score	Zipcode	Population Density
Person 1	25	45,000	85	10001	12,500
Person 2	42	78,000	92	90210	8,200
Person 3	67	95,000	78	60601	15,800
Person 4	31	62,000	88	77001	9,100

As a matrix: 4 people × 5 features = 4×5 matrix

│ 25   45000   85   10001   12500 │
│ 42   78000   92    90210    8200 │
│ 67   95000   78    60601   15800 │
│ 31   62000   88    77001    9100 │

Real-World Applications

🎮 Computer Graphics

Rotate, scale, and move 3D game objects. Every rotation in a video game uses matrices!

📱 Image Filters

Instagram filters? Matrices! They transform pixel colors to create effects like blur, sharpen, and edge detection.

🤖 Machine Learning

Neural networks are built from matrices. Every AI model you use (ChatGPT, image recognition) runs on matrix math!

📊 Data Analysis

Organize and analyze large datasets. Matrices help find patterns in millions of data points (like Netflix recommendations).

⚡ Engineering

Model electrical circuits, structural forces, and quantum mechanics. Engineers use matrices to predict how systems behave.

🔐 Cryptography

Encrypt secret messages! Some encryption methods multiply your message by a secret matrix to scramble it.

🎯 Lesson 2: Matrix Arithmetic

Learning Objectives:
✓ Master matrix addition and subtraction
✓ Understand matrix multiplication (it's different!)
✓ Learn transpose, determinant, and inverse operations

Part 1: Addition & Subtraction (The Easy Ones!)

Good news: Adding matrices is like adding regular numbers — just do it element-by-element!

Example: Add these 2×2 matrices

│ 1  2 │
│ 3  4 │Matrix A
+
│ 5  6 │
│ 7  8 │Matrix B
=
│  6   8 │
│ 10  12 │Result

Each element adds: (1+5=6, 2+6=8, 3+7=10, 4+8=12)

⚠️ Important Rule:
You can only add/subtract matrices with the SAME dimensions!
Valid: A 2×3 matrix + 2×3 matrix.
Invalid: A 2×2 matrix + 3×3 matrix.

Not Possible: Adding different-sized matrices

│ 1  2 │
│ 3  4 │Matrix A
+
│ 5  6  7 │
│ 8  9 10 │
│11 12 13 │Matrix B
×
Cannot add
Different dimensions

Part 2: Matrix Multiplication (The Tricky One!)

Warning: Matrix multiplication is NOT element-by-element! It's more like "mix and combine".

The Rule: To multiply matrices A × B:

Take a row from A (shown above: Row 1 of A = [1, 2])
Take a column from B (shown above: Column 1 of B = [5, 7])
Multiply corresponding elements and add them up: (1×5) + (2×7) = 5 + 14 = 19
That's one entry in the result!

💡 Dimension Rule:
You can only multiply A × B if columns_of_A = rows_of_B.
Valid: A (2×3) × B (3×4) = ✓ Valid (result is 2×4).
Invalid: A (2×3) × B (4×2) = ✗ Invalid!

Worked Example: A valid matrix multiplication

│ 1  2  3 │
│ 4  5  6 │Matrix A (2×3)
×
│ 7   8 │
│ 9  10 │
│11  12 │Matrix B (3×2)
=
│  58   64 │
│ 139  154 │Result (2×2)

Part 3: Transpose (The Flipper!)

The transpose of a matrix flips rows into columns (and columns into rows). In real life, you might need to transpose data when your features are stored as rows but your algorithm expects them as columns (or vice versa).

│ 1  2  3 │
│ 4  5  6 │

Original (2×3)

→ Aᵀ →

│ 1  4 │
│ 2  5 │
│ 3  6 │

Transposed (3×2)

Notice: Rows became columns! The first row [1,2,3] became the first column.

Part 4: Determinant (The "Size" of a Matrix)

The determinant tells you whether a matrix is invertible, meaning the transformation preserves information so the original input can be uniquely recovered, and it also measures how the transformation scales area. For 2×2 matrices

│  a   b  │
│  c   d  │

det(A) = ad - bc

Example:

Matrix: │  2   3  │
        │  1   4  │

det = (2×4) - (3×1) = 8 - 3 = 5

This means the area or volume would scale by 5.

🔍 What does determinant mean?
• det = 0 → Matrix is "singular" (not invertible, collapses space)
• det > 0 → Matrix preserves orientation
• det < 0 → Matrix flips orientation (mirrors)
• |det| = scaling factor (how much the matrix stretches area/volume)

📐 Determinant Examples

Case 1: det > 0 — Preserves Orientation

│ 2  0 │
│ 0  3 │

Scaling

│ 1 │
│ 1 │

Vector

│ 2 │
│ 3 │

Stretched

det = (2×3) − (0×0) = 6 — stretches but keeps orientation

Case 2: det < 0 — Flips Orientation

│ 1  0 │
│ 0 -1 │

Reflection

│ 1 │
│ 1 │

Vector

│  1 │
│ -1 │

Flipped

det = (1×−1) − (0×0) = −1 — inverts orientation (mirror)

Case 3: det = 0 — Singular (Collapses Space)

│ 1  2 │
│ 2  4 │

Dep. rows

│ 1 │
│ 1 │

Any vector

│ 3 │
│ 6 │

Same dir.

det = (1×4) − (2×2) = 0 — not invertible, collapses to a line

Exercise 3: Determinant

Find det(A) for:

          A =       
              │ 3  -2│
              │ 1   4│

Show Solution

det(A) = (3×4) - (-2×1) = 12 - (-2) = 12 + 2 = 14

Exercise 4: Determinant & Area

Calculate det(B) and predict how it transforms the area of a 2×2 square:

          B =
              │ 0.5   0 │
              │ 0    0.5│

Show Solution

det(B) = (0.5×0.5) - (0×0) = 0.25

Area scales by factor of 0.25 (shrinks to 1/4 the original area)

💻 Interactive Matrix Calculator

1. Choose Operation:

2. Matrix Size:

Count:

3. Actions:

🎯 Lesson 3: Matrix Celebreties

Learning Objectives:
✓ Recognize identity, diagonal, rotation, and symmetric matrices
✓ Understand what makes each matrix type special
✓ Know when to use each type in practice

🔄 Rotation Matrix — The Spinner

What is it? Rotates vectors by angle θ without stretching.

                  
│ cos(θ)  -sin(θ) │
│ sin(θ)   cos(θ) │

Superpower: Pure rotation, preserves lengths!

Example: θ = 45° →
cos(45°) ≈ 0.707, sin(45°) ≈ 0.707

Why it matters: Computer graphics, robotics, animations, GPS systems

Angle θ 45°

R(θ) =

0.707 -0.707 0.707 0.707

Original vector: (3.00, 0.00)

Rotated vector: (2.12, 2.12)

Length preserved: 3.00

Blue shows the starting vector. Orange shows the rotated vector after applying the rotation matrix.

📏 Diagonal Matrix — The Scaler

What is it? Only diagonal entries are non-zero.

│ 2  0  0 │
│ 0  5  0 │
│ 0  0  3 │

Superpower: Scales each axis independently!
(x,y,z) → (2x, 5y, 3z)

Why it matters: Easy to compute powers (D² = just square each entry!), eigenvalue decompositions

Scale x 2.0

Scale y 1.4

D =

2.0 0 0 1.4

Original point: (1.50, 1.00)

Scaled point: (3.00, 1.40)

Axis scaling: x × 2.0, y × 1.4

The light square is the original shape. The green rectangle shows how a diagonal matrix stretches x and y independently.

🔁 Symmetric Matrix — The Mirror

What is it? Equals its own transpose: A = Aᵀ (mirror across diagonal).

         
│ 4  1  2│
│ 1  3  5│  ← Notice symmetry
│ 2  5  6│     across diagonal!

Superpower: Always has real eigenvalues!

Check: A₁₂ = A₂₁ = 1 ✓
A₁₃ = A₃₁ = 2 ✓
A₂₃ = A₃₂ = 5 ✓

Why it matters: Physics (stress tensors), optimization, covariance matrices in statistics

🪞 Orthogonal Matrix — The Preserver

What is it? Preserves lengths and angles. QᵀQ = I

               
│ 0.8  -0.6  0│
│ 0.6   0.8  0│
│ 0     0    1│

Superpower: Rotations + reflections, no distortion!

Distance between points = unchanged
Angles = unchanged
det(Q) = ±1

Why it matters: Computer vision, QR decomposition, numerical stability

Angle θ 37°

Q(θ) =

0.799 -0.602 0.602 0.799

‖e₁‖ = ‖Q·e₁‖: 1.00 = 1.00 ✓

‖e₂‖ = ‖Q·e₂‖: 1.00 = 1.00 ✓

Angle Q·e₁ ∠ Q·e₂: 90.0° ✓

Blue: basis vectors. Purple: after Q — same lengths, same 90° angle.

🎯 Lesson 4: Matrices in Motion

Learning Objectives:
✓ Visualize how matrices transform space
✓ Understand rotation, scaling, shearing, and reflection
✓ Connect determinant to geometric area changes

The Big Idea: Matrices Transform Space

A 2×2 matrix takes every point (x, y) in the plane and moves it to a new location. Think of it like molding clay!

How It Works:

Matrix        times vector      equals new vector         
       │ a b│              │ x │                  │ ax + by│
       │ c d│              │ y │                  │ cx + dy│

The matrix "mixes" x and y coordinates to create the new position!

Common Transformations

🔄 Rotation (by θ degrees)

                  
│ cos(θ)  -sin(θ) │
│ sin(θ)   cos(θ) │

What it does: Spins vectors around the origin
Determinant: Always 1 (no area change!)
Example: θ=90° → Rotate left 90 degrees

📏 Scaling (by factors sx, sy)

         
│ sx   0 │
│  0  sy │

What it does: Stretches/squashes along axes
Determinant: sx × sy (area multiplier)
Example: [2, 0; 0, 3] → doubles x, triples y

↔️ Shear (slant by k)

       
│ 1  k │  ← Horizontal shear
│ 0  1 │

What it does: "Slants" space (like pushing cards)
Determinant: Always 1 (area preserved!)
Example: k=1 → skews parallelogram

🪞 Reflection (over x-axis)

        
│  1   0│
│  0  -1│  ← Flip y-coordinate

What it does: Mirrors across an axis
Determinant: -1 (flips orientation!)
Note: Negative det = mirror/flip

🔍 Determinant Tells The Story:
• |det| = how much area gets scaled (2 = double area, 0.5 = half area)
• det > 0 = preserves orientation (no flip)
• det < 0 = flips orientation (mirror)
• det = 0 = collapses to a line (singular matrix!)

🔁 Invertibility Demo — Recover the Original Vector

What happens? Click generate to create an invertible 2×2 matrix, send a vector through it, then use the inverse to recover the original vector.

M =

1 0 0 1

M⁻¹ =

1.00 0.00 0.00 1.00

Original vector: (2.00, 1.00)

Transformed vector: (2.00, 1.00)

Recovered vector: (2.00, 1.00)

det(M): 1.00

Click generate to create an invertible matrix.

Blue shows the original vector v, orange shows y = Mv, and green shows the recovered vector M⁻¹y.

💻 Interactive Transformer

Try transforming the unit square! Enter matrix values or use presets.

Matrix

Vector

Transform Preset

det = 1.00 (neg = flip)

Click plot to set vector

● Original ● Transformed Click plot to move vector

🎯 Lesson 5: Solving Systems with Matrices

Learning Objectives:
✓ Convert equation systems to matrix form (Ax = b)
✓ Solve systems using matrix operations
✓ Understand when systems have unique, infinite, or no solutions

Why Matrices for Equations?

Remember solving systems by hand? Painful! Matrices make it systematic and scalable to 100s of variables.

Step 1: Convert to Matrix Form

System of Equations:

2x + 3y = 8
x - y = 1

→

Matrix Form (Ax = b):

                  
│ 2  3│ · │ x│ = │ 8│
│ 1 -1│   │ y│   │ 1│
                  
   A        x       b

A = coefficients, x = unknowns, b = right-hand sides

Step 2: Solve using Matrix Inverse

If A is invertible (det ≠ 0), the solution is: x = A⁻¹b

Example: Solve the system above

Step 1: Find det(A) = (2)(-1) - (3)(1) = -2 - 3 = -5 ✓ (non-zero!)

Step 2: Find A⁻¹ (use formula for 2×2):
A⁻¹ = (1/det) ×         =  (1/-5) ×         =           
                 │ d -b│              │-1 -3│     │ 0.2  0.6│
                 │-c  a│              │-1  2│     │ 0.2 -0.4│
                                                         

Step 3: Multiply x = A⁻¹b:
                                                
│ x│ = │ 0.2  0.6│ · │ 8│ = │ (0.2×8)+(0.6×1) │ = │2.2│
│ y│   │ 0.2 -0.4│   │ 1│   │ (0.2×8)+(-0.4×1)│   │1.2│
                                                

Answer: x = 2.2, y = 1.2

✓ Check: 2(2.2) + 3(1.2) = 4.4 + 3.6 = 8.0 ✓ | 2.2 - 1.2 = 1.0 ✓

The Three Cases: How Many Solutions?

✅ Case 1: Unique Solution (det ≠ 0)

When: Matrix A is invertible (full rank)
Means: Exactly ONE solution exists
Solve: x = A⁻¹b

Example:        det = 2  →  Unique solution!
         │ 2 3│
         │ 0 1│

⚠️ Case 2: Infinite Solutions (det = 0, consistent)

When: Equations are dependent (one is a multiple of another)
Means: Infinite solutions (a line/plane of solutions)
Example: 2x + 4y = 6 and x + 2y = 3 (same line!)

Matrix:        det = 0  →  Infinite solutions
        │ 2 4│
        │ 1 2│

❌ Case 3: No Solution (det = 0, inconsistent)

When: Equations are contradictory
Means: No solution exists (parallel lines never meet!)
Example: 2x + 4y = 6 and 2x + 4y = 10 (impossible!)

Same matrix but different b → No solution

🔍 Quick Check: Calculate det(A) first!
• det ≠ 0 → Unique solution guaranteed ✓
• det = 0 → Check if consistent (infinite) or inconsistent (no solution)

💻 Interactive System Solver

Solve your own linear systems! Enter the number of equations and let the matrix solver work its magic.

Number of equations:

🧪 Practice Problems

Exercise 1: Convert to Matrix Form

Write this system as Ax = b:

3x + 2y = 7
x - 4y = -5

Show Solution

A =           x =        b =     
    │ 3  2│        │ x│        │  7│
    │ 1 -4│        │ y│        │ -5│

Exercise 2: Solve by Hand

Solve using matrix inverse:

                 
│ 1 2│ · │ x│ = │ 5│
│ 3 4│   │ y│   │11│

Show Solution

det(A) = (1×4) - (2×3) = 4 - 6 = -2 ✓

A⁻¹ = (1/-2) ×         =         
               │  4 -2│     │ -2  1│
               │ -3  1│     │1.5 -0.5│
                                 

x = A⁻¹b =         ×     =                 =    
           │ -2  1│   │ 5│   │(-2×5)+(1×11)│   │ 1│
           │1.5 -0.5│   │11│   │(1.5×5)+(-0.5×11)│   │ 2│
                                                

Answer: x = 1, y = 2

Exercise 3: Determine Solution Type

How many solutions does each system have?

System A:              System B:      
          │ 2 6│                  │ 1 2│
          │ 1 3│                  │ 3 5│

Show Solution

System A: det = (2×3) - (6×1) = 6 - 6 = 0
→ Either infinite solutions or no solution (need to check consistency)

System B: det = (1×5) - (2×3) = 5 - 6 = -1 ≠ 0
→ Unique solution exists! ✓

� Lesson 6: Eigenvalues — The Magic Directions

Learning Objectives:
✓ Understand what eigenvalues and eigenvectors represent geometrically
✓ Learn how to find eigenvalues (det(A - λI) = 0)
✓ Recognize why eigenvalues matter in applications

The Mind-Blowing Idea

Most matrices rotate AND stretch vectors. But there are special directions where the matrix ONLY stretches!

The Eigenvalue Equation

Av = λv

A
The matrix

v
Eigenvector
(special direction)

λ
Eigenvalue
(stretch factor)

"Matrix A just scales vector v by λ — no rotation!"

Example: See It In Action

Matrix A =          Eigenvector v =        Eigenvalue λ = 4
           │ 3 1│                    │ 1│
           │ 0 4│                    │ 0│
                                       

Let's verify Av = λv:

Av =       ×     =         =    
     │ 3 1│   │ 1│   │ 3×1+1×0│   │ 3│
     │ 0 4│   │ 0│   │ 0×1+4×0│   │ 0│
                                   ← This should equal 4v

λv = 4 ×     =       ← They DON'T match! So v=[1,0] is NOT an eigenvector.
         │ 1│   │ 4│
         │ 0│   │ 0│
                  

Try v =    :
        │ 1│
        │ 1│
           

Av =       ×     =        and    4v =       ✓ Match! This IS an eigenvector!
     │ 3 1│   │ 1│   │ 4│                  │ 4│
     │ 0 4│   │ 1│   │ 4│                  │ 4│

How to Find Eigenvalues (The Algorithm)

Step 1: Set up the characteristic equation

det(A - λI) = 0

Why? We need Av = λv, which rearranges to (A - λI)v = 0.
This only has non-trivial solutions when det(A - λI) = 0.

Step 2: Calculate the determinant (gives a polynomial)

Example: A =      
             │ 4 2│
             │ 1 3│
                  

A - λI =          
         │ 4-λ   2│
         │  1  3-λ│
                  

det(A - λI) = (4-λ)(3-λ) - (2)(1)
            = 12 - 4λ - 3λ + λ² - 2
            = λ² - 7λ + 10

Step 3: Solve for λ (find roots)

λ² - 7λ + 10 = 0
(λ - 5)(λ - 2) = 0

Eigenvalues: λ₁ = 5, λ₂ = 2

Step 4: Find eigenvectors (plug λ back in)

For λ = 5:  (A - 5I)v = 0  →      v = 0  →  Eigenvector v₁ =    
                                   │-1  2│                       │ 2│
                                   │ 1 -2│                       │ 1│

Why Eigenvalues Matter

🎬 Google PageRank
The web is a giant matrix! Google finds the "importance" eigenvector of this matrix.

🔬 Physics & Engineering
Vibration modes, quantum mechanics, stability analysis — all use eigenvalues!

📊 Principal Component Analysis (PCA)
Data science's favorite tool! Uses eigenvectors to find important patterns in data.

🎮 Computer Graphics
Eigenvectors define "principal axes" for 3D object rotations.

🔍 Quick Facts:
• An n×n matrix has n eigenvalues (counting multiplicities)
• Symmetric matrices → always real eigenvalues
• Trace(A) = sum of eigenvalues
• det(A) = product of eigenvalues
• Eigenvalues of diagonal matrices = the diagonal entries!

💻 Compute & Visualize

Generate a random square matrix to explore its eigenvalues and eigenvectors.

Matrix Size (N×N):

📊 Visualization

💡 How to read this plot:
• Arrows (Real Eigenvalues): Show the eigenvectors ($v$) and how they get scaled ($\lambda v$).
• Points (Complex Eigenvalues): Show the eigenvalues on the complex plane (Rotation + Scaling).

🎯 Lesson 7: SVD & PCA — Data Science Superpowers

Learning Objectives:
✓ Understand Singular Value Decomposition (A = UΣVᵀ)
✓ Learn how SVD enables data compression
✓ Master Principal Component Analysis (PCA) for dimensionality reduction

SVD: The Ultimate Matrix Factorization

Every matrix can be broken down into three simple pieces!

A = U Σ Vᵀ

A
Original
Matrix

U
Rotate
(left)

Σ
Stretch
(diagonal)

Vᵀ
Rotate
(right)

Any transformation = Rotate → Stretch → Rotate!

The Three Pieces Explained

U (Left Singular Vectors)
• Orthogonal matrix (columns are perpendicular)
• Defines output space directions
• Size: m × m

Σ (Singular Values)
• Diagonal matrix with σ₁ ≥ σ₂ ≥ ... ≥ 0
• Shows "importance" of each direction
• Large σ = important, small σ = can be dropped!

Vᵀ (Right Singular Vectors)
• Orthogonal matrix (rows are perpendicular)
• Defines input space directions
• Size: n × n

🗜️ The Magic: Data Compression!

Keep only the TOP k singular values → throw away the rest → get close approximation with less data!

Example: Compress an Image

Original 1000×1000 image matrix = 1,000,000 numbers

After SVD: Keep top 50 singular values
→ Storage needed: 50 × (1000 + 1000 + 1) ≈ 100,000 numbers
→ Compression ratio: 10x smaller! Only 10% of original size

Result: Image looks almost identical but file is 90% smaller! 🎉

This is exactly what JPEG compression does! (with a twist using DCT, a cousin of SVD)

📊 PCA: Finding Patterns in Data

Principal Component Analysis uses SVD to find the "most important directions" in your data.

The PCA Recipe (4 Steps)

Center the data: Subtract mean from each feature
Compute covariance matrix: Shows how features vary together
Find eigenvalues & eigenvectors: Get principal components (eigenvectors of covariance matrix)
Project onto top components: Reduce from 100D → 2D!

Real Example: Netflix Recommendations
• You have 10,000 movies (10,000 dimensions!)
• PCA finds ~50 "hidden factors" (action, romance, comedy, etc.)
• Each user's taste = combination of these 50 factors
• 10,000D → 50D = 200x compression! 🚀

💡 Key Insight: Not all directions matter equally! SVD/PCA find the directions with the MOST variation. Drop the boring directions, keep the interesting ones.

💻 Interactive SVD Decomposition

Generate a random matrix or enter one to see its Singular Value Decomposition.

Rows:

Cols:

🎯 Interactive PCA Analysis

Generate a random dataset (rows=samples, cols=features) and find its principal components.

Samples (Rows):

Features (Cols):

🎓 Matrix Learning Lab

🎯 What Are Matrices?

Part 1: A Matrix is Just a Grid of Numbers

Part 2: Larger Matrices and Real Data

Real-World Applications

🎯 Lesson 2: Matrix Arithmetic

Part 1: Addition & Subtraction (The Easy Ones!)

Part 2: Matrix Multiplication (The Tricky One!)

Part 3: Transpose (The Flipper!)

Part 4: Determinant (The "Size" of a Matrix)

📐 Determinant Examples

💻 Interactive Matrix Calculator

Enter Matrix (semicolon-separated rows)

🎯 Lesson 3: Matrix Celebreties

🔄 Rotation Matrix — The Spinner

📏 Diagonal Matrix — The Scaler

🔁 Symmetric Matrix — The Mirror

🪞 Orthogonal Matrix — The Preserver

🎯 Lesson 4: Matrices in Motion

The Big Idea: Matrices Transform Space

Common Transformations

🔄 Rotation (by θ degrees)

📏 Scaling (by factors sx, sy)

↔️ Shear (slant by k)

🪞 Reflection (over x-axis)

🔁 Invertibility Demo — Recover the Original Vector

💻 Interactive Transformer

🎯 Lesson 5: Solving Systems with Matrices

Why Matrices for Equations?

Step 2: Solve using Matrix Inverse

The Three Cases: How Many Solutions?

✅ Case 1: Unique Solution (det ≠ 0)

⚠️ Case 2: Infinite Solutions (det = 0, consistent)

❌ Case 3: No Solution (det = 0, inconsistent)

💻 Interactive System Solver

🧪 Practice Problems

� Lesson 6: Eigenvalues — The Magic Directions

The Mind-Blowing Idea

Example: See It In Action

How to Find Eigenvalues (The Algorithm)

Why Eigenvalues Matter

💻 Compute & Visualize

📊 Visualization

🎯 Lesson 7: SVD & PCA — Data Science Superpowers

SVD: The Ultimate Matrix Factorization

The Three Pieces Explained

🗜️ The Magic: Data Compression!

📊 PCA: Finding Patterns in Data

💻 Interactive SVD Decomposition

🎯 Interactive PCA Analysis

Explained Variance (Scree Plot)

2D Projection (PC1 vs PC2)