Foundations

Dotaiz · Topics

Learn linear algebra for machine learning

Linear algebra studies vectors, matrices, and transformations. Embeddings, attention, and neural network layers are those operations applied to data.

For learners who want the geometry behind machine learning, with a visual series and a textbook chapter.

Start here

Watch the vectors lesson, then pause and compute one dot product by hand before you continue the series.

Recommended resources

Start here · Beginner

Essence of linear algebra

The visual series for vectors, span, and matrix multiplication.

www.3blue1brown.com
Lesson · Beginner

Vectors

The first episode. Finish this before treating an embedding as a list of unexplained numbers.

www.3blue1brown.com
Practice · Beginner

Khan Academy linear algebra

Exercises for the operations the videos make intuitive.

www.khanacademy.org
Reference · Intermediate

Deep Learning Book: Linear Algebra

The chapter written for machine learning, once the pictures are familiar.

www.deeplearningbook.org

Related topics

Learn PyTorch · Understand transformer models

Search this topic live