Linear Algebramath

The mathematics of vectors and matrices — vector spaces, dot products, norms, and linear transformations.

Embeddings live in vector spaces; similarity, projection, and dimensionality reduction are all linear algebra. It is the floor beneath most of SKC's semantic machinery.

Where it appears

Descend

Prerequisites

  • —

Dependencies

  • —

Foundations

  • —

Historical evolution

Foundational since the 19th century; the engine of every modern embedding model.

Implementation details

Cosine similarity = (a.b)/(|a||b|); random-projection dimensionality reduction uses Uniform(-1,1) scaled by 2/sqrt(d).

Sources

View in graph →