#embeddings

2 articles about embeddings

llmSeptember 27, 2026

Episode 3: Embeddings — Absolute at the Start, Contextual at the End

Is an embedding the word on its own or the word in context? Both, at different moments. Plus the three engineering details around attention: multi-head, masking and position encoding.

llmSeptember 27, 2026

Episode 5: Embeddings and Vector Databases

From keywords to meaning: how embeddings and cosine similarity let you search by proximity, why you need a vector database, and how it all comes together as a RAG.