← all pillarsPillar · session 7 · in progress

Transformer & DL Foundations

Attention/MHA, RoPE, RMSNorm, activations, tokenization, sampling, and scaling laws — from first principles.

Shipping in session 7

This pillar is on the build list. We're going depth-first — one fully-built pillar per session. Start with Building AI Agents.