Transformers from First Principles
Free lecture notes as a 148-page PDF: build a transformer one block at a time, from the next-word problem to designing your own model, with every matrix drawn and every number computed and checked.
Read article →Interactive diagrams and long-form studies on transformers, agentic systems, and AI engineering.
Free lecture notes as a 148-page PDF: build a transformer one block at a time, from the next-word problem to designing your own model, with every matrix drawn and every number computed and checked.
Read article →Follow a token through a 3D transformer. Inspect the matrices, attention, gradients and training batches in a small, working Qwen-style teaching model.
Open diagram →A ground-up technical study of Kirti's cost-sensitive CI-triage system: labels, trust gates, observers, evidence contracts, fusion, distillation, and human judgment around AI-assisted coding.
Read article →A first-principles architecture study of a production-grade AI pull-request review agent: specialist reasoners, grounded context, orchestration, memory, evaluation, observability, and human review.
Read article →Reliable AI agents need more than longer context windows. They need explicit state, graphs, task DAGs, validators, proof logs, and feedback loops around the model.
Read article →An AI coding plan is not a pile of prompts. It is a small machine that writes the to-do list, delegates work, checks results, and records what got done.
Read article →