Microsoft

Transformer Roofline + FP32→FP16 Drill

Members only

MAI AI-infra loop: read transformer code, compute matmul wall-clock from roofline, vibe-code CUDA in your own editor, then defend the residual-connection gradient path under FP32→FP16 casting.