ByteDance / TikTok logoByteDance / TikTok
Coding·60 minMembers

Hand-Code Self-Attention and Cross-Entropy

Members only

Write self-attention pseudocode and the cross-entropy loss derivation on the spot, interleaved with attention-mechanism oral questions (FFN role, attention scaling).

MLE
RS
transformer
attention
numpy
pytorch
ml-knowledge
hard
Frequency
Low
Last asked
2026-05-01
Stage
phone-screen · onsite-coding

Log in to continue reading the full content

Comments

Sign in to join the discussion
Loading...