Implement a Decoder KV Cache
Implement a Decoder KV Cache
Implement a KV cache for a single-layer, single-batch Transformer decoder. The key and value of each token are integer vectors of length D.
The cache is initial...
Example
Unlock to view complete problem details
and practice with sample input/output
Was this article helpful?
View Test Cases & Run Code requires membership
Standard Input
Execution Result: