xAI

Distributed Token-Bucket Rate Limiter

Members only

Coding round (distinct from the inbound/outbound rate-limiter system-design prompt): implement a per-user token-bucket limiter with lazy on-read refill, backed by a shared cache so the whole fleet enf...