KV Cache Implementation for Inference

CodingOpenAILast reported May 2026Medium Frequency

Reported: 7× across candidate reports
First seen: May 2025
Last reported: May 2026
Reported outcome: mixed

Problem Overview

This is the second half of the transformer-debugging round, asked once the four bugs are fixed, and it is not optional: several candidates ran out of time here, and one who finished everything was rejected for not having time to test it. Seven reports. There are no separate tests; your…

5 candidate-reported follow-ups — the exact probes interviewers asked, with the trigger for each
The rest of the problem statement — full requirements, constraints, and edge cases
Approach and trade-offs — what passing candidates did, and the mistakes that sink people

Unlock the full OpenAI catalog

Full problem statements, candidate-reported follow-ups, and walkthroughs — for every OpenAI question.

Unlock with Pro

Already a member? Sign in

Verified Source

Every question is reconstructed from multiple independent candidate reports. Verbatim follow-ups, not invented ones.

Codex Fact-Checked

Technical claims, formulas, and scale numbers are reviewed against primary sources.

Interviewer Follow-ups

The exact follow-ups reported by candidates, with the trigger that prompts each one — plus the mistakes that sink people.