Design a Pipeline Around a Black-Box Model Service

System DesignScale AILast reported April 2026Medium Frequency
Reported
5× across candidate reports
First seen
February 2025
Last reported
April 2026
Reported outcome
mixed

Problem Overview

Design a pipeline around a black-box model service you cannot change. Five reports describe this round, with different briefs, so ask which one you have: - A classification validation system: read records from a database, check them with a black-box validator, and email users to validate results by hand. The…

  • 3 candidate-reported follow-ups — the exact probes interviewers asked, with the trigger for each
  • The rest of the problem statement — full requirements, constraints, and edge cases
  • Approach and trade-offs — what passing candidates did, and the mistakes that sink people
Unlock the full Scale AI catalog
Full problem statements, candidate-reported follow-ups, and walkthroughs — for every Scale AI question.
Unlock with Pro
Already a member? Sign in
Verified Source
Every question is reconstructed from multiple independent candidate reports. Verbatim follow-ups, not invented ones.
Codex Fact-Checked
Technical claims, formulas, and scale numbers are reviewed against primary sources.
Interviewer Follow-ups
The exact follow-ups reported by candidates, with the trigger that prompts each one — plus the mistakes that sink people.
Is this helpful?