Waymo Common Problems
Simulation Logging and Statistics System Design
System DesigneasyLast reported April 2026
By AceOffer · Updated April 2026 · Reported 1× across 190+ candidate reports
Insider Notes
**Common mistakes:** Focusing only on storage/ingestion without addressing how statistics are computed or served; Ignoring the sim-to-real gap sub-problem entirely; Not defining the schema/structure of simulation log events before designing the pipeline
**What passers do:** Explicitly separating the ingestion, storage, computation, and serving layers; Proactively raising the sim-to-real gap issue and proposing concrete reconciliation mechanisms (importance weighting, source tagging)
**Why people fail:** Treating it as a generic log aggregation problem without addressing autonomous-driving-specific concerns; Struggling to articulate how to handle the data imbalance between simulation and real-world sources
**Edge cases probed:** Sim vs. real data volume imbalance and how it skews aggregate statistics; Schema evolution of log formats across simulation versions; Handling partial or corrupted simulation runs in aggregation
**Alternative approaches:** Lambda architecture (batch + speed layer) (Provides both real-time and historical aggregation but increases operational complexity with two code paths to maintain.); Pure streaming with stateful aggregation (Flink/Dataflow) (Lower latency for live simulation runs; harder to reprocess historical logs and manage exactly-once semantics at scale.); Offline-only batch pipeline (Spark on object storage) (Simpler to implement and reprocess, but no real-time visibility into ongoing simulation campaigns.)
Waymo · System Design · Last reported April 2026