Design the perception system for an autonomous vehicle (or robot).

AV perception is safety-critical, real-time, multimodal ML: detect and track everything around the vehicle from multiple sensors. The signal is sensor fusion plus detection/tracking under a hard latency budget and a fail-safe bar. Here is the design.

Updated Aug 2026 · Grounded in real Applied AI Engineer interview loops and written to a senior-engineer editorial bar.