← 💻 Coding & Engineering CraftNEXT IN CODING & ENGINEERING CRAFTArrays and Hashing→
Core
Streaming and Backpressure
When data is too big to fit in memory or arrives continuously, you process it as a stream, one piece at a time, with bounded memory, rather than loading it all. Backpressure is the mechanism that stops a fast producer from overwhelming a slow consumer, by signaling 'slow down' rather than buffering unboundedly until you run out of memory. Applied-AI interviews probe it because AI pipelines process huge datasets and token streams, and the naive load-everything approach OOMs while unbounded buffering crashes under load.
a free account unlocks the core curriculum tier · no card
RELATED CONCEPTS
PRACTICE THIS IN REAL QUESTIONS
SQL & Data EngineeringDeduplicate events exactly-once over a sliding 7-day window in a high-throughput stream without running out of memory.→SQL & Data EngineeringWhen do you choose batch vs streaming, and what are the Lambda and Kappa architectures?→SQL & Data EngineeringHow does a Kafka stream-processing pipeline achieve exactly-once semantics end to end?→SQL & Data EngineeringHow do you handle late-arriving data in a streaming or incremental pipeline?→SQL & Data EngineeringImplement Slowly Changing Dimension Type 2 history tracking in a Delta lakehouse.→SQL & Data EngineeringGroup a stream of user events into sessions in SQL (30-minute inactivity gap) using window functions.→
COMPANIES THAT ASSUME THIS
