ann

Every RAG system rests on a vector index, and the interviewer wants to know you understand the recall/latency/memory tradeoff, not just 'use a vector DB.' The signal is why exact search does not scale and how HNSW and IVF make different bets.

At a billion vectors the index choice is a memory budget problem before it's a recall problem. Flat search is out, HNSW may not fit, and PQ trades recall for RAM. Here is the decision a staff engineer makes on the whiteboard.

You don't always need a dedicated vector database. When embeddings live next to your relational data, nearest-neighbor in SQL makes filters and joins trivial. Here is how, and the scale where it breaks.

How large recommenders and search pull candidates from millions of items in milliseconds. The signal is why the user and item towers are separate, how that unlocks precomputed embeddings plus an ANN index, and where ranking takes over.

The service behind every RAG stack and semantic search box. The signal is your ANN index choice and how you handle the three things that quietly break it: metadata filtering, live updates, and scale.

Image search is embedding retrieval at billion-image scale. The tell of a strong answer is knowing when a vision-only encoder suffices and when you need a CLIP-style shared space, plus how the ANN index actually serves the query. Here is the design.

Video search is image search with a time axis, and the time axis is the whole problem. A strong answer embeds frames, pools them into scene vectors, indexes with ANN at billion scale, and explains how a multimodal query (clip, text, or both) finds the right moment, not just the right video.