vector search
Applied AI interview questions tagged vector search, across every topic.
6 questions · 3 unlocked for you
Concepts behind "vector search"
The curriculum that explains the ideas these questions test.
Foundational
kNN and the Curse of Dimensionalityk-nearest-neighbors is a lazy, instance-based learner that classifies a point by majority vote of its closest training examples under some distance metric. Interviews probe it because its failure mode, distance concentration in high dimensions, teaches why naive nearest-neighbor search breaks down and why production systems lean on approximate nearest-neighbor indexes instead.📊 Evaluation & ML Foundations
Core
Choosing and Adapting Embedding ModelsPicking an embedding model is a decision about retrieval quality, cost, and operational risk on your data, not about who tops a public leaderboard. The hard parts are benchmarking on your own queries, trading dimensionality against storage and latency, deciding whether to fine-tune for your domain, and planning for the re-embedding migration when the model changes. Applied AI interviews probe it because candidates default to the leaderboard winner and ignore the drift and migration costs that bite later.🤖 Retrieval & AgentsSign in
Core
Late-Interaction Retrieval (ColBERT)Late-interaction retrieval represents each document as one vector per token rather than a single pooled vector, then scores a query by summing the best token-to-token matches (MaxSim). It sits between cheap single-vector bi-encoders and expensive cross-encoder rerankers: more precise than a single vector, far cheaper than running a full reranker on every candidate, but with a large storage cost. Applied AI interviews probe it because knowing when this middle tier is worth its disk footprint shows real retrieval-architecture judgment.🤖 Retrieval & AgentsSign in
Core
Hybrid Search and Reciprocal Rank FusionPure vector search captures meaning but misses exact terms (codes, names, SKUs); pure keyword search (BM25) nails exact terms but misses synonyms and intent. Hybrid search runs both and fuses the results, and Reciprocal Rank Fusion is the simple way to merge their rankings without calibrating incomparable scores. Applied-AI interviews probe it because production retrieval is almost always hybrid, and knowing why (and how to fuse) signals real RAG experience.🤖 Retrieval & AgentsSign in
