Vector Isn't Enough: Hybrid Search & Retrieval - Jeff Vestal & James Williams, Elastic

AI Engineer1h 16m
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Video summary

    Jeff Vestal and James Williams compare semantic retrieval with lexical BM25 search. Meaning-based matching helps with paraphrases but can miss exact identifiers; keyword search handles those identifiers while struggling with differently worded requests. Their workshop combines the approaches instead of assuming one is always sufficient.

    Jeff Vestal explains reciprocal rank fusion as combining result positions, while linear combination normalizes scores and exposes weights. Filtering narrows the candidate pool, and judgment sets provide a way to assess whether changed weights improve the desired results. Routing query types to predefined search templates is distinct from an automatic relevance-tuning feature, which the presenters say has not been released.

    James Williams and Jeff Vestal connect retrieval to an Agent Builder example that diagnoses an out-of-memory exit code, performs repeated searches and cites underlying documentation. Index descriptions and parameterized query tools reduce unnecessary exploration. Citations expose the documents used; they do not independently guarantee that an answer is correct.

    Jeff Vestal compares pointwise and listwise rerankers as a second retrieval stage. The extra inference cost is useful when a small set of highly similar candidates requires better ordering, but may be unnecessary when first-stage results already meet the relevance target. End-to-end latency includes model inference, not only the database lookup.

    Original YouTube thumbnailWatch on YouTube

    Share this page

    Portraits of Jeff Vestal, James Williams against black with the headline HYBRID SEARCH in attention blue and white. Framed in blue with WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 11 October 2026 and duration 1h 16m.

    Jeff Vestal and James Williams explain how hybrid search, filtering and measured reranking improve the evidence supplied to an agent.