The challenge, approach & outcome.
- 01Challenge
A medical-information provider was answering a backlog of clinician and patient inquiries by hand. Every answer had to cite a source from a compliance-approved knowledge base. Throughput was the bottleneck; safety was non-negotiable.
- 02Approach
Hybrid RAG (BM25 + embeddings) over the approved corpus, with strict citation requirements at generation time. The agent refuses cleanly when context is missing, and routes ambiguous queries to a clinician review queue. A continuous eval suite runs every prompt change against 1,200 reference answers.
- 03Outcome
Average response time down 72%, citation-match rate at 98.4% on the eval set, and zero policy violations in 90 days of production. The clinician review queue now sees only the 6% of queries that genuinely need expert judgement.

