RAG

Retrieval-augmented generation as a system with knobs — chunk size, top-k, rerankers — and how to tell which of them is actually carrying the result.

2 posts

• A/B testing your RAG pipeline

  4 August 2026 · 5 min read

  Chunk size 512 because a blog post said so. Eight knobs, what each trades against, how to test it — and why retrieval metrics are diagnostic while end-to-end quality is the decision.

  • RAG
  • A/B testing
  • evaluation

• How to put a number on hallucination

  3 August 2026 · 6 min read

  “Hallucination rate” is four different failures wearing one word. The taxonomy with a detection method for each, why groundedness has to be scored per claim rather than per answer, and why the absolute number belongs nowhere near a sales deck.

  • evaluation
  • LLM-as-judge
  • RAG