Tag
4 posts
4 posts
How does an assistant remember you across sessions? A speaker-attributed extraction pipeline with dedup and rate limits, three isolation scopes, and a retrieval hierarchy that ranks topics, decays by recency, and never truncates silently.
How do you compare LLMs on generating structured queries? Syntax similarity is worthless. What works: executing generated queries against a live triplestore and comparing result sets — plus a spread rule most benchmarks ignore.
Dense embeddings find paraphrases; full-text finds exact terms. How to run both legs concurrently and fuse their rankings with RRF — a simple formula that consistently beats either leg alone.
When a model answers over private knowledge, the answer must never leak what it used. How to scrub IRIs, UUIDs, and query fragments across streaming chunk boundaries, and how to project provenance as an allowlist.