Larger Context Windows Don’t Fix RAG — So I Built a System That Does

The article argues that simply enlarging context windows in RAG systems fails to improve accuracy for aggregation tasks and can actually make errors harder to detect. The author benchmarks retrieval-based pipelines against a deterministic full-scan engine across 100,000 rows, concluding that computation queries should be routed away from RAG entirely.