your rag eval number is hiding regressions
ragdiff: a small open-source tool that diffs two retriever configs per-query instead of scoring one in aggregate — because a metric that went up can still be hiding queries that got worse.
RAGretrievalevaluationopen source