The more I dig into properly evaluating RAG, the more I think that purely evaluating retrieval metrics (MRR, precision) isn’t the whole picture 🤔- you need end-to-end response evals 🧑🔬 🔎 In standard retrieval, you assume the documents are *fixed*. By knowing the ground-truth… https://t.co/8zGYEm0eTE https://t.co/BfGwvKcYXV
— Jerry Liu (@jerryjliu0) Sep 26, 2023
from Twitter https://twitter.com/jerryjliu0
September 26, 2023 at 12:30PM
via IFTTT
No comments:
Post a Comment