~/blog/topic/evals

Evals

One article on this topic.

  1. 7 MIN READMy prompt couldn't add, and my eval didn't say whyI built an LLM scorer with a threshold I never measured and eyeballed it until something showed up. Two weeks later: 39 labels and a bug in the prompt.