Blog / Tag / ai evaluation
Tag archive
ai evaluation
2 posts tagged ai evaluation from Building Agentic AI. Practical writing on agentic AI.
2 posts · All posts →
- Aug 14 2026
The Hard Part of an AI Eval Set Is the Answer Key
An automated score said my retriever was failing badly. I read the failures by hand and found my own answer key was wrong. Here is what that cost, and what it did not fix.
· Enterprise · 10 min read
- Jul 23 2026
When the Small Language Model Isn't the Bottleneck
On an offline 350M assistant, model choice mattered, and then stopped being the limit. Several failures I blamed on the model started in the system around it.
· Enterprise · 27 min read