Your AI Agent Passed Every Eval. Finance Still Killed It.
in the eval harness. Then it got shut down. I was in the room for the review that killed it. A mid-market SaaS company had built a customer-operations agent to handle billing and account tickets. They had instrumented it against the twelve-metric evaluation framework I published on this site two months ago. Task completion, faithfulness,…