HN 提问：构建智能体时，你们会跟踪哪些指标？
2 分•作者: rstagi•3 个月前
我主要关注的指标是推理成本，这能很好地指示出问题所在。
然而，几天前我发现由于一个 bug，我们加载了大约 300 个工具，这同时影响了成本和准确性。这个问题已经存在一段时间了，我并没有通过查看成本来发现它，因为它被我同期进行的其他更改所掩盖了。
现在我开始跟踪这个指标以及其他一些指标，但这让我开始思考我可能还遗漏了什么。所以：你们在跟踪什么？有什么建议吗？我很想听听。
查看原文
The main metric I look at is inference cost, which is a pretty good indicator when something's off.<p>However, a couple of days a go I discovered we were loading ~300 tools due to a bug, affecting both costs and accuracy. It was going on for some time and I didn't realize it by looking at the costs, cause it got hidden by other changes I made in the same period.<p>Now I started tracking that and some other metrics, but it made me wonder what else I might be missing. So: what are you tracking? Any tips? Curious to hear