HN 提问:你们如何节省 token?

2 分•作者: bonigv•4 个月前
许多产品都在致力于节省 token 空间。压缩、工具输出重写、作为 harness 和 provider 之间的代理缓存、通过拦截器钩子进行各种操作——这些是我们今天看到的一些方法。 在我进行的测试中,反复观察得出的诚实结论是,只有在 agentic 循环的早期阶段减少 turn(回合数)才能取得切实的成果。在原本有 40 个 turn 的循环中,前 25% 的 turn 节省所带来的收益,远大于在后 50% 的 turn 中节省的收益。我想我不需要在这里解释——这是复合效应。 基于这一观察,是不是应该将更多的精力投入到工具工程(以及所有其他 xyz 工程)上?
查看原文
Lots of products working on saving-tokens-space. Compression, Tool Output rewrite, Sitting as proxy Cache between harness and provider , doing circus with interceptor hooks - these are some of the approaches we are seeing today.<p>In my tests, honest conclusion from repeated observations is that the tangible results are possible only by reducing Turns upfront in an agentic loop. Turns saved in first 25% of an otherwise 40 turn loop can produce significant gains - than turns saved in the latter 50% of the same loop. I don&#x27;t think I need to explain it here - the compounding context.<p>From that observation, shouldn&#x27;t there be a lot more energy put into tool engineering (that all other xyz engineering) ?