大型组织减少 AI 令牌使用量的想法
3 分•作者: mgav•大约 1 个月前
可能存在许多高度相似的高令牌任务的重复。<p>也许对于高令牌任务，首先在公司内部自动化搜索先前的工作，解析已完成或未完成的部分，然后仅提示 AI 完成新组件，最后将这些组件组装起来再提供给用户。<p>如果冗长的组件已经完成，整体输出可能会更快。<p>这是 OpenRouter 的一个附加功能，还是独立的功能？
查看原文
There must be many near-identical repeats of high-token tasks.<p>Perhaps for high-token tasks, first an automated search of prior work within the firm, parsing what's already done or not done, and only prompting AI for the new components, then assembling the components before serving to the user.<p>If lengthy components were already done. the overall output might be faster.<p>Is this an add-on to OpenRouter, or standaloone?