Show HN: 时光机 - 通过分叉和回放任意步骤来调试 AI 智能体

2作者: deva005 个月前
嘿,HN!我们正在构建 Time Machine,一个用于 AI 智能体的调试和重放平台。我们希望得到您的反馈。 演示:[https://youtu.be/KyOP9BY0WiY](https://youtu.be/KyOP9BY0WiY) 网站链接:[https://timemachinesdk.dev/](https://timemachinesdk.dev/) 我们试图解决的最初问题是:想象一下,一个智能体正在运行,进行到第 9 步(共 10 步),它幻觉了一个工具调用,向你的数据库写入了垃圾数据,然后崩溃了。你修复了提示。你重新运行。1.50 美元没了。这种情况在午餐前又发生了六次。对于在生产环境中运行非平凡工作流程的团队来说,每天花费 100 美元以上用于重新运行是常态。 我们围绕一个想法构建了 Time Machine:当一个智能体在第 9 步失败时,你应该能够从第 8 步分叉,并且只重放下游内容。 如何实现:放入 TypeScript SDK(或 LangChain 回调适配器,实现零代码集成),每个步骤都会被记录下来——输入、输出、LLM 调用、工具调用、完整状态——并持久化到 PostgreSQL。仪表板为你提供执行的时间线和 DAG。在任何时候,你都可以分叉、更改某些内容(交换模型、编辑提示、调整输入),只重放下游步骤,并并排比较这两个运行。 我们反复思考的内部框架是:智能体执行的 Git。检查点、分支、差异、重放。 我们已经看到了一些重叠的工具:LangSmith、Helicone 和 LangFuse。它们是很好的工具,但主要是记录器。可观察性是必要的,但在你真正需要更改某些内容并查看结果时,它是不够的,而这正是我们让你能够轻松做到的。 我们还提供原生的 Claude Code 集成。安装一次 hook bridge,每个 Claude Code 会话都会自动捕获为 Time Machine 执行:工具调用、token 计数、文件编辑、git 上下文、子智能体树。你可以在同一个仪表板中获得对 Claude Code 工作流程的全面可观察性,使用相同的时间线和分叉工具,无需任何手动检测。除此之外,我们正在积极努力,以便直接从你的终端启用 Time Machine,这样你就可以要求 Claude Code 提取失败的运行,检查跟踪,并建议修复,而无需离开你的编辑器。我们的目标是,调试循环保持在开发循环已经存在的地方。 我们还在同一个基础设施上构建一个评估平台。生产运行会自动成为测试用例。你可以针对重放的输出运行断言(包含、正则表达式、余弦相似度、LLM 作为评估者、延迟和成本约束),并将其插入 CI/CD,以便在发布之前测试提示更改。 当前状态: MVP 已上线 - 执行捕获、会话重放、分叉/重放和 Claude Code 集成。评估平台正在发布。SDK 是零依赖的。 正在寻找积极调试生产智能体的团队,他们希望成为早期的设计合作伙伴。如果这是一个你正在大规模处理的问题,我们很乐意深入探讨。我们希望人们能够亲身体验这个工具,针对真实的智能体运行进行测试,并让我们知道什么可以真正帮助我们消除手动基础设施和智能体管理开销——这样你就可以专注于迭代并快速获得价值。
查看原文
Hey HN! We are building Time Machine, a debugging and replay platform for AI agents. We would love your feedback.<p>Here&#x27;s a demo: <a href="https:&#x2F;&#x2F;youtu.be&#x2F;KyOP9BY0WiY" rel="nofollow">https:&#x2F;&#x2F;youtu.be&#x2F;KyOP9BY0WiY</a> Website Link: <a href="https:&#x2F;&#x2F;timemachinesdk.dev&#x2F;" rel="nofollow">https:&#x2F;&#x2F;timemachinesdk.dev&#x2F;</a><p>Here is the initial problem we are trying to solve: Imagine it&#x27;s Step 9 of 10 of an agent running, and it hallucinated a tool call, wrote garbage to your database, and crashed. You fix the prompt. You re-run. $1.50 gone. This happens six more times before lunch. Teams burning $100+ per day on re-runs is normal once you are running non-trivial workflows in production.<p>We built Time Machine around one idea: when an agent fails at step 9, you should be able to fork from step 8 and replay only what is downstream.<p>How: Drop in the TypeScript SDK (or the LangChain callback adapter for zero-code integration) and every step gets recorded — inputs, outputs, LLM calls, tool invocations, full state — persisted to PostgreSQL. The dashboard gives you a timeline and DAG of the execution. At any point, you can fork, change something (swap a model, edit a prompt, tweak an input), replay only the downstream steps, and diff the two runs side by side.<p>The internal framing we keep coming back to: Git for agent execution. Checkpoint, branch, diff, replay.<p>What we already see out there with some overlap: LangSmith, Helicone, and LangFuse. They are good tools, but mainly loggers. Observability is necessary but not sufficient when what you actually need is to change something and see what happens, which is what we enable you to do easily.<p>We also ship a native Claude Code integration. Install the hook bridge once, and every Claude Code session is automatically captured as a Time Machine execution: tool calls, token counts, file edits, git context, subagent trees. You get full observability over your Claude Code workflows in the same dashboard, with the same timeline and fork tooling, without any manual instrumentation. In addition to this, we are actively working on enabling Time Machine directly from your terminal, so you can ask Claude Code to pull a failed run, inspect the trace, and suggest a fix without leaving your editor. The intent is that the debugging loop stays where the development loop already lives.<p>We are also building an eval platform on the same infrastructure. Production runs become test cases automatically. You can run assertions (contains, regex, cosine similarity, LLM-as-judge, latency, and cost constraints) against replayed outputs and plug it into CI&#x2F;CD so prompt changes get tested before they ship.<p>Current status: MVP is live - execution capture, session replay, fork&#x2F;replay, and Claude Code integration. The Eval platform is shipping now. The SDK is zero-dependency.<p>Looking for teams actively debugging production agents who want to be early design partners. Happy to go deeper if this is a problem you are dealing with at scale. We would love for people to get their hands on this, test against real agent runs and let us know what can actually help us to take out the manual infra and Agent management overhead away from your hands - so you can focus on iterating and getting to value quickly.