Show HN: 面向 LLM 运维的彭博终端——免费开源
2 分•作者: amans9712•4 个月前
彭博终端之所以存在，是因为金融交易员需要一个可以查看所有信息的平台：价格、风险、交易路径、交易对手的健康状况。你不能闭着眼睛交易。
LLM 工程师们正在闭着眼睛交易。
哪个提供商目前性能下降？在考虑了开销，而不仅仅是代币价格后，这个模型的实际成本是多少？如果流量在不同提供商之间转移，成本和延迟会发生什么变化？你的技术栈是否危险地集中在一个提供商上？
这些是每个生产 LLM 系统都面临的运营问题。直到现在，还没有人为此构建过相应的工具，所以大多数团队要么闭着眼睛摸索，要么拼凑状态页面、电子表格和凭感觉来解决问题。
我们构建了 LLM Ops 工具包来解决这个问题：
1. 跨 18+ LLM 提供商的提供商正常运行时间监控器，在一个视图中实时显示状态
2. 成本计算器，包括开销，而不仅仅是原始代币价格
3. 路由模拟器，用于在转移流量之前模拟成本和延迟的影响
4. 模型多样性审计，用于在风险成为事件之前发现集中风险
免费、开源，无需注册。仪表盘位于 tools.lamatic.ai
路由模拟器是最具实验性的部分，也是最粗糙的部分。 真的很好奇其他人是如何看待提供商集中风险的。
我们一直将其视为软件中的依赖风险，但这种框架可能无法大规模适用。
今天也在 Product Hunt 上线：producthunt.com/products/lamatic-ai
查看原文
Bloomberg Terminal exists because financial traders needed one place to see everything: prices, risk, routing, counterparty health. You can't trade blind.<p>LLM engineers are trading blind.<p>Which provider is degraded right now? What does this model actually cost when you factor in overhead, not just token price? If traffic shifts between providers, what happens to cost and latency? Is your stack dangerously concentrated on one provider?<p>These are operational questions every production LLM system has. Nobody's built the tooling for them until now, so most teams either fly blind or patch together status pages, spreadsheets, and gut feel.<p>We built the LLM Ops Toolkit to fix that:<p>1. Provider uptime monitor across 18+ LLM providers, live status in one view
2. Cost calculator that includes overhead, not just raw token pricing
3. Routing simulator to model cost and latency impact before you shift traffic
4. Model diversity audit to surface concentration risk before it becomes an incident<p>Free, open-source, no signup. Dashboard is at tools.lamatic.ai<p>The routing simulator is the most experimental piece and has the roughest edges. Genuinely curious how others think about provider concentration risk.<p>We've been treating it as dependency risk in software but that framing may not hold at scale.<p>Also live on Product Hunt today: producthunt.com/products/lamatic-ai