HackerNews中文版

我们是一家小型推理服务提供商，两周前正式上线，需求增长迅猛。我联系了许多其他推理服务提供商，比如Fireworks、TogetherAI、simpliAI等，向他们询问了各自的增长情况，以及他们对这个领域的观察和预测。Fireworks的一位高管告诉我，自今年1月以来，整个行业平均每周增长10%——这种爆炸性的增长速度感觉很不真实。我真的预计今年晚些时候会出现价格挤压，没有人能跟上。我认为我们已经开始在GPU价格上看到这一点——H100的按需价格已经从1.30美元涨到了1.90美元左右，H200节点已经售罄，候补名单超过3个月。根据我得到的报价，B300的候补名单接近一年。市场太疯狂了。

查看原文

So we're a small inference provider, launched publicly two weeks ago and have seen a crazy demand of growth.I reached out to a lot of other inference providers such as fireworks, togetherAI, simpliAI etc and started asking them their growth and what they are seeing in this space / what they predict we will see over this year.I was told by a higher up at fireworks that on average since January the space as a whole has had 10% week over week growth -- this type of explosive growth feels unreal. I honestly expect a price squeeze later this year, no one can keep up.I think we're starting to see this with GPU prices -- h100s have gone from 1.30 on demand to 1.90 about, h200 nodes are all sold out with 3+ month waitlists. B300s have near a year waitlist from the quotes I got. Insane market.

今年，开源推理每周增长10%。