Ask HN：是什么让维持大型语言模型在线如此困难？
2 分•作者: realberkeaslan•4 个月前
感觉每隔几天，大型 AI 服务就会出现宕机、性能下降或速度变慢的情况。我这并不是在抱怨，只是真的很好奇。这些都是资金雄厚、人才济济的公司。运行这些模型到底有什么难处，导致可靠性如此难以捉摸？仅仅是因为需求超出了预期，还是说，提供 AI 服务的本质与普通 Web 应用有所不同？
查看原文
It feels like every few days one of the big AI services is down, degraded, or just slow. I don't mean this as a complaint. I'm just genuinely curious. These are well-funded companies with smart people. What is it about running these models that makes reliability so elusive? Is it just demand nobody predicted, or is there something fundamentally different about serving AI vs. a normal web app?