Ask HN:有人有专用的、本地的 AI 服务器吗?

1作者: skwee35713 天前
我正在考虑尝试运行一些本地 AI 模型,用于自主编码,以及尝试基于 AI 模型开发产品。 我目前还没有考虑训练模型,而是更多地关注推理,同时保持预算。我大约有 2000-3000 欧元可以用于硬件,用于在家运行的服务器。我知道可以租用 AI 推理服务器,但根据我的研究,它们通常每月花费 200-300 欧元左右,这意味着我的硬件大约 10 个月就能回本。 然而,我对选择什么硬件感到很困惑。我看到有人推荐在 SFF(小型台式机)电脑中使用 Ryzen AI Pro+ 395,但也有人建议构建一台配备 Nvidia 3090 或 4090 的“普通”电脑。 那些运行小型服务器(而不是 1 万到 1.5 万欧元巨型服务器)的人,你们的经验和建议是什么?
查看原文
I&#x27;m toying with the idea of trying to run some local AI models for both agentic coding, as well as trying to get into developing products on top of AI models.<p>I&#x27;m not, yet, looking into training models, but more about inference, while staying relatively on a budget. I have about €2-3k to spend on hardware, for a server I can run at home. I know that one can rent an AI inference server, but from my research, they tend to cost around €200-300&#x2F;mo, which means that my hardware will pay for itself in ~10 months.<p>However, I&#x27;m quiet confused with what hardware to chose. I saw recommendations for Ryzen AI Pro+ 395, in SFF PCs, but some people suggest instead to build a &quot;regular&quot; PC with Nvidia 3090 or 4090.<p>People who run small servers (as opposed to €10-15k beasts), what&#x27;s your experience and recommendations?