Ask HN:有人有专用的、本地的 AI 服务器吗?
1 分•作者: skwee357•13 天前
我正在考虑尝试运行一些本地 AI 模型,用于自主编码,以及尝试基于 AI 模型开发产品。
我目前还没有考虑训练模型,而是更多地关注推理,同时保持预算。我大约有 2000-3000 欧元可以用于硬件,用于在家运行的服务器。我知道可以租用 AI 推理服务器,但根据我的研究,它们通常每月花费 200-300 欧元左右,这意味着我的硬件大约 10 个月就能回本。
然而,我对选择什么硬件感到很困惑。我看到有人推荐在 SFF(小型台式机)电脑中使用 Ryzen AI Pro+ 395,但也有人建议构建一台配备 Nvidia 3090 或 4090 的“普通”电脑。
那些运行小型服务器(而不是 1 万到 1.5 万欧元巨型服务器)的人,你们的经验和建议是什么?
查看原文
I'm toying with the idea of trying to run some local AI models for both agentic coding, as well as trying to get into developing products on top of AI models.<p>I'm not, yet, looking into training models, but more about inference, while staying relatively on a budget. I have about €2-3k to spend on hardware, for a server I can run at home. I know that one can rent an AI inference server, but from my research, they tend to cost around €200-300/mo, which means that my hardware will pay for itself in ~10 months.<p>However, I'm quiet confused with what hardware to chose. I saw recommendations for Ryzen AI Pro+ 395, in SFF PCs, but some people suggest instead to build a "regular" PC with Nvidia 3090 or 4090.<p>People who run small servers (as opposed to €10-15k beasts), what's your experience and recommendations?