HN 提问：关于 AMD Ryzen AI MAX+ 395 用于本地 AI 的看法？
1 分•作者: mempirate•13 天前
想知道是否有人尝试过配备 128GB 统一内存的 Strix Halo 系统用于本地 AI，以及他们在运行不同模型方面的经验如何：
- 参数数量 x 量化后的实际限制
- 您用它来做什么
- 哪些模型和推理引擎结合得好
查看原文
Wondering if anyone has played around with the Strix Halo based systems with 128GB of unified memory for local AI, and what their experience has been so far in running different models:
- Practical limit on number of parameters x quantization
- What you've been using it for
- Which models and inference engines combine well