Show HN: Clusterflock：面向联网硬件的人工智能编排器
2 分•作者: notum•4 个月前
嗨，HN！
我们构建了 Clusterflock，旨在解决我们在管理跨分布式设置、不同 VRAM 和 RAM 限制以及需要轻松试用新模型时遇到的难题。
虽然侧重于基础设施（我们专门为网络硬件构建了它），但它确实附带了一个强大的任务运行器（或编排器），该运行器是多会话和异步的。
以下是它的最佳功能：
硬件感知自动下载：它会分析您的网络硬件，并自动下载最适合您特定设置的模型（目前仅来自 HuggingFace）。
紧密打包：通过 llama.cpp 实现原生并行，您可以让它在同一设备上容纳多个较小的模型。
它是完全开源的。我们希望找到一种轻松部署智能体集群的方法，希望您也会觉得它有用。
网站：<a href="https://clusterflock.net" rel="nofollow">https://clusterflock.net</a>
欢迎提出反馈意见。非常期待您的支持。
查看原文
Hi HN!<p>We built Clusterflock to solve our own headaches with managing AI agents across distributed setups, different VRAM and RAM allowances, and the need to easily try out new models.<p>While the focus on infrastructure (we built this specifically for networked hardware) it does ship with a powerful mission runner (or orchestrator), which is multi-session and asynchronous.<p>Here is what it does best:<p>Hardware-aware auto-downloading: It profiles your networked hardware and automatically pulls down the best models for your specific setup (currently only from HuggingFace).<p>Tight packing: Native parallelism via llama.cpp, you can allow it to fit multiple smaller models on same device.<p>It is fully open-source. We wanted a painless way to deploy agentic clusters, and we hope you find it useful too.<p>Website: <a href="https://clusterflock.net" rel="nofollow">https://clusterflock.net</a><p>Happy to hear feedback. Flocks very much given.