Show HN:使用 mistral.rs v0.8.10 运行 Agent Skills:支持 /v1/skills 及更多功能

8作者: ericlbuehler3 天前
大家好! 我是 mistral.rs 的维护者。我刚刚为 OpenAI 兼容的 Agent Skills 添加了支持,通过 `/v1/skills` 端点实现,并且可以在本地的开放模型上运行。 到目前为止,Skills 主要局限于闭源模型。随着私有化、本地化智能的重要性日益增加,这项功能将允许您使用本地模型执行 XYZ 操作。 它与 OpenAI 的 `/v1/skills` API 完全兼容,因此您可以轻松地将 mistral.rs 集成到您现有的代码中。 我们还支持相关的工具:`/v1/files` 或 `input_file` 用于将文件附加到您的提示中,并且 mistral.rs 还允许模型使用 OpenAI 兼容的方法将生成的文件发送回来。 现在尝试 mistral.rs 比以往任何时候都更容易:我们提供了 NVIDIA CUDA、Apple Silicon 和 CPU 的预编译二进制文件! # Linux/Mac > curl --proto '=https' --tlsv1.2 -sSf https://raw.githubusercontent.com/EricLBuehler/mistral.rs/master/install.sh | sh # Windows > irm https://raw.githubusercontent.com/EricLBuehler/mistral.rs/master/install.ps1 | iex 然后: mistralrs serve --agent --isq 4 -m google/gemma-4-E4B-it 我非常期待您试用这项功能并提供反馈!您对下一版本有什么建议吗? 查看 GitHub:https://github.com/EricLBuehler/mistral.rs 文档和快速入门:https://ericlbuehler.github.io/mistral.rs/
查看原文
Hey all! I&#x27;m the maintainer of mistral.rs. I just landed support for OpenAI-compatible Agent Skills via a &#x2F;v1&#x2F;skills endpoint, and it works with local open models.<p>Until now Skills have basically been locked to closed models, and with the ability to have private, local intelligence becoming increasingly important, but this feature allows you to do XYZ with local models.<p>It&#x27;s fully compatible with OpenAI&#x27;s &#x2F;v1&#x2F;skills API, so you can drop mistral.rs into your existing code with minimal difficulty.<p>We support the accompanying tools too: &#x2F;v1&#x2F;files or input_file for attaching files to your prompts, and mistral.rs also allows models to send generated files back using the OpenAI-compatible method.<p>It&#x27;s also easier than ever to try mistral.rs: we are including prebuilt binaries for NVIDIA CUDA, Apple Silicon, and CPU! # Linux&#x2F;Mac &gt; curl --proto &#x27;=https&#x27; --tlsv1.2 -sSf <a href="https:&#x2F;&#x2F;raw.githubusercontent.com&#x2F;EricLBuehler&#x2F;mistral.rs&#x2F;master&#x2F;install.sh" rel="nofollow">https:&#x2F;&#x2F;raw.githubusercontent.com&#x2F;EricLBuehler&#x2F;mistral.rs&#x2F;ma...</a> | sh # Windows &gt; irm <a href="https:&#x2F;&#x2F;raw.githubusercontent.com&#x2F;EricLBuehler&#x2F;mistral.rs&#x2F;master&#x2F;install.ps1" rel="nofollow">https:&#x2F;&#x2F;raw.githubusercontent.com&#x2F;EricLBuehler&#x2F;mistral.rs&#x2F;ma...</a> | iex<p>Then: mistralrs serve --agent --isq 4 -m google&#x2F;gemma-4-E4B-it<p>Super excited for you to try this out and any feedback! Do you have any suggestions for what you would like to see in the next releases?<p>Check out the GitHub: <a href="https:&#x2F;&#x2F;github.com&#x2F;EricLBuehler&#x2F;mistral.rs" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;EricLBuehler&#x2F;mistral.rs</a> Docs &amp; Quickstart: <a href="https:&#x2F;&#x2F;ericlbuehler.github.io&#x2F;mistral.rs&#x2F;" rel="nofollow">https:&#x2F;&#x2F;ericlbuehler.github.io&#x2F;mistral.rs&#x2F;</a>