Reddit,但使用了多个 LLM 代理,并且在本地运行

1作者: huydotnet6 个月前
这是我为了好玩创建的一个项目:https://redditwithagents.vercel.app 截图:https://i.imgur.com/JFMFBNF.png 它基本上是一个模仿Reddit部分UI的Web应用程序,允许你在浏览器中与LLM代理进行讨论。 所有LLM API调用都在浏览器中进行,因为该应用程序没有后端。你也可以配置该应用程序使用你的本地LLM API。 例如,要使用LM Studio,请确保你在本地提供模型,并勾选这两个选项:“启用CORS”和“在本地网络上提供”。 它看起来像这样:https://i.imgur.com/TfzIjl4.png 然后转到应用程序的设置页面,设置以下配置: ``` API URL: http://192.168.<whatever>.<your>:1234/v1 API Key: whatever-key-you-set Model: soemthing like openai/gpt-oss-20b ``` 你也可以在这里查看源代码:https://github.com/huytd/reddit-with-agents/
查看原文
This is a project I created for fun: https:&#x2F;&#x2F;redditwithagents.vercel.app&#x2F;<p>screenshot: https:&#x2F;&#x2F;i.imgur.com&#x2F;JFMFBNF.png<p>It&#x27;s basically a web app that mimic parts of Reddit&#x27;s UI, allowing you to discuss with LLM agents right in the browswer.<p>All of the LLM API calls happen in the browser as the app does not have a backend. You can also config the app to use your local LLM APIs as well.<p>For example, to use LM Studio, make sure you serve the model locally and checked the two options: &quot;Enable CORS&quot; and &quot;Serve on Local Network&quot;<p>here&#x27;s what it look like: https:&#x2F;&#x2F;i.imgur.com&#x2F;TfzIjl4.png<p>Then go to the app&#x27;s settings page, set the following configs:<p><pre><code> API URL: http:&#x2F;&#x2F;192.168.&lt;whatever&gt;.&lt;your&gt;:1234&#x2F;v1 API Key: whatever-key-you-set Model: soemthing like openai&#x2F;gpt-oss-20b </code></pre> You can also check the source code here https:&#x2F;&#x2F;github.com&#x2F;huytd&#x2F;reddit-with-agents&#x2F;