Ask HN: 关于“爪子”和人机协同安全
1 分•作者: qixxiq•5 个月前
大家好,
我构建了 Sandclaw (https://github.com/qix/sandclaw),目的是测试一个想法:在代理可能执行的任何写入路径上,都让人类参与其中。核心代理可以访问任何信息进行读取,但除了 LLM 提供商之外,这些信息都通过安全防火墙隔离。
随着时间的推移,我可以放宽防火墙,允许更安全的操作(例如,向我的待办事项列表添加任务总是安全的),甚至可能构建更智能的检查,以实现更大的自主性。但目前,对于发送/删除电子邮件、浏览不受信任的网站或运行 shell 命令,都采取“默认拒绝”策略。
有没有哪个项目真正实现了这种机制?我一直在搜索,但似乎所有选项都侧重于让代理决定何时提问,这感觉… 很有问题。
查看原文
Hi all-<p>I built Sandclaw (https://github.com/qix/sandclaw) to test an idea of having a human in the loop on any write path that the agent might do. The core agent has access to read anything, but other than to the LLM provider that information is securely firewalled off.<p>Over time I can loosen the firewall, and allow safer actions (i.e. adding a task to my todo list is always safe), and perhaps build smarter checks to allow more autonomy. But the `DEFAULT DENY` to sending/deleting emails, browsing untrusted websites, or running shell commands.<p>Is there any project that actually does this? I've been searching but it looks like all the options focus on letting the agent handle when to ask, which feels... problematic.