GPT-5.4的一个漏洞导致OpenAI封禁了“地精”和“浣熊”。

1作者: prabal973 个月前
有人在 OpenAI Codex 的系统提示中发现了这段话: “永远不要谈论地精、小精灵、浣熊、巨魔、食人魔、鸽子或其他动物或生物,除非它们与用户的查询绝对且明确相关。” 地精、小精灵、巨魔、食人魔——奇幻四人组,没问题。我理解。也许有人让 Codex 写点什么,结果它回复了一篇关于 Runescape 地精传说的深度分析。 但鸽子呢?浣熊呢?这些是部署环境中的动物啊。 如果不是浣熊,谁来清理垃圾呢? RFC 1149(IP over Avian Carriers,1990 年,一个真正的协议——在卑尔根有实际的实现)将鸽子明确地置于系统工程的范畴之内。 “或其他动物或生物”——完全的反生物议程。每小时都有数百万美元在处理这些提示时被烧掉。 事实证明,禁止是有原因的。早在 5.4 版本,GPT 就对地精产生了痴迷,而且 Reddit 上有帖子,里面全是用户说他们的 ChatGPT 总是提到小精灵。这个系统提示是 5.5 版本附带的驱魔咒语。 如果你认为我在撒谎,请自己看:提示就在下面分享的 repo 链接中。 REPO 链接:https://github.com/openai/codex/blob/de2ccf94735a3d8a2a7077e6a5292026413867cf/codex-rs/models-manager/models.json#L55 HN 链接:https://news.ycombinator.com/item?id=47319285 REDDIT 帖子 1:https://www.reddit.com/r/ChatGPT/comments/1roci77/anyone_elses_chatgpt_obsessed_with_goblins_since/ REDDIT 帖子 2:https://www.reddit.com/r/ChatGPT/comments/1rll8hb/suddenly_obsessed_with_goblins_and_gremlins/
查看原文
Someone found this in OpenAI Codex’s system prompt:<p>&quot;Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons, or other animals or creatures unless it is absolutely and unambiguously relevant to the user’s query.&quot;<p>Goblins, gremlins, trolls, ogres - the fantasy quartet, fine. I get it. Perhaps someone asked Codex to write something and got back a Runescape goblin lore deep-dive.<p>But pigeons? Raccoons? These are deployment-environment animals.<p>If not for raccoons, who’d do the garbage collection?<p>RFC 1149 (IP over Avian Carriers, 1990, an actual protocol - with an actual implementation, in Bergen) puts pigeons squarely inside the systems-engineering canon.<p>“Or other animals or creatures” - full anti-creature agenda. Literally a bajillion dollars get set on fire every hour processing these prompts.<p>Turns out there’s a reason for the ban. Back in 5.4, GPT developed a goblin obsession and there are reddit threads full of users whose ChatGPT couldn’t stop bringing up gremlins. The system prompt is the exorcism that shipped with 5.5.<p>If you think I’m lying, see for yourselves: the prompt is right there in the repo link shared below.<p>REPO LINK: https:&#x2F;&#x2F;github.com&#x2F;openai&#x2F;codex&#x2F;blob&#x2F;de2ccf94735a3d8a2a7077e6a5292026413867cf&#x2F;codex-rs&#x2F;models-manager&#x2F;models.json#L55<p>HN LINK: https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=47319285<p>REDDIT THREAD 1: https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;ChatGPT&#x2F;comments&#x2F;1roci77&#x2F;anyone_elses_chatgpt_obsessed_with_goblins_since&#x2F;<p>REDDIT THREAD 2: https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;ChatGPT&#x2F;comments&#x2F;1rll8hb&#x2F;suddenly_obsessed_with_goblins_and_gremlins&#x2F;