HackerNews中文版

最近我感到非常沮丧和焦虑。在看到 Astra 已经饱和了 ARC-AGI-3 并轻松通过了许多其他基准测试后，我很难相信我们今年年底前不会拥有强大的人工通用智能（AGI），最晚也不会超过明年。我不明白为什么我们没有看到一个巨大的呼声要求暂停进一步发展人工智能的强度。即使我们还不知道如何在多国层面协调和执行这样的暂停，但我们似乎也没有花任何精力去研究如何实现这一点。我看到很多人将来自前沿公司自身的警告斥为“营销和制造炒作”。就我个人而言，我无法将我亲眼所见、在工作和日常生活中每天互动的那种能力称为“营销和炒作”。像 OpenAI 首席科学家最近发表的“一个外星心智”这样的帖子，并不能让我感觉好些。似乎我们目前最好的希望就是寄希望于其他前沿实验室会自愿放慢速度。而且，尽管对齐（alignment）远未解决（如果它甚至可以解决的话），但目前的路径似乎是我们为了不让别人抢先而仓促走向超人工智能（ASI）。有人有同样的担忧吗？我发现每天都很难去想别的事情。即使超人工智能（ASI）不会毁灭人类，在不到一年的时间里，从目前的世界适应到“ASI已存在”的状态，也是非常令人不安的。似乎我们所知的生命将在一夜之间改变，而且很可能不是以好的方式，我为我的亲人感到担忧，为所有对正在发生的事情及其潜在影响一无所知的人感到担忧。

查看原文

I'm feeling extremely depressed and anxious lately. After seeing Astra saturating ARC-AGI-3 and blowing through many other benchmarks, it's hard to believe we won't have a strong form of AGI by the end of this year, or the next one at the latest.<p>I don't understand why we're not seeing a MASSIVE clamor for a pause in the further development of AI strength. Even if we don't know how to coordinate and enforce such a pause yet (at the multi-nation level), it seems we're not spending any effort in figuring how to.<p>I see a lot of people dismissing warnings from the frontier companies themselves as nothing but "marketing and generating hype". I myself can't call "marketing and hype" the kind of capability I see before my very eyes and interact with every day, at work and in everyday life otherwise.<p>Posts like the recent "An Alien Mind" by the chief scientist of OpenAI don't make me feel any better. It seems the best hope we have so far is to just hope other frontier labs will voluntarily slow down. And, regardless of the fact that alignment is nowhere near solved (if it can even be solved), it seems the current path is that we will rush toward RSI because otherwise someone else will do it first.<p>Does anyone feel uneasy in this way? I find it hard to think about anything else every single day. Even if ASI doesn't doom mankind, it's very unsettling to have to adapt from the world as it currently is, to "ASI now exists" in less than a year possibly. It seems life as we know it is about to change overnight, and probably not in a good way, and I fear for my loved ones, for all of the people that have no idea of what is going on and what the implications of this will be.

问 HN：大家对 AI 的最新进展感到不安吗？