我们为什么要构建超级智能？
2 分•作者: Taikhoom10•10 个月前
嘿，各位 HN 用户，
明天，或者可能这周末，GPT-5 就要发布了。我还记得 22 年，基于 GPT-3 的 ChatGPT 发布时，世界为之疯狂。人们对 LLM 趋之若鹜，三年后，世界已经沉迷于 AI。我无法断言这究竟是好是坏。
在继续之前，我完全支持为了人类福祉而推动技术进步。谁不是呢？就我个人而言，我也完全不担心“AI”抢走工作。我相信新的工作岗位肯定会被创造出来。
我真正担心的是超级智能。你可能会觉得我杞人忧天，但我认为，如果我正确理解了这个概念，它本质上就是一个能够自主做出决策，并且比全人类都更聪明的思考型计算机。这可能有点科幻，所以这里有一个技术性的描述：一种在所有领域都超越人类智能的 AI。
现在，有人可能会指出，超级智能甚至还没有出现，为什么要担心不存在的东西。虽然这是事实，但我很难相信，在 AI 发展如此迅速的情况下，人们没有想到在未来十年左右，甚至更长时间，超级智能可能会被创造出来。
我对此的困惑在于，我们为什么要故意构建一个超越我们的东西。如果答案是“为了超越中国”，我只是觉得这不够好。而且，在那个时候，人类的角色是什么？在此之前，我们是绝对的统治物种，为什么要创造一个更智能的存在，它很可能终结我们所知的人类文明？为什么要冒这个险，为什么？
我知道最终我无法控制这一切，但我只是想知道，为什么人们要追求创造超级智能。
查看原文
Hey HN,
Tommorow, or maybe this weekend, GPT Five Releases. I remember back in 22 when Chat Gpt based of gpt 3 was released. The world went bezerk on a llm, and 3 years later the world is AI obsessed. I cannot tell you if this is a good thing.
Before i move on i am all for the advancement of technology for the betterment of humanity. Who isn't? And personally i am also not worried at all about "AI" taking jobs. New jobs will be created i am sure of it.
What i am worried about is Super Intellgence. And you might think i am stupid or silly for being worried, yet if i think i understand the concept of it correctly in essence a thinking computer that can make decisions on its own and is smarter than all of humanity. This may be a bit on the sci fi edge so here is the technical description : an AI that surpasses all humans intellgence in all domains.
Now one might point out that super intellgence is not even here, why worry about something that doesnt exist. And while that is true i find it hard to beleive that people do not think at the pace AI is going that sometime in the next decade or so, maybe more that Super Intellgence will be created.
My problem with this is that why are we purposely building something that surpasses us. If the answer is China, i just do not think that is good enough. As well as what is a humans role at that point. Before that we were by far the dominant specices why create something more intellgent that could very well end humanity as we know it. Why take that risk, why?
I know in the end i have no control over this, yet i just want to know why one should pursue creating Superintellgence.