1800人使用AI后,我学到的东西
2 分•作者: Ozzie-D•大约 2 个月前
我正在运行一个人工智能流畅度评估工具,在1800名真实用户与我们的聊天机器人互动20-40分钟后,我们发现了一些有趣的现象:
1. AI流畅度最低的专业人士高估了自己的分数40分。而流畅度最高的专业人士则低估了27分。这产生了67分的邓宁-克鲁格效应差距。
2. 产品经理在AI流畅度上超越了工程师(59.2 vs 53.7)。应用判断力胜过技术知识。
3. 人力资源人员(讽刺的是,他们使用AI做招聘决策)对AI的理解最少,AI流畅度得分最低。
4. 人们普遍声称自己擅长使用AI,但三分之二的人甚至未能达到熟练水平。
5. 1800名专业人士的平均AI流畅度得分为48分,处于“发展中”的水平。大多数人经常使用AI,但缺乏系统性的练习。
6. 公司范围内的AI培训假设每个人都从同一起点开始。数据显示,同一团队内,起点差异可达5倍。
7. 同一家公司,相同的工具,相同的培训预算。在一个团队中,AI流畅度最低和最高的员工之间的差距为82分(15分到97分)。
如果您对此持怀疑态度(这是应该的),可以在这里查看我们的方法论:https://aisa.to/methodology
查看原文
I'm running a an AI fluency assessment tool and after 1800 real users who interact with our chat bot 20-40 minutes; here are some weird things we found out.<p>1. The least AI-fluent professionals overestimated their score by 40 points. The most fluent underestimated by 27. 67 point Dunning-Kruger gap.<p>2. Product managers outscore engineers on AI fluency (59.2 vs 53.7). Applied judgement beats technical knowledge.<p>3. HR people (ironically who make hiring decisions using AI) understand AI the least, with the lowest AI fluency score.<p>4. People consistently say they are good with AI, but 2 out 3 fail to reach even proficient level.<p>5. The average AI fluency score across 1,800 professionals is 48 — squarely in the Developing tier. Most people use AI regularly but without systematic practice.<p>6. Company-wide AI training assumes everyone starts from the same place. The data says starting points vary by 5x within the same team.<p>7. Same company, same tools, same training budget. The gap between the least and most AI-fluent employee in one team was 82 points (15 to 97).<p>If you are sceptical (rightly so) you can review our methodology here: https://aisa.to/methodology