Muse Spark 1.1 问题
1 分•作者: mzubairtahir•3 个月前
我在查看 Muse Spark 的基准测试时，起初它在 Terminal Bench 2.1 上得分 80，这看起来令人印象深刻。但随后我看到了 Vals AI 的帖子，其中显示 Muse Spark 的得分是 69.29。这再次证实了我的假设：基准测试确实不稳定，并不能说明全部情况。
我们该如何信任这些基准测试呢？
你们怎么看？或者是我遗漏了什么？
查看原文
I was checking benchmarks of muse spark and first it looked impressive that it scores 80 on terminal bench 2.1, but then i saw vals ai's post: in which they are showing that muse spark scores 69.29, which again proved my hypothesis true that benchmakrs are really inconsitent and does not tell whole story.<p>how to trust these benchmarks?
what would you say? or i am missing smth?