提问 HN:你如何设计一个高效的事务性/持久化任务系统?

1作者: stevefan19997 个月前
作为一个想要设计类似 EC2 的云资源调度系统的人,我一直很好奇它们是如何深入运作的。我知道我需要一个任务队列,但选择哪个呢?Kafka?NATS (JetStream)?RabbitMQ?或者他们真的只是用一些未开源的黑魔法设计了自己的持久化、可靠的任务队列? 直到今天我仍然不清楚。此外,我还专注于将其作为某种 Kubernetes Operator 运行。
查看原文
As someone who wants to design a cloud resource scheduling system similar to EC2, I always wonder how they works in depth. I know I&#x27;m going to need a task queue, but which? Kafka? NATS (JetStream)? RabbitMQ? Or if they really just design your own persistent durable task queue with some black magic which is not open sourced.<p>I still don&#x27;t know to this day. Plus I have a focus on running that as some kind of Kubernetes operator as well.