4 ms·

is mosquitto clusterable nowadays? on its own or via k8s? for: * fault tolerance * fail over * vertical scalability? does anyone know this? if not is there a

by deknos 5y ago

is mosquitto clusterable nowadays? on its own or via k8s? for: * fault tolerance * fail over * vertical scalability? does anyone know this? if not is there a another opensource mqtt broker which does that?

mlhales 5y ago
Mosquitto is not, we use RabbitMQ which runs on Erlang/OTP and has mqtt plug-ins. Mosquitto is single threaded. It's fast for sure but doesn't scale out. They can interoperate though as Mosquitto has configurable bridging.
eska 5y ago
There are broker implementations that support clustering. Emqx comes to mind.
serial_dev 5y ago
VerneMQ [0] could be interesting for you, they claim that: > VerneMQ is a high-performance, distributed MQTT broker. It scales horizontally and vertically on commodity hardware to support a high number of concurrent publishers and consumers while maintaining low latency and fault tolerance. I'm not sure about their licensing at the moment [1], to me it's a bit confusing. [0] https://vernemq.com/ https://vernemq.com/ [1] https://vernemq.com/blog/2019/11/26/vernemq-end-user-license-agreement.html https://vernemq.com/blog/2019/11/26/vernemq-end-user-license...
jonquark 5y ago
There are lots of brokers and Eclipse Amlen is coming soon: https://www.eclipse.org/amlen/ https://www.eclipse.org/amlen/ (disclosure: I work on Amlen)
ralight 5y ago
I work for Cedalo AG developing Mosquitto. Cedalo will be offering a version of Mosquitto with failover support as a paid for feature soon.
oneweekwonder 5y ago
Recently wanted to also create a cluster of mqtt brokers and found this medium tutorial stringing Docker Swarm, RabbitMQ, Consul and HAProxy together very helpful[0]. I was not happy with the static ip's for haproxy and opted to register the mqtt/tls services in consul and use the consul dns resolver with hapraxy. [0]: https://medium.com/hepsiburadatech/implementing-highly-available-rabbitmq-cluster-on-docker-swarm-using-consul-based-discovery-45c4e7919634 https://medium.com/hepsiburadatech/implementing-highly-avail...
discreteevent 5y ago
Have a look at Apache Artemis. Well architected multi-protocol broker with clustering.
nkristoffersen 5y ago
I'm running a cluster of Aedes backed by redis. https://github.com/moscajs/aedes https://github.com/moscajs/aedes I was inspired by this post by Bolt https://medium.com/bolt-labs/developing-software-for-bolt-scooters-how-we-built-the-communication-layer-involving-mqtt-protocol-d3c29627bd7d https://medium.com/bolt-labs/developing-software-for-bolt-sc...

by deknos 5y ago

mlhales 5y ago

Mosquitto is not, we use RabbitMQ which runs on Erlang/OTP and has mqtt plug-ins. Mosquitto is single threaded. It's fast for sure but doesn't scale out. They can interoperate though as Mosquitto has configurable bridging.

eska 5y ago

There are broker implementations that support clustering. Emqx comes to mind.

serial_dev 5y ago

VerneMQ [0] could be interesting for you, they claim that: > VerneMQ is a high-performance, distributed MQTT broker. It scales horizontally and vertically on commodity hardware to support a high number of concurrent publishers and consumers while maintaining low latency and fault tolerance. I'm not sure about their licensing at the moment [1], to me it's a bit confusing. [0] https://vernemq.com/ https://vernemq.com/ [1] https://vernemq.com/blog/2019/11/26/vernemq-end-user-license-agreement.html https://vernemq.com/blog/2019/11/26/vernemq-end-user-license...

jonquark 5y ago

There are lots of brokers and Eclipse Amlen is coming soon: https://www.eclipse.org/amlen/ https://www.eclipse.org/amlen/ (disclosure: I work on Amlen)

ralight 5y ago

I work for Cedalo AG developing Mosquitto. Cedalo will be offering a version of Mosquitto with failover support as a paid for feature soon.

oneweekwonder 5y ago

Recently wanted to also create a cluster of mqtt brokers and found this medium tutorial stringing Docker Swarm, RabbitMQ, Consul and HAProxy together very helpful[0]. I was not happy with the static ip's for haproxy and opted to register the mqtt/tls services in consul and use the consul dns resolver with hapraxy. [0]: https://medium.com/hepsiburadatech/implementing-highly-available-rabbitmq-cluster-on-docker-swarm-using-consul-based-discovery-45c4e7919634 https://medium.com/hepsiburadatech/implementing-highly-avail...

discreteevent 5y ago

Have a look at Apache Artemis. Well architected multi-protocol broker with clustering.

nkristoffersen 5y ago

I'm running a cluster of Aedes backed by redis. https://github.com/moscajs/aedes https://github.com/moscajs/aedes I was inspired by this post by Bolt https://medium.com/bolt-labs/developing-software-for-bolt-scooters-how-we-built-the-communication-layer-involving-mqtt-protocol-d3c29627bd7d https://medium.com/bolt-labs/developing-software-for-bolt-sc...