What's new in RabbitMQ 3

There is a new version of RabbitMQ, and this is a list of the most important changes.

Routing Topologies for Performance and Scalability with RabbitMQ

Another interesting article on how to scale up architectures based on RabbitMQ. The rule of thumb is “do not use so many queues: use more routing information”

Official RabbitMQ tutorials for Python

The RabbitMQ guys have some nice tutorials for using this message queue from Python (using the Pika library), with some very descriptive graphs like this:

ZeroMQ =/= Erlang

From the RabbitMQ blog

A RabbitMQ to ZeroMQ gateway

With this RabbitMQ to ZeroMQ gateway you can:

  • push some ZeroMQ messages to remote 0MQ clusters by translating them to RabbitMQ messages.
  • use ZeroMQ as an interconnect to create federations of RabbitMQ brokers (also take a look at this federation mechanism)
  • use RabbitMQ as a gateway from ZeroMQ to other protocols such as AMQP, STOMP or XMPP.

So your software can use ZeroMQ for local, high-performance messages and the AMQP for reaching remote services. More details on other uses for this bridge.

I’m specially interested on how to use this RabbitMQ plugin for bringing federation in a hackish way. Federation allows you to bridge geographically separated clusters so that you can relay messages from one broker to other distant brokers, increasing scalability and performance on WANs.

AMQP topic exchange

Apache’s Qpid seems to implement this kind of functionality, and OpenAMQ also does so, but RabbitMQ lacks a mature solution that could be used in production. Federation sees to be achieved with Rabbitter (using XMPP for the inter-brokers communication) or with this ZeroMQ bridge, so, if I want to use it on a WAN environment, maybe I will be stuck with regular RabbitMQ’s clustering (some people say it gives some acceptable results), use the shovel plugin or make my own custom gateway…

Achieving Scale With Messaging And The Cloud, an introduction to RabbitMQ.

There are other AMQP systems like MRG, an enterprise-level implementation by RedHat (also available for Fedora), or Apache’s Qpid, but they are not supported by my preferred Python abstraction layer, Celery.

The guys at dotcloud provide this kind of AMQP services and they have documented how to do it from Python with Celery.