RabbitMQ — Reliable Open-Source Message Broker

What it is

RabbitMQ is one of the most widely deployed open-source message brokers. Built on Erlang/OTP, it implements the Advanced Message Queuing Protocol (AMQP) as its primary protocol and also supports MQTT, STOMP, HTTP, and WebSocket. It handles async messaging, task queues, pub/sub patterns, RPC, and microservice communication.

RabbitMQ suits backend teams that need reliable message delivery between services. It runs on Linux, macOS, and Windows, with official Docker images and Kubernetes operators available.

How it saves time or tokens

RabbitMQ decouples producers from consumers, letting services scale independently. Instead of polling or blocking on synchronous HTTP calls, services push messages to queues and move on. Failed consumers retry automatically with configurable dead-letter exchanges. This eliminates manual retry logic and reduces wasted compute on failed operations.

How to use

1. Run RabbitMQ with Docker using the management plugin for the web UI.
2. Connect a producer using the pika library (Python) or any AMQP client.
3. Connect a consumer that processes messages and acknowledges them.

docker run -d --name rabbitmq -p 5672:5672 -p 15672:15672 \
  -e RABBITMQ_DEFAULT_USER=admin -e RABBITMQ_DEFAULT_PASS=admin \
  rabbitmq:3-management

Example

A Python producer sending a persistent message to a durable queue:

import pika

conn = pika.BlockingConnection(pika.ConnectionParameters('localhost'))
channel = conn.channel()
channel.queue_declare(queue='tasks', durable=True)

channel.basic_publish(
    exchange='',
    routing_key='tasks',
    body='process order 42',
    properties=pika.BasicProperties(delivery_mode=2),
)
conn.close()

A consumer processing and acknowledging messages:

def callback(ch, method, properties, body):
    print(f'Received {body}')
    ch.basic_ack(delivery_tag=method.delivery_tag)

channel.basic_qos(prefetch_count=1)
channel.basic_consume(queue='tasks', on_message_callback=callback)
channel.start_consuming()

Related on TokRepo

• AI Tools for DevOps — Infrastructure and operations tools for modern backends
• AI Tools for Self-Hosted — Self-hosted alternatives for common infrastructure

Common pitfalls

• Forgetting to set durable=True on queues and delivery_mode=2 on messages means data loss on restart.
• The default guest user only works from localhost. Remote connections need a new user created via rabbitmqctl add_user.
• Unacknowledged messages accumulate in memory. Always set prefetch_count to limit how many messages a consumer holds at once.