Skip to main content

How to Build a Simple Message Queue in Node.js and RabbitMQ

The producer and consumer do not interact directly with each other, but they interact with message queue. This way of handling messages decouples the producer from the consumer so that they do not need to interact with the message queue simultaneously.

Initializing Node.js Application

Initialize the application using the following commands:

mkdir node-queue 

cd node-queue

npm init -y

touch index.js

Install the AMQP dependency which will be used for integrating Node.js application with RabbitMQ.

npm install –-save amqplib

Installing RabbitMQ

I have installed RabbitMQ to demonstrate this example by downloading here. Once you have installed, create a queue called ‘node_queue’.

How to Build a Simple Message Queue in Node.js and RabbitMQ

RabbitMQ

Implementing Producer

We will now implement a producer in Node.js application, which will put a message on the queue.

const amqp = require('amqplib/callback_api');

amqp.connect('amqp://localhost', function(error, connection) {
  if (error) {
    throw error;
  }
  connection.createChannel(function(error1, channel) {
    if (error1) {
      throw error1;
    }

    let queue = 'node_queue';
    let msg = 'Test message';

    channel.assertQueue(queue, {
      durable: true
    });
    channel.sendToQueue(queue, Buffer.from(msg), {
      persistent: true
    });
    console.log("Sent '%s'", msg);
  });
  setTimeout(function() {
    connection.close();
    process.exit(0)
  }, 500);
});

In the above code snippet, we have imported amqplib. We establish the connection to RabbitMQ server using amqp.connect(). Then we create a channel within which the API for sending message to the queue resides.

channel.assertQueue() asserts a queue into existence. If the queue does not exist, it will create on the server. The message will be sent to the server in byte array format. The connection will be closed after a short period of time.

Now, start the Node.js app by running the command: node index.js.

Navigate to the RabbitMQ dashboard. We will see that one message is ready on the queue.

How to Build a Simple Message Queue in Node.js and RabbitMQ

Shows that one message is available on queue

Implementing Consumer

Let us implement a consumer which will consume the message placed on the queue.

amqp.connect('amqp://localhost', function(error0, connection) {
  if (error0) {
    throw error0;
  }
  connection.createChannel(function(error1, channel) {
    if (error1) {
      throw error1;
    }
    var queue = 'node_queue';

    channel.assertQueue(queue, {
      durable: true
    });
    channel.prefetch(1);

    console.log("Waiting for messages in %s", queue);
    channel.consume(queue, function(msg) {

      console.log("Received '%s'", msg.content.toString());

      setTimeout(function() {
        channel.ack(msg);
      }, 1000);
    });
  });
});

Establishing the connection to RabbitMQ server is same as producer. We establish the connection and declare the queue from which we will consume messages.

We also assert queue here as consumer might start before the publisher, therefore we want to ensure that the queue exists before consumer tries to consume messages from it.

channel.consume() retrieves the message from the server.

Restart the application and navigate to the dashboard. We will see that no messages are left to be consumed.

How to Build a Simple Message Queue in Node.js and RabbitMQ

Shows that no message is waiting to be consumed

In this article, I have implemented both producer and consumer in the same application. Note that they can be configured separately depending on the requirement.

The complete example can be found on this GitHub repository.

Comments

Post a Comment

Popular posts from this blog

4 Ways to Communicate Across Browser Tabs in Realtime

1. Local Storage Events You might have already used LocalStorage, which is accessible across Tabs within the same application origin. But do you know that it also supports events? You can use this feature to communicate across Browser Tabs, where other Tabs will receive the event once the storage is updated. For example, let’s say in one Tab, we execute the following JavaScript code. window.localStorage.setItem("loggedIn", "true"); The other Tabs which listen to the event will receive it, as shown below. window.addEventListener('storage', (event) => { if (event.storageArea != localStorage) return; if (event.key === 'loggedIn') { // Do something with event.newValue } }); 2. Broadcast Channel API The Broadcast Channel API allows communication between Tabs, Windows, Frames, Iframes, and  Web Workers . One Tab can create and post to a channel as follows. const channel = new BroadcastChannel('app-data'); channel.postMessage(data); And oth...
Post a Comment
Read more

Certbot SSL configuration in ubuntu

  Introduction Let’s Encrypt is a Certificate Authority (CA) that provides an easy way to obtain and install free  TLS/SSL certificates , thereby enabling encrypted HTTPS on web servers. It simplifies the process by providing a software client, Certbot, that attempts to automate most (if not all) of the required steps. Currently, the entire process of obtaining and installing a certificate is fully automated on both Apache and Nginx. In this tutorial, you will use Certbot to obtain a free SSL certificate for Apache on Ubuntu 18.04 and set up your certificate to renew automatically. This tutorial will use a separate Apache virtual host file instead of the default configuration file.  We recommend  creating new Apache virtual host files for each domain because it helps to avoid common mistakes and maintains the default files as a fallback configuration. Prerequisites To follow this tutorial, you will need: One Ubuntu 18.04 server set up by following this  initial ...
Post a Comment
Read more

Working with Node.js streams

  Introduction Streams are one of the major features that most Node.js applications rely on, especially when handling HTTP requests, reading/writing files, and making socket communications. Streams are very predictable since we can always expect data, error, and end events when using streams. This article will teach Node developers how to use streams to efficiently handle large amounts of data. This is a typical real-world challenge faced by Node developers when they have to deal with a large data source, and it may not be feasible to process this data all at once. This article will cover the following topics: Types of streams When to adopt Node.js streams Batching Composing streams in Node.js Transforming data with transform streams Piping streams Error handling Node.js streams Types of streams The following are four main types of streams in Node.js: Readable streams: The readable stream is responsible for reading data from a source file Writable streams: The writable stream is re...
Post a Comment
Read more