DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports Events Over 2 million developers have joined DZone. Join Today! Thanks for visiting DZone today,
Edit Profile Manage Email Subscriptions Moderation Admin Console How to Post to DZone Article Submission Guidelines
View Profile
Sign Out
Refcards
Trend Reports
Events
Zones
Culture and Methodologies Agile Career Development Methodologies Team Management
Data Engineering AI/ML Big Data Data Databases IoT
Software Design and Architecture Cloud Architecture Containers Integration Microservices Performance Security
Coding Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
Culture and Methodologies
Agile Career Development Methodologies Team Management
Data Engineering
AI/ML Big Data Data Databases IoT
Software Design and Architecture
Cloud Architecture Containers Integration Microservices Performance Security
Coding
Frameworks Java JavaScript Languages Tools
Testing, Deployment, and Maintenance
Deployment DevOps and CI/CD Maintenance Monitoring and Observability Testing, Tools, and Frameworks
  1. DZone
  2. Software Design and Architecture
  3. Cloud Architecture
  4. Deploying a RabbitMQ Cluster at One Million Messages Per Second on Google Compute Engine

Deploying a RabbitMQ Cluster at One Million Messages Per Second on Google Compute Engine

Benjamin Ball user avatar by
Benjamin Ball
·
Jul. 03, 14 · Interview
Like (0)
Save
Tweet
Share
23.77K Views

Join the DZone community and get the full member experience.

Join For Free
Message queuing systems are an integral part of many business models where scalable applications are at the heart of systems development. One of the most popular (and growing) message queuing systems is RabbitMQ. I know that a lot of DZone developers have backed it as a great choice for a high-volume low-latency MQ, and I've seen it grown in popularity even in the last year.

Last week, Google and Pivotal released a guide to getting started with RabbitMQ clusters on Google Compute Engine. Google has backed RabbitMQ in this regard due to what I mentioned previously--high through-put, low latency, and in-memory queuing--all in a way that is easy to set up and deploy. Now Google and Pivotal are backing up their RabbitMQ praise with a benchmark release that demonstrates a RabbitMQ cluster handling a million messages per second through Google Compute Engine--a fantastic feat that definitely seems to back up their claims about high-performance on their platform. They spoke a little bit about their motivations:

"We also wanted to demonstrate that a RabbitMQ cluster running on Google Compute Engine is a good fit for high-throughput and low-latency scenarios. To do so, we ran a series of benchmarks in various configurations. These test clusters were able to sustain a throughput of over 1 million messages published and consumed per second (a sustained combined ingress/egress of over two million messages per second)."
So the idea is that Google rounded up the engineers at Pivotal (the company behind RabbitMQ). For their Google Compute Engine platform setup, they provisioned a cluster of 32 virtual machines with 8 vCPUs and 30GB of RAM each, and deployed RabbitMQ on Debian. To generate the load they used the RabbitMQ PerfTest tool. Here's some evidence of their benchmarks:


Screen Shot 2014-04-23 at 2.04.02 PM.png

These are definitely results that should interest the community at large. They reached a final conclusion:

Conclusion
We are excited to offer our customers an easy way to deploy RabbitMQ. We are proud that both Google and Pivotal benchmarks validate that Compute Engine is an excellent choice for running RabbitMQ in a public cloud

To deploy your own dedicated RabbitMQ cluster, go to Google Developer Console and navigate to an existing project, or create a new one, and you will have an option to deploy RabbitMQ from the project dashboard

Google Compute Engine Google (verb) cluster Engine

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • ChatGPT: The Unexpected API Test Automation Help
  • How To Check Docker Images for Vulnerabilities
  • Express Hibernate Queries as Type-Safe Java Streams
  • Select ChatGPT From SQL? You Bet!

Comments

Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends: