Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Scalable Architectures: Taming the Twitter Firehose

DZone's Guide to

Scalable Architectures: Taming the Twitter Firehose

· Database Zone
Free Resource

Finding a database that fits with a container-based deployment model can be frustrating. Learn what to look for in a Docker database

Scalable architectures: Taming the Twitter Firehose - Lorenzo Alberton from GrUSP on Vimeo.

Handling lots of real-time streams of information, when Twitter alone is producing 250+ million tweets a day and 27 million links to news and media, can be a daunting task.

This talk will cover how to develop a platform that can deal with billions of items per day, perform complex analysis and serve thousands of customers in real-time, by dissecting a large scale architecture into small components and explaining what processes to put in place, what pitfalls to avoid and how to keep the system running. We will walk through several scalability patterns, clever techniques and cutting-edge technologies, high-throughput message queues, nosql databases, monitoring tools, each accompanied by one or more concrete examples.

When you're looking for a SQL database that can scale elastically, while still preserving ACID guarantees, you only have a few choices. Find out how these elastic SQL databases perform in thishead-to-head YCSB benchmark.

Topics:

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}