Redis Watch: Data Structures and Streaming Pipelines
A weekly wrap-up in Redis. Interesting things this week include Redis Streams, Redis for Time Series DB, Deduping, and Trdis with Spark.
Join the DZone community and get the full member experience.Join For Free
After a long time in the making (and partly because of a detour in favor of the modules API), v3.2 is finally out! With Geo,
#Lua replication and debugging, and too many more improvements to copy-paste. Also,
redis-cli got a revamp and has useful command hints and its own documentation page.
After the experience of doing the first development iteration of the modules API away from the public's, Lead Dev and his team have decided not to repeat that. As a result, we've moved our discussions to the
#redis channel on Freenode, and the Redis website now logs it.
A once-you-see-it-you-it-is-so-self-explanatory-that-you-are-ashamed-you-did-not-think-of-this-yourself addition to the documentation that I'm sure you already knew of.
Redis as a Time Series DB (1 Hour, 35 Minutes)
Probabilistic data structures, such as Bloom Filters and HyperLogLog, are extraordinary contraptions. This is just one of the many uses that they have and for more on these see immediately below.
Scalable Streaming Data Pipelines with Redis (53 Slides)
Counting Distinct Values With HyperLogLog (8 minutes)
By pure chance, here's presentation I gave on that this very same topic (albeit heavily modules-biased, naturally) earlier this week. And, coincidentally, another improbability was witnessed.
Josiah Carlson explains how he indexes.
A fast and lightweight Redis Cluster Proxy for Redis 3.0 — very interesting.
A Long Poll Ago in an AJAX Call Far, Far Away (7 Minutes)
What edition of the Redis Watch is complete w/o at least one article from Kyle @stockholmux?
Mike Perham, author of
#Sidekiq, tests the latter's concurrent limiter.
Andrei Kashchaworked around what have been vexing many users by redirecting
require to a table that his library composes. A very cool hack.
The problem: "We know we must avoid redis-cli keys.'" The solution: "bashrc script for redis-scan util to iterate Redis keys" by Evan Summers.
Simple Graph Traversals with Redis UDFs
Dunno how I missed this beauty from Sai Teja Pratap.
MDEL LUA Command for Redis Clients
... or simply use
PDEL from the rxkeys Redis module.
The newest version brings in support for Spark SQL, which IMO is pretty awesome. Special thanks go to Sun He for making everything possible.
Published at DZone with permission of Itamar Haber, DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.