Over a million developers have joined DZone.

The Best of the Week (Apr. 25): Big Data Zone

DZone's Guide to

The Best of the Week (Apr. 25): Big Data Zone

· Big Data Zone ·
Free Resource

Learn how to operationalize machine learning and data science projects to monetize your AI initiatives. Download the Gartner report now.

Make sure you didn't miss anything with this list of the Best of the Week in the Big Data Zone (Apr. 25 to May 01). Here they are, in order of popularity:

1. IoT Creates Big Problems for Big Data

The overwhelming quantity of data on the horizon is a big issue alone, but don't forget about new data types, security, and emergent processing technology.

2. Lucene and Solr 4.8

Apache Lucene and Solr PMC announced another version of Apache Lucene library and Apache Solr search server numbered 4.8. This is a next release continuing the 4th version of both Apache Lucene and Apache Solr. This is also the first version of Lucene that requires JDK 7.

3. You Cannot Predict the Way You Die

After spending a day with yet another Heisenbug which seemed to change its shape whenever I got close to the cause, I thought my lessons learned from the case could be worth sharing.

4. Big Data Needs a Better Network

Hadoop is a fairly tough network problem to solve if you want to do anything more than “throw bandwidth at the problem”. And when you do throw bandwidth at the problem, the extreme burstiness of the traffic will still significantly drag down the performance of the overall solution.

5. Parameterizing Queries in Solr and Elasticsearch

We all know how good it is to have abstraction layers in software we create. Why not do the same with search queries? Can we even do that in Elasticsearch and Solr?


Bias comes in a variety of forms, all of them potentially damaging to the efficacy of your ML algorithm. Our Chief Data Scientist discusses the source of most headlines about AI failures here.


Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}