Over a million developers have joined DZone.

The Best of the Week (Mar. 7): Big Data Zone

DZone's Guide to

The Best of the Week (Mar. 7): Big Data Zone

· Big Data Zone ·
Free Resource

How to Simplify Apache Kafka. Get eBook.

Make sure you didn't miss anything with this list of the Best of the Week in the Big Data Zone (Mar. 7 to Mar. 13). Here they are, in order of popularity:

1. MapReduce on Avro Data Files

In this post we are going to write a MapReduce program to consume Avro input data and also produce data in Avro format. We will write a program to calculate average of student marks.

2. Big Data and Machine Learning: The Dehumanization of Everything

There is a lot of talk recently about the possible negative consequences of Big Data, machine learning, and the lack of data privacy. Facebook, for example, has a lot of data regarding a lot of people, and Mark Zuckerberg attended the annual NIPS conference and panels on deep learning, so what does it all mean?

3. Using Lucene's Search Server to Search Jira Issues

You may remember the author's first blog post describing how the Lucene developers eat our own dog food by using a Lucene search application to find our Jira issues. Recently, he's made some further progress, so he wanted to give an update.

4. XML to Avro Conversion

With Avro, the context and the values are separated. This means the schema/structure of what the information is does not get stored or streamed over and over and over and over (and over) again.

5. Big Data: When Single Node is Better than Clustered

There’s a lot of hype about “big data” and a general trend to try to apply Hadoop to almost every problem. However, sometimes it turns out that you can get much better results by writing an old-fashioned, but optimised, single-node version of your algorithm. 

12 Best Practices for Modern Data Ingestion. Download White Paper.


Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}