Guglielmo Iozzia

Thanks Anirudh. Any Scala or Python code that works through the Spark Scala or PySpark shell I have used so far works through the Livy API.

Thank you for this detailed and comprehensive list.

The article includes the link to the Github repo hosting the full source code project presented here.

Challenges 2 and 3 are children of root challenge 1: when dev managers and Scrum masters don't care about testing and code quality then developers don't follow best practices of CI in their rush to commit code.

Thank you Eugen for driving people attention on performance issues early detection. This is a best practice still ignored by some developers and development managers.

Thanks Claire.

The Maven plugin automatically creates the UI in Jelly but it is possible anyway to implement it in Groovy.

I agree with Carol: Streamsets Data Collector and MapR Streams need to be brought to this discussion. Furthermore, my opinion is that Apache Flume in terms of use cases is becoming obsolete if compared to the other available options (and its latest release is from October 17 2016).

This article is probably the best (and for sure the most comprehensive) summary of Scrum anti-patterns ever.

Very well done article and analysis. I would like to add that Python is probably the easiest language to learn for newbies, but when it comes to large-scale and robust systems Scala is a better choice and the number of available analytics/ML frameworks and libraries for this language is comparable with the same for Python.

The multicore package has been removed from the CRAN repository. parallel could be used instead (it is part of the R distribution).