Deep Learning and Machine Learning Killer Tools, Libraries, and Apps

DZone 's Guide to

Deep Learning and Machine Learning Killer Tools, Libraries, and Apps

A selection of new tools, updates and libraries for doing some amazing deep learning and machine learning.

· Big Data Zone ·
Free Resource

TensorFlow has released a that includes an experimental Java API (using JNI). It's only a matter of time before TensorFlow reaches production Hadoop and Big Data clusters in Global 5000 industries.

I have seen my example TensorFlow scripts running very consistently without crashing for thousands of uses. The one thing missing is Enterprise support for TensorFlow, especially containerized and managed. I think a number of Big Data vendors will start doing that soon. IBM has added TensorFlow to PowerAI.

A good time to revisit and retry the Neural Image Caption Generator in TensorFlow, I will post my findings on how well it runs on a OSX 10.12 Intel 2.5 GHz i7 with 16 GB RAM.

Yet another Python library for neural networks, here is a cool example for Sentiment Analysis.

For analtyics, you have to try Airbnb's Superset (formerely Caravel) with PyHive for SparkSQL. Yet another cool Python tool.

sudo yum upgrade python-setuptools
sudo yum install gcc libffi-devel python-devel python-pip python-wheel openssl-devel libsasl2-devel openldap-devel
pip install virtualenv
virtualenv venv
. ./venv/bin/activate
pip install --upgrade setuptools pip
pip install mysqlclient 
pip install pyhive
pip install superset
fabmanager create-admin --app superset
2017-01-27 18:15:37,864:INFO:flask_appbuilder.security.sqla.manager:Created Permission View: menu access on Query Search
2017-01-27 18:15:37,885:INFO:flask_appbuilder.security.sqla.manager:Added Permission menu access on Query Search to role Admin
Recognized Database Authentications.
2017-01-27 18:15:37,907:INFO:flask_appbuilder.security.sqla.manager:Added user admin
Admin User admin created.
superset db upgrade
superset load_examples
superset init
superset runserver -p 8088


Image title

The above is an example report using example data, live running after a quick install.   This tool is slick and the results look great.   I am hoping the tool moves over to Apache and get's some enterprise support.   If it scales for Airbnb, it should work for most data loads.   It supports a number of Python SQLAlchemy connections including SparkSQL, Hive, MySQL, PostgreSQL, and others.  

Some very cool Deep Learning tutorials from Google: Learn TensorFlow and Deep Learning without a PHD and TensorFlow for MNIST Codelab. It's definitely time to start evaluating TensorFlow as it is now on Android, Linux, OSX, and RPi.

Everyone with a few gigabytes to spare, please Save the Data! Mirror the Climate Data from NOAA.

big data, hadoop, hive, python, spark, tensorflow

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}