Over a million developers have joined DZone.

Deep Learning and Machine Learning Killer Tools, Libraries, and Apps

DZone's Guide to

Deep Learning and Machine Learning Killer Tools, Libraries, and Apps

A selection of new tools, updates and libraries for doing some amazing deep learning and machine learning.

· Big Data Zone ·
Free Resource

The Architect’s Guide to Big Data Application Performance. Get the Guide.

TensorFlow has released a that includes an experimental Java API (using JNI). It's only a matter of time before TensorFlow reaches production Hadoop and Big Data clusters in Global 5000 industries.

I have seen my example TensorFlow scripts running very consistently without crashing for thousands of uses. The one thing missing is Enterprise support for TensorFlow, especially containerized and managed. I think a number of Big Data vendors will start doing that soon. IBM has added TensorFlow to PowerAI.

A good time to revisit and retry the Neural Image Caption Generator in TensorFlow, I will post my findings on how well it runs on a OSX 10.12 Intel 2.5 GHz i7 with 16 GB RAM.

Yet another Python library for neural networks, here is a cool example for Sentiment Analysis.

For analtyics, you have to try Airbnb's Superset (formerely Caravel) with PyHive for SparkSQL. Yet another cool Python tool.

sudo yum upgrade python-setuptools
sudo yum install gcc libffi-devel python-devel python-pip python-wheel openssl-devel libsasl2-devel openldap-devel
pip install virtualenv
virtualenv venv
. ./venv/bin/activate
pip install --upgrade setuptools pip
pip install mysqlclient 
pip install pyhive
pip install superset
fabmanager create-admin --app superset
2017-01-27 18:15:37,864:INFO:flask_appbuilder.security.sqla.manager:Created Permission View: menu access on Query Search
2017-01-27 18:15:37,885:INFO:flask_appbuilder.security.sqla.manager:Added Permission menu access on Query Search to role Admin
Recognized Database Authentications.
2017-01-27 18:15:37,907:INFO:flask_appbuilder.security.sqla.manager:Added user admin
Admin User admin created.
superset db upgrade
superset load_examples
superset init
superset runserver -p 8088


Image title

The above is an example report using example data, live running after a quick install.   This tool is slick and the results look great.   I am hoping the tool moves over to Apache and get's some enterprise support.   If it scales for Airbnb, it should work for most data loads.   It supports a number of Python SQLAlchemy connections including SparkSQL, Hive, MySQL, PostgreSQL, and others.  

Some very cool Deep Learning tutorials from Google: Learn TensorFlow and Deep Learning without a PHD and TensorFlow for MNIST Codelab. It's definitely time to start evaluating TensorFlow as it is now on Android, Linux, OSX, and RPi.

Everyone with a few gigabytes to spare, please Save the Data! Mirror the Climate Data from NOAA.

Learn how taking a DataOps approach will help you speed up processes and increase data quality by providing streamlined analytics pipelines via automation and testing. Learn More.

big data ,hadoop ,spark ,tensorflow ,python ,hive

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}