Building a Custom Processor in Apache NiFi for TensorFlow Using the Java API
Building a Custom Processor in Apache NiFi for TensorFlow Using the Java API
Learn how I used TensorFlow's new Java API with Apache NiFi, which uses a custom processor to perform image recognition.
Join the DZone community and get the full member experience.
Join For FreeEdgeVerve’s Business Applications built on AI platform Infosys Nia™ enables your enterprise to manage specific business areas and make the move from a deterministic to cognitive approach.
TensorFlow has released a Java API, so I decided to write a quick custom processor to run TensorFlow Inception v3.
It's a simple set of dependencies for Maven:
It's easy to add the new processor NiFi. First, build it using mvn install (see my build script), then deploy it:
cp nifi-tensorflow-nar/target/nifi-tensorflow-nar-1.0.nar /Volumes/Transcend/Apps/nifi-1.2.0/libOnce you restart NiFi, you can add the TensorFlow Processor.
An example flow is to the use the very smart ListFile , which will iterate through a list of files and keep track of the timestamp of files it last accessed. I point to a directory of files and the NiFi processor gets fed a ton of images to very quickly process. This is much faster than my calling out to a script.
I gave it a picture of my RV...
And this is what it guessed. The result of the run is a new attribute, probabilities, which is a string description of what it could be a confidence percentage as text:
Resources
- Data Lake 3.0: Containerization, Erasure Coding, GPU Pooling n
- HDF 2.0 Flow for Processing Real-Time Tweets
- Using an ASUS Tinkerboard with TensorFlow and Python
- Setting Up GPU-Enabled TensorFlow to Work With Zeppelin
- IoT Capturing Photos and Analyzing the Image With TensorFlow on a Raspberry Pi
- Analyzing Images in HDF 2.0 With TensorFlow
- Deep Learning IoT Workflows With Raspberry Pi MQTT
Adopting a digital strategy is just the beginning. For enterprise-wide digital transformation to truly take effect, you need an infrastructure that’s #BuiltOnAI. Click here to learn more.
Like This Article? Read More From DZone
Published at DZone with permission of Tim Spann , DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.
{{ parent.title || parent.header.title}}
{{ parent.tldr }}
{{ parent.linkDescription }}
{{ parent.urlSource.name }}