How to Run Scala-Implemented Storm Topologies on HDInsight
After setting up a Scala-implemented storm topology in order to count words, the next logical step is to create a Storm topology on HDInsight.
Join the DZone community and get the full member experience.
Join For FreePreviously, we set up a Scala-implemented storm topology in order to count words. What comes next is uploading our topology to HDInsight.
So, we shall proceed to create a Storm topology on HDInsight.
Then, we choose the instance types:
The next step is to upload our JAR file to the head node in order to deploy it. We can use SCP for this purpose.
scp target / scala - 2.12 / ScalaStorm - assembly - 1.0.jar {
your user
}
@ {
your azure endpoint
}: /home/demo
Now, we can SSH to our storm cluster’s head node and issue the storm command.
storm jar ScalaStorm-assembly-1.0.jar
com.gkatzioura.scala.storm.WordCountTopology word-count-stream-scala
Then, we can check our topology by navigating to https://{your cluster}.azurehdinsight.net/stormui.
And that's it! Now, you know how to run Scala-implemented storm topologies on HDInsight.
Published at DZone with permission of Emmanouil Gkatziouras, DZone MVB. See the original article here.
Opinions expressed by DZone contributors are their own.
Comments