Over a million developers have joined DZone.

Exploring Apache Camel Core - DataSet Component

DZone's Guide to

Exploring Apache Camel Core - DataSet Component

· Java Zone
Free Resource

Download Microservices for Java Developers: A hands-on introduction to frameworks and containers. Brought to you in partnership with Red Hat.

A good sample data generator can help you test a program more thoroughly and help measure the processing throughput. The camel-core comes with a dataset component that can help you do this easily. All you need is to provide a bean that implements the org.apache.camel.component.dataset.DataSet interface, and bind it in the CamelContext registry. Here is an example:

package camelcoredemo;

import org.slf4j.*;
import org.apache.camel.*;
import org.apache.camel.builder.*;
import org.apache.camel.main.Main;
import org.apache.camel.component.dataset.*;

public class DataSetDemoCamel extends Main {
    static Logger LOG = LoggerFactory.getLogger(DataSetDemoCamel.class);
    public static void main(String[] args) throws Exception {
        DataSetDemoCamel main = new DataSetDemoCamel();
        main.bind("sampleGenerator", createDataSet());
    static RouteBuilder createRouteBuilder() {
        return new RouteBuilder() {
            public void configure() {
    static DataSet createDataSet() {
        return new SimpleDataSet();

Compile and run it.

mvn compile exec:java -Dexec.mainClass=camelcoredemo.DataSetDemoCamel

In this example, we have used the built-in org.apache.camel.component.dataset.SimpleDataSet implementation, which by default, will generate 10 messages with a text body set to <hello>world!</hello>. You may easily change the value, or even provide your own implementation starting with the org.apache.camel.component.dataset.DataSetSupport base class to customize your data set.

Use DataSet Component to Measure Throughput

One useful feature of the dataset component I found is using it to load test your Route. To do this, you have to adjust a couple of settings. Let’s say I want to load a large text file as sample input data and feed it to the Route, and then measure its throughput.

 static RouteBuilder createRouteBuilder() {
        return new RouteBuilder() {
            public void configure() {
    static DataSet createDataSet() {
        SimpleDataSet result = new SimpleDataSet();
        return result;

Replace above in the Main class and you will notice that it pumps 500 messages into the Route, and it samples every 100 messages and displays its through-rates. I have to add a produceDelay=0 option to the generator so it will not pause between messages. Then I have added a groupSize=100 option to the log component for throughput measurement. I skipped the readFileToString(String) demo code since I assume you can easily figure that out on your own. (Hint: Check out the Apache commons-io library.)

There is another side of the dataset component that you may use, and that is to receive and verify message content. You would simply use the same URL in a to(url) line. Internally Camel would assert your message body against your original.

There are more options available from the DataSet component that you may explore. Try it out with a Route and see it for yourself.

Download Building Reactive Microservices in Java: Asynchronous and Event-Based Application Design. Brought to you in partnership with Red Hat


Published at DZone with permission of Zemian Deng, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.


Dev Resources & Solutions Straight to Your Inbox

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.


{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}