Over a million developers have joined DZone.

Spring Batch – A Batch Framework Introduction

Learn more about Spring Batch, a batch framework built on Spring. We'll learn what batch programming is, and see the basics of Spring Batch.

Is iPaaS solving the right problems? Not knowing the fundamental difference between iPaaS and dPaaS could cost you down the road. Brought to you in partnership with Liaison Technologies.

In this article, we will see Spring Batch, a batch framework built on top of Spring framework. Before getting into Spring Batch, let us understand What is batch programming? A batch application is one which will perform a set of jobs without manual intervention. Let us take typical shopping site where we will get product catalog feed as a flat file. We need to process the feed file and upload the data to the shopping site product catalog database. In this case, we can write set of tasks to read the feed file, transform the data and then upload it to database behind the scenes. Spring Batch framework provides the necessary infrastructure to accomplish such kind of batch processing. Now, we will see the terminology used in Spring Batch framework.

Job: A job is a process which will perform a bunch of tasks. For example, Product Catalog processing is a job. This job has tasks like basic product info import task, product specifications import task, price info import task etc..

Step: A step is an individual piece of a task. For example, import price info as part of product catalog import job.

Item: Item is an individual entity. For example, a product is an item in the product catalog.

Chunk: Bunch of items are nothing but a chunk.

Job Repository: Job repository keeps track of job execution, status etc.. It has information such as job success, failure, when the failure occurred, from where the job has to restart etc…

ItemReader: Reader reads the data from any data source(eg: flat file, XML file, database, etc..)

ItemProcessor: Processor transforms the data before writing it to the data source. The ItemProcessor is optional in the Spring Batch job configuration.

ItemWriter: Writer writes the processed items to the data source (eg: flat file, XML file, database, etc…).

The below sequence diagram depicts the interaction of ItemReader, ItemProcessor, and ItemWriter.

Spring Batch











The ItemReader, ItemProcessor, and the ItemWriter interface implementations have to be provided to the Spring Batch job. The sample job configuration is given below.


<batch:job id="job1">
   <batch:step id="step1">
      <batch:tasklet transaction-manager="transactionManager">
         <batch:chunk reader="reader" writer="writer" processor="processor" commit-interval="1" />
     </batch:tasklet>
   </batch:step>
</batch:job>

The features of Spring Batch is given below:

  • Transaction management
  • Chunk based processing
  • Declarative I/O
  • Start/Stop/Restart
  • Retry/Skip
  • The Web-based administration interface (Spring Batch Admin)

In the coming articles will see sample Spring Batch sample applications. Till then stay tuned.

Discover the unprecedented possibilities and challenges, created by today’s fast paced data climate and why your current integration solution is not enough, brought to you in partnership with Liaison Technologies.

Topics:
spring batch ,integration ,batch programming ,spring

Published at DZone with permission of Siva Prasad Rao Janapati, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

The best of DZone straight to your inbox.

SEE AN EXAMPLE
Please provide a valid email address.

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.
Subscribe

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}