Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Retrieving Large Datasets in Mule ESB

DZone's Guide to

Retrieving Large Datasets in Mule ESB

· Integration Zone ·
Free Resource

SnapLogic is the leading self-service enterprise-grade integration platform. Download the 2018 GartnerMagic Quadrant for Enterprise iPaaS or play around on the platform, risk free, for 30 days.

Clare Cini recently wrote a useful example for performing a batch select and batch insert transfer of data between two databases with Mule ESB.  The documentation for Mule covers large dataset retrieval, but only briefly.  

The customer wanted to transfer items from one database to another by performing a batch select and then a batch insert. The ‘batch insert’ part is pretty straightforward and is done automatically by Mule when the payload is of type List. However, the batch select is mastered in a different way.
In order to retrieve all the records, we will use the Batch Manager to compute the ID ranges for the next batch of records to be retrieved. This is provided out of the box with Mule EE.

-- Clare Cini

Think of this as a useful addendum to the documentation.

With SnapLogic’s integration platform you can save millions of dollars, increase integrator productivity by 5X, and reduce integration time to value by 90%. Sign up for our risk-free 30-day trial!

Topics:

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}